[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:03:20 dist-test-slave-2w3w krb5kdc[15514](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:03:20 dist-test-slave-2w3w krb5kdc[15514](info): set up 2 sockets
Aug 11 08:03:20 dist-test-slave-2w3w krb5kdc[15514](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260811 08:03:22.114073 15507 mini_kdc.cc:121] Time spent starting KDC: real 1.247s user 0.004s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Aug 11 08:03:22 dist-test-slave-2w3w krb5kdc[15514](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435402, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:03:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:03:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.36.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab.
Entry for principal kudu/127.15.36.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab.
I20260811 08:03:22.284107 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:45221
--webserver_interface=127.15.36.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=kudu/127.15.36.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:35965
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.36.254:45221
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:03:22.421734 15531 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:03:22.422065 15531 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:03:22.422113 15531 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:03:22.424023 15531 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:03:22.424137 15531 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:03:22.424163 15531 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:03:22.424185 15531 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:03:22.424206 15531 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:03:22.426396 15531 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:35965
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.36.254:45221
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=kudu/127.15.36.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:45221
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.36.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15531
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:03:22.426811 15531 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:03:22.427135 15531 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:03:22.436708 15541 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:22.436704 15539 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:22.436857 15538 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:03:22.438189 15531 server_base.cc:1034] running on GCE node
I20260811 08:03:22.438680 15531 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:03:22.439865 15531 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:03:22.441136 15531 hybrid_clock.cc:648] HybridClock initialized: now 1786435402441131 us; error 92 us; skew 500 ppm
Aug 11 08:03:22 dist-test-slave-2w3w krb5kdc[15514](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435402, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:03:22.446559 15531 init.cc:377] Logged in from keytab as kudu/127.15.36.254@KRBTEST.COM (short username kudu)
I20260811 08:03:22.447206 15531 webserver.cc:460] Webserver started at http://127.15.36.254:43721/ using document root <none> and password file <none>
I20260811 08:03:22.447494 15531 fs_manager.cc:359] Metadata directory not provided
I20260811 08:03:22.447576 15531 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:03:22.447911 15531 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:03:22.449616 15531 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/minicluster-data/master-0/data/instance:
uuid: "f3ddd56a5833422ebc3a7b1fb43de1e7"
format_stamp: "Formatted at 2026-08-11 08:03:22 on dist-test-slave-2w3w"
server_key: "4c0b5017ed0e89f7bdccfaa7c733bec5"
server_key_iv: "e1b39c8875273f8ee9c21552739d61c8"
server_key_version: "encryptionkey@0"
I20260811 08:03:22.450121 15531 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/minicluster-data/master-0/wal/instance:
uuid: "f3ddd56a5833422ebc3a7b1fb43de1e7"
format_stamp: "Formatted at 2026-08-11 08:03:22 on dist-test-slave-2w3w"
server_key: "4c0b5017ed0e89f7bdccfaa7c733bec5"
server_key_iv: "e1b39c8875273f8ee9c21552739d61c8"
server_key_version: "encryptionkey@0"
I20260811 08:03:22.452777 15531 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.003s
I20260811 08:03:22.454366 15548 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:22.454737 15531 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260811 08:03:22.455018 15531 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/minicluster-data/master-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/minicluster-data/master-0/wal
uuid: "f3ddd56a5833422ebc3a7b1fb43de1e7"
format_stamp: "Formatted at 2026-08-11 08:03:22 on dist-test-slave-2w3w"
server_key: "4c0b5017ed0e89f7bdccfaa7c733bec5"
server_key_iv: "e1b39c8875273f8ee9c21552739d61c8"
server_key_version: "encryptionkey@0"
I20260811 08:03:22.455137 15531 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:03:22.469143 15531 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:03:22.473487 15531 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:03:22.474186 15531 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:03:22.486940 15531 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.254:45221
I20260811 08:03:22.487598 15531 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
I20260811 08:03:22.487596 15604 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.254:45221 every 8 connection(s)
I20260811 08:03:22.489157 15605 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:03:22.494249 15605 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f3ddd56a5833422ebc3a7b1fb43de1e7: Bootstrap starting.
I20260811 08:03:22.494489 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 15531
I20260811 08:03:22.494585 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/minicluster-data/master-0/wal/instance
I20260811 08:03:22.495831 15507 external_mini_cluster.cc:1428] Setting key 66217a3dc724a3dd97e6d08ded1994ef
I20260811 08:03:22.495978 15605 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f3ddd56a5833422ebc3a7b1fb43de1e7: Neither blocks nor log segments found. Creating new log.
I20260811 08:03:22.497057 15605 log.cc:824] T 00000000000000000000000000000000 P f3ddd56a5833422ebc3a7b1fb43de1e7: Log is configured to *not* fsync() on all Append() calls
I20260811 08:03:22.498234 15605 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f3ddd56a5833422ebc3a7b1fb43de1e7: No bootstrap required, opened a new log
I20260811 08:03:22.502857 15605 raft_consensus.cc:348] T 00000000000000000000000000000000 P f3ddd56a5833422ebc3a7b1fb43de1e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3ddd56a5833422ebc3a7b1fb43de1e7" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 45221 } }
I20260811 08:03:22.503222 15605 raft_consensus.cc:374] T 00000000000000000000000000000000 P f3ddd56a5833422ebc3a7b1fb43de1e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:03:22.503278 15605 raft_consensus.cc:729] T 00000000000000000000000000000000 P f3ddd56a5833422ebc3a7b1fb43de1e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ddd56a5833422ebc3a7b1fb43de1e7, State: Initialized, Role: FOLLOWER
I20260811 08:03:22.503448 15605 consensus_queue.cc:260] T 00000000000000000000000000000000 P f3ddd56a5833422ebc3a7b1fb43de1e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3ddd56a5833422ebc3a7b1fb43de1e7" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 45221 } }
I20260811 08:03:22.503556 15605 raft_consensus.cc:388] T 00000000000000000000000000000000 P f3ddd56a5833422ebc3a7b1fb43de1e7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:03:22.503593 15605 raft_consensus.cc:482] T 00000000000000000000000000000000 P f3ddd56a5833422ebc3a7b1fb43de1e7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:03:22.503674 15605 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f3ddd56a5833422ebc3a7b1fb43de1e7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:03:22.504695 15605 raft_consensus.cc:504] T 00000000000000000000000000000000 P f3ddd56a5833422ebc3a7b1fb43de1e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3ddd56a5833422ebc3a7b1fb43de1e7" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 45221 } }
I20260811 08:03:22.504853 15605 leader_election.cc:302] T 00000000000000000000000000000000 P f3ddd56a5833422ebc3a7b1fb43de1e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f3ddd56a5833422ebc3a7b1fb43de1e7; no voters:
I20260811 08:03:22.505089 15605 leader_election.cc:288] T 00000000000000000000000000000000 P f3ddd56a5833422ebc3a7b1fb43de1e7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:03:22.505302 15610 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f3ddd56a5833422ebc3a7b1fb43de1e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:03:22.505681 15605 sys_catalog.cc:564] T 00000000000000000000000000000000 P f3ddd56a5833422ebc3a7b1fb43de1e7 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:03:22.505698 15610 raft_consensus.cc:686] T 00000000000000000000000000000000 P f3ddd56a5833422ebc3a7b1fb43de1e7 [term 1 LEADER]: Becoming Leader. State: Replica: f3ddd56a5833422ebc3a7b1fb43de1e7, State: Running, Role: LEADER
I20260811 08:03:22.506004 15610 consensus_queue.cc:237] T 00000000000000000000000000000000 P f3ddd56a5833422ebc3a7b1fb43de1e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3ddd56a5833422ebc3a7b1fb43de1e7" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 45221 } }
I20260811 08:03:22.506659 15612 sys_catalog.cc:455] T 00000000000000000000000000000000 P f3ddd56a5833422ebc3a7b1fb43de1e7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f3ddd56a5833422ebc3a7b1fb43de1e7. Latest consensus state: current_term: 1 leader_uuid: "f3ddd56a5833422ebc3a7b1fb43de1e7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3ddd56a5833422ebc3a7b1fb43de1e7" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 45221 } } }
I20260811 08:03:22.506860 15612 sys_catalog.cc:458] T 00000000000000000000000000000000 P f3ddd56a5833422ebc3a7b1fb43de1e7 [sys.catalog]: This master's current role is: LEADER
I20260811 08:03:22.507140 15611 sys_catalog.cc:455] T 00000000000000000000000000000000 P f3ddd56a5833422ebc3a7b1fb43de1e7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f3ddd56a5833422ebc3a7b1fb43de1e7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3ddd56a5833422ebc3a7b1fb43de1e7" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 45221 } } }
I20260811 08:03:22.507231 15611 sys_catalog.cc:458] T 00000000000000000000000000000000 P f3ddd56a5833422ebc3a7b1fb43de1e7 [sys.catalog]: This master's current role is: LEADER
I20260811 08:03:22.508144 15617 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:03:22.509673 15617 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:03:22.512693 15617 catalog_manager.cc:1347] Generated new cluster ID: a3ba16547ab44b179cb4a4e4e7411dec
I20260811 08:03:22.512825 15617 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 08:03:22 dist-test-slave-2w3w krb5kdc[15514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435402, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:03:22.523963 15608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:22.497531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50590 (local address 127.15.36.254:45221)
0811 08:03:22.497858 (+ 327us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:22.497868 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:22.498044 (+ 176us) server_negotiation.cc:407] Connection header received
0811 08:03:22.503214 (+ 5170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:22.503227 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:22.503318 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:22.503594 (+ 276us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:22.506995 (+ 3401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:22.509533 (+ 2538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:22.512426 (+ 2893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:22.513112 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:22.513295 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:22.517857 (+ 4562us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:22.517863 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:22.517863 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:22.517877 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:22.520306 (+ 2429us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:22.520860 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:22.520863 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:22.520863 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:22.520959 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:22.521294 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:22.521295 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:22.521295 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:22.521562 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:22.522093 (+ 531us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:22.522452 (+ 359us) server_negotiation.cc:299] Negotiation successful
0811 08:03:22.523087 (+ 635us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":229,"thread_start_us":125,"threads_started":1}
I20260811 08:03:22.541102 15617 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:03:22.542029 15617 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:03:22.548802 15617 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f3ddd56a5833422ebc3a7b1fb43de1e7: Generated new TSK 0
I20260811 08:03:22.549137 15617 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.36.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab.
Entry for principal kudu/127.15.36.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab.
I20260811 08:03:22.629652 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.193:0
--local_ip_for_outbound_sockets=127.15.36.193
--webserver_interface=127.15.36.193
--webserver_port=0
--tserver_master_addrs=127.15.36.254:45221
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab
--principal=kudu/127.15.36.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:35965
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:03:22.790302 15632 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:03:22.790571 15632 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:03:22.790601 15632 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:03:22.792912 15632 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:03:22.792990 15632 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:03:22.793027 15632 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.193
I20260811 08:03:22.794997 15632 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:35965
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab
--principal=kudu/127.15.36.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.36.193
--webserver_port=0
--tserver_master_addrs=127.15.36.254:45221
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15632
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.193
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:03:22.795318 15632 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:03:22.795612 15632 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:03:22.803398 15637 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:22.803413 15641 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:22.803618 15639 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:03:22.803941 15632 server_base.cc:1034] running on GCE node
I20260811 08:03:22.804533 15632 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:03:22.804895 15632 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:03:22.806142 15632 hybrid_clock.cc:648] HybridClock initialized: now 1786435402806080 us; error 76 us; skew 500 ppm
Aug 11 08:03:22 dist-test-slave-2w3w krb5kdc[15514](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435402, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:03:22.810688 15632 init.cc:377] Logged in from keytab as kudu/127.15.36.193@KRBTEST.COM (short username kudu)
I20260811 08:03:22.811687 15632 webserver.cc:460] Webserver started at http://127.15.36.193:45611/ using document root <none> and password file <none>
I20260811 08:03:22.811982 15632 fs_manager.cc:359] Metadata directory not provided
I20260811 08:03:22.812064 15632 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:03:22.812232 15632 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:03:22.813426 15632 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/minicluster-data/ts-0/data/instance:
uuid: "a6a1cb616f5846519ca8c7298da6aeba"
format_stamp: "Formatted at 2026-08-11 08:03:22 on dist-test-slave-2w3w"
server_key: "b13c1b0a4e57bb952276dd0c8d488694"
server_key_iv: "9309014736301e0a1bdcc0b5c2312852"
server_key_version: "encryptionkey@0"
I20260811 08:03:22.813925 15632 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/minicluster-data/ts-0/wal/instance:
uuid: "a6a1cb616f5846519ca8c7298da6aeba"
format_stamp: "Formatted at 2026-08-11 08:03:22 on dist-test-slave-2w3w"
server_key: "b13c1b0a4e57bb952276dd0c8d488694"
server_key_iv: "9309014736301e0a1bdcc0b5c2312852"
server_key_version: "encryptionkey@0"
I20260811 08:03:22.816212 15632 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260811 08:03:22.817504 15648 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:22.817807 15632 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:03:22.817989 15632 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/minicluster-data/ts-0/wal
uuid: "a6a1cb616f5846519ca8c7298da6aeba"
format_stamp: "Formatted at 2026-08-11 08:03:22 on dist-test-slave-2w3w"
server_key: "b13c1b0a4e57bb952276dd0c8d488694"
server_key_iv: "9309014736301e0a1bdcc0b5c2312852"
server_key_version: "encryptionkey@0"
I20260811 08:03:22.818107 15632 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:03:22.841663 15632 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:03:22.845556 15632 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:03:22.845804 15632 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:03:22.846452 15632 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:03:22.847915 15632 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:03:22.848016 15632 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:22.848062 15632 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:03:22.848119 15632 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:22.857064 15632 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.193:45621
I20260811 08:03:22.857383 15771 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.193:45621 every 8 connection(s)
I20260811 08:03:22.857499 15632 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
I20260811 08:03:22.859310 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 15632
I20260811 08:03:22.859427 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/minicluster-data/ts-0/wal/instance
I20260811 08:03:22.859707 15507 external_mini_cluster.cc:1428] Setting key 9b163120647d91bf085cf726a762acbe
Aug 11 08:03:22 dist-test-slave-2w3w krb5kdc[15514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435402, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.193@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.15.36.194@KRBTEST.COM; defaulting to no policy
I20260811 08:03:22.874259 15608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:22.858695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:49991 (local address 127.15.36.254:45221)
0811 08:03:22.858893 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:22.858896 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:22.859222 (+ 326us) server_negotiation.cc:407] Connection header received
0811 08:03:22.860695 (+ 1473us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:22.860696 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:22.860709 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:22.860763 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:22.862266 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:22.863079 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:22.865593 (+ 2514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:22.865951 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:22.866042 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:22.869772 (+ 3730us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:22.869776 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:22.869776 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:22.869788 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:22.871972 (+ 2184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:22.872728 (+ 756us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:22.872729 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:22.872729 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:22.872807 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:22.873194 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:22.873195 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:22.873196 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:22.873553 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:22.873642 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:22.874079 (+ 437us) server_negotiation.cc:299] Negotiation successful
0811 08:03:22.874188 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170}
I20260811 08:03:22.874366 15774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:22.858665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:45221 (local address 127.15.36.193:49991)
0811 08:03:22.859068 (+ 403us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:22.859113 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:22.860572 (+ 1459us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:22.860851 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:22.860858 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:22.861685 (+ 827us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:03:22.862037 (+ 352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:22.862048 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:22.864025 (+ 1977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:22.864027 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:22.865428 (+ 1401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:22.865434 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:22.866240 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:22.866242 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:22.866471 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:22.867456 (+ 985us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:03:22.867467 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:03:22.869600 (+ 2133us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:03:22.872197 (+ 2597us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:22.872213 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:22.872217 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:22.872607 (+ 390us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:22.872935 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:22.872935 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:22.872936 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:22.873081 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:22.873663 (+ 582us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:03:22.873670 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:03:22.873824 (+ 154us) client_negotiation.cc:769] Sending connection context
0811 08:03:22.873923 (+ 99us) client_negotiation.cc:240] Negotiation successful
0811 08:03:22.874073 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":350,"thread_start_us":274,"threads_started":1}
I20260811 08:03:22.875128 15772 heartbeater.cc:347] Connected to a master server at 127.15.36.254:45221
I20260811 08:03:22.875248 15772 heartbeater.cc:464] Registering TS with master...
I20260811 08:03:22.875483 15772 heartbeater.cc:511] Master 127.15.36.254:45221 requested a full tablet report, sending...
I20260811 08:03:22.876199 15566 ts_manager.cc:194] Registered new tserver with Master: a6a1cb616f5846519ca8c7298da6aeba (127.15.36.193:45621)
I20260811 08:03:22.876868 15566 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.36.193@KRBTEST.COM'} at 127.15.36.193:49991
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab.
Entry for principal kudu/127.15.36.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab.
I20260811 08:03:22.913465 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.194:0
--local_ip_for_outbound_sockets=127.15.36.194
--webserver_interface=127.15.36.194
--webserver_port=0
--tserver_master_addrs=127.15.36.254:45221
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab
--principal=kudu/127.15.36.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:35965
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:03:23.040423 15777 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:03:23.040712 15777 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:03:23.040774 15777 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:03:23.042471 15777 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:03:23.042611 15777 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:03:23.042671 15777 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.194
I20260811 08:03:23.047073 15777 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:35965
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab
--principal=kudu/127.15.36.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.36.194
--webserver_port=0
--tserver_master_addrs=127.15.36.254:45221
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15777
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.194
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:03:23.047485 15777 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:03:23.047907 15777 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:03:23.057595 15785 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:23.057761 15782 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:23.057598 15783 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:03:23.059583 15777 server_base.cc:1034] running on GCE node
I20260811 08:03:23.059875 15777 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:03:23.060145 15777 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:03:23.067615 15777 hybrid_clock.cc:648] HybridClock initialized: now 1786435403067635 us; error 124 us; skew 500 ppm
Aug 11 08:03:23 dist-test-slave-2w3w krb5kdc[15514](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435403, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:03:23.071874 15777 init.cc:377] Logged in from keytab as kudu/127.15.36.194@KRBTEST.COM (short username kudu)
I20260811 08:03:23.072535 15777 webserver.cc:460] Webserver started at http://127.15.36.194:46053/ using document root <none> and password file <none>
I20260811 08:03:23.072857 15777 fs_manager.cc:359] Metadata directory not provided
I20260811 08:03:23.072940 15777 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:03:23.073099 15777 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:03:23.075040 15777 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/minicluster-data/ts-1/data/instance:
uuid: "f428ae0d07e749aab5d8ff4676153af3"
format_stamp: "Formatted at 2026-08-11 08:03:23 on dist-test-slave-2w3w"
server_key: "50b1efa2a68460731496d533447dcd90"
server_key_iv: "3772f84f76434676da585b16a9549210"
server_key_version: "encryptionkey@0"
I20260811 08:03:23.075634 15777 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/minicluster-data/ts-1/wal/instance:
uuid: "f428ae0d07e749aab5d8ff4676153af3"
format_stamp: "Formatted at 2026-08-11 08:03:23 on dist-test-slave-2w3w"
server_key: "50b1efa2a68460731496d533447dcd90"
server_key_iv: "3772f84f76434676da585b16a9549210"
server_key_version: "encryptionkey@0"
I20260811 08:03:23.078130 15777 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.002s
I20260811 08:03:23.079540 15793 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:23.079854 15777 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:03:23.079958 15777 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/minicluster-data/ts-1/wal
uuid: "f428ae0d07e749aab5d8ff4676153af3"
format_stamp: "Formatted at 2026-08-11 08:03:23 on dist-test-slave-2w3w"
server_key: "50b1efa2a68460731496d533447dcd90"
server_key_iv: "3772f84f76434676da585b16a9549210"
server_key_version: "encryptionkey@0"
I20260811 08:03:23.080035 15777 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:03:23.100103 15777 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:03:23.103382 15777 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:03:23.103529 15777 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:03:23.103756 15777 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:03:23.104163 15777 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:03:23.104210 15777 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:23.104242 15777 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:03:23.104256 15777 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:23.114683 15777 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.194:45521
I20260811 08:03:23.115181 15777 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
I20260811 08:03:23.115180 15917 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.194:45521 every 8 connection(s)
I20260811 08:03:23.122243 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 15777
I20260811 08:03:23.122354 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/minicluster-data/ts-1/wal/instance
I20260811 08:03:23.122543 15507 external_mini_cluster.cc:1428] Setting key 7a9bc5888cae4a593ebcff196e57e7ba
Aug 11 08:03:23 dist-test-slave-2w3w krb5kdc[15514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435403, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.194@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:03:23.129645 15608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:23.116196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:38257 (local address 127.15.36.254:45221)
0811 08:03:23.116247 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:23.116249 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:23.116390 (+ 141us) server_negotiation.cc:407] Connection header received
0811 08:03:23.116983 (+ 593us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:23.116984 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:23.116996 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:23.117064 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:23.118842 (+ 1778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:23.119440 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:23.120747 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:23.120956 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:23.121326 (+ 370us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:23.124732 (+ 3406us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:23.124734 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:23.124734 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:23.124744 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:23.127440 (+ 2696us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:23.128020 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:23.128021 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:23.128022 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:23.128101 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:23.128451 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:23.128451 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:23.128452 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:23.128631 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:23.128718 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:23.129403 (+ 685us) server_negotiation.cc:299] Negotiation successful
0811 08:03:23.129517 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 08:03:23.129765 15920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:23.116017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:45221 (local address 127.15.36.194:38257)
0811 08:03:23.116252 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:23.116299 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:23.116844 (+ 545us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:23.117374 (+ 530us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:23.117378 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:23.118448 (+ 1070us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:03:23.118692 (+ 244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:23.118698 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:23.119564 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:23.119565 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:23.120567 (+ 1002us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:23.120571 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:23.121381 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:23.121382 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:23.121552 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:23.122587 (+ 1035us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:03:23.122602 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:03:23.124595 (+ 1993us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:03:23.127595 (+ 3000us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:23.127608 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:23.127610 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:23.127923 (+ 313us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:23.128202 (+ 279us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:23.128203 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:23.128203 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:23.128368 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:23.128741 (+ 373us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:03:23.128748 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:03:23.129122 (+ 374us) client_negotiation.cc:769] Sending connection context
0811 08:03:23.129335 (+ 213us) client_negotiation.cc:240] Negotiation successful
0811 08:03:23.129522 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":149,"threads_started":1}
I20260811 08:03:23.130704 15918 heartbeater.cc:347] Connected to a master server at 127.15.36.254:45221
I20260811 08:03:23.131281 15918 heartbeater.cc:464] Registering TS with master...
I20260811 08:03:23.131534 15918 heartbeater.cc:511] Master 127.15.36.254:45221 requested a full tablet report, sending...
I20260811 08:03:23.132107 15566 ts_manager.cc:194] Registered new tserver with Master: f428ae0d07e749aab5d8ff4676153af3 (127.15.36.194:45521)
I20260811 08:03:23.132778 15566 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.36.194@KRBTEST.COM'} at 127.15.36.194:38257
WARNING: no policy specified for kudu/127.15.36.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab.
Entry for principal kudu/127.15.36.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab.
I20260811 08:03:23.172216 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.195:0
--local_ip_for_outbound_sockets=127.15.36.195
--webserver_interface=127.15.36.195
--webserver_port=0
--tserver_master_addrs=127.15.36.254:45221
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab
--principal=kudu/127.15.36.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:35965
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:03:23.292099 15923 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:03:23.292373 15923 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:03:23.292403 15923 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:03:23.293869 15923 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:03:23.293944 15923 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:03:23.293978 15923 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.195
I20260811 08:03:23.296286 15923 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:35965
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab
--principal=kudu/127.15.36.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.36.195
--webserver_port=0
--tserver_master_addrs=127.15.36.254:45221
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15923
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.195
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:03:23.296628 15923 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:03:23.296933 15923 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 08:03:23.306164 15923 server_base.cc:1034] running on GCE node
W20260811 08:03:23.306114 15932 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:23.306130 15930 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:23.306135 15929 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:03:23.307184 15923 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:03:23.307507 15923 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:03:23.308733 15923 hybrid_clock.cc:648] HybridClock initialized: now 1786435403308473 us; error 288 us; skew 500 ppm
Aug 11 08:03:23 dist-test-slave-2w3w krb5kdc[15514](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435403, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:03:23.312368 15923 init.cc:377] Logged in from keytab as kudu/127.15.36.195@KRBTEST.COM (short username kudu)
I20260811 08:03:23.313036 15923 webserver.cc:460] Webserver started at http://127.15.36.195:40921/ using document root <none> and password file <none>
I20260811 08:03:23.313378 15923 fs_manager.cc:359] Metadata directory not provided
I20260811 08:03:23.313468 15923 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:03:23.313652 15923 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:03:23.315251 15923 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/minicluster-data/ts-2/data/instance:
uuid: "6cc20d1c35d243b8803833bffa032cc8"
format_stamp: "Formatted at 2026-08-11 08:03:23 on dist-test-slave-2w3w"
server_key: "ad6bba5d8e913240485e091bc06275ed"
server_key_iv: "3878098e7f8cfa00835757907d66423a"
server_key_version: "encryptionkey@0"
I20260811 08:03:23.315688 15923 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/minicluster-data/ts-2/wal/instance:
uuid: "6cc20d1c35d243b8803833bffa032cc8"
format_stamp: "Formatted at 2026-08-11 08:03:23 on dist-test-slave-2w3w"
server_key: "ad6bba5d8e913240485e091bc06275ed"
server_key_iv: "3878098e7f8cfa00835757907d66423a"
server_key_version: "encryptionkey@0"
I20260811 08:03:23.317457 15923 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260811 08:03:23.318636 15940 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:23.319401 15923 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:03:23.319634 15923 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/minicluster-data/ts-2/wal
uuid: "6cc20d1c35d243b8803833bffa032cc8"
format_stamp: "Formatted at 2026-08-11 08:03:23 on dist-test-slave-2w3w"
server_key: "ad6bba5d8e913240485e091bc06275ed"
server_key_iv: "3878098e7f8cfa00835757907d66423a"
server_key_version: "encryptionkey@0"
I20260811 08:03:23.320081 15923 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:03:23.339437 15923 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:03:23.343669 15923 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:03:23.343834 15923 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:03:23.344173 15923 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:03:23.344563 15923 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:03:23.344623 15923 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:23.344659 15923 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:03:23.344707 15923 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:23.354019 15923 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.195:41517
I20260811 08:03:23.354074 16060 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.195:41517 every 8 connection(s)
I20260811 08:03:23.354519 15923 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
I20260811 08:03:23.360906 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 15923
I20260811 08:03:23.361160 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786435400844580-15507-0/minicluster-data/ts-2/wal/instance
I20260811 08:03:23.361378 15507 external_mini_cluster.cc:1428] Setting key 87419077a4bb186a62742331ea485fc7
Aug 11 08:03:23 dist-test-slave-2w3w krb5kdc[15514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435403, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.195@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:03:23.367911 15608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:23.355871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:58099 (local address 127.15.36.254:45221)
0811 08:03:23.355953 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:23.355955 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:23.356163 (+ 208us) server_negotiation.cc:407] Connection header received
0811 08:03:23.356943 (+ 780us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:23.356944 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:23.356960 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:23.357030 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:23.358607 (+ 1577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:23.359465 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:23.360755 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:23.361245 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:23.361342 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:23.364423 (+ 3081us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:23.364425 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:23.364426 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:23.364434 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:23.366146 (+ 1712us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:23.366678 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:23.366679 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:23.366679 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:23.366749 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:23.367120 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:23.367121 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:23.367121 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:23.367302 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:23.367371 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:23.367745 (+ 374us) server_negotiation.cc:299] Negotiation successful
0811 08:03:23.367835 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 08:03:23.368347 16063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:23.355751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:45221 (local address 127.15.36.195:58099)
0811 08:03:23.355971 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:23.356018 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:23.356722 (+ 704us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:23.357345 (+ 623us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:23.357349 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:23.358018 (+ 669us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:03:23.358329 (+ 311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:23.358336 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:23.359573 (+ 1237us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:23.359574 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:23.360626 (+ 1052us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:23.360628 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:23.361378 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:23.361379 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:23.361545 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:23.362464 (+ 919us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:03:23.362475 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:03:23.364279 (+ 1804us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:03:23.366258 (+ 1979us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:23.366268 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:23.366270 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:23.366586 (+ 316us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:23.366837 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:23.366838 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:23.366838 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:23.367033 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:23.367391 (+ 358us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:03:23.367399 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:03:23.367546 (+ 147us) client_negotiation.cc:769] Sending connection context
0811 08:03:23.367656 (+ 110us) client_negotiation.cc:240] Negotiation successful
0811 08:03:23.367831 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":136,"threads_started":1}
I20260811 08:03:23.369009 16061 heartbeater.cc:347] Connected to a master server at 127.15.36.254:45221
I20260811 08:03:23.369135 16061 heartbeater.cc:464] Registering TS with master...
I20260811 08:03:23.369307 16061 heartbeater.cc:511] Master 127.15.36.254:45221 requested a full tablet report, sending...
I20260811 08:03:23.369774 15566 ts_manager.cc:194] Registered new tserver with Master: 6cc20d1c35d243b8803833bffa032cc8 (127.15.36.195:41517)
I20260811 08:03:23.370260 15566 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.36.195@KRBTEST.COM'} at 127.15.36.195:58099
I20260811 08:03:23.374562 15507 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 08:03:23 dist-test-slave-2w3w krb5kdc[15514](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435403, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 08:03:23 dist-test-slave-2w3w krb5kdc[15514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435403, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.15.36.193@KRBTEST.COM
I20260811 08:03:23.406782 16069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:23.394613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50950 (local address 127.15.36.193:45621)
0811 08:03:23.394758 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:23.394764 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:23.394785 (+ 21us) server_negotiation.cc:407] Connection header received
0811 08:03:23.394814 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:23.394816 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:23.394832 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:23.394901 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:23.395681 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:23.396429 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:23.397255 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:23.397610 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:23.397676 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:23.401819 (+ 4143us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:23.401845 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:23.401846 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:23.401861 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:23.404546 (+ 2685us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:23.405405 (+ 859us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:23.405410 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:23.405411 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:23.405522 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:23.405952 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:23.405953 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:23.405953 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:23.406250 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:23.406508 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:23.406607 (+ 99us) server_negotiation.cc:299] Negotiation successful
0811 08:03:23.406696 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":78,"threads_started":1}
W20260811 08:03:23.407295 15679 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50950
Aug 11 08:03:23 dist-test-slave-2w3w krb5kdc[15514](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435403, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 08:03:23 dist-test-slave-2w3w krb5kdc[15514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435403, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.36.193@KRBTEST.COM
I20260811 08:03:23.441629 16069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:23.428027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50958 (local address 127.15.36.193:45621)
0811 08:03:23.428112 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:23.428115 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:23.428336 (+ 221us) server_negotiation.cc:407] Connection header received
0811 08:03:23.428515 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:23.428516 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:23.428533 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:23.428595 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:23.429351 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:23.429920 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:23.431065 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:23.431270 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:23.431345 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:23.435586 (+ 4241us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:23.435588 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:23.435589 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:23.435599 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:23.439542 (+ 3943us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:23.440148 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:23.440149 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:23.440150 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:23.440220 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:23.440679 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:23.440680 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:23.440681 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:23.440934 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:23.441047 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:23.441347 (+ 300us) server_negotiation.cc:299] Negotiation successful
0811 08:03:23.441486 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 08:03:23.443106 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 15632
I20260811 08:03:23.453696 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 15777
I20260811 08:03:23.461333 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 15923
I20260811 08:03:23.469406 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 15531
2026-08-11T08:03:23Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2634 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:03:23 dist-test-slave-2w3w krb5kdc[16076](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:03:23 dist-test-slave-2w3w krb5kdc[16076](info): set up 2 sockets
Aug 11 08:03:23 dist-test-slave-2w3w krb5kdc[16076](info): commencing operation
krb5kdc: starting...
W20260811 08:03:24.880594 15507 mini_kdc.cc:121] Time spent starting KDC: real 1.386s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Aug 11 08:03:24 dist-test-slave-2w3w krb5kdc[16076](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435404, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:03:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:03:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.36.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab.
Entry for principal kudu/127.15.36.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab.
I20260811 08:03:25.048942 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:37233
--webserver_interface=127.15.36.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=kudu/127.15.36.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:42703
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.36.254:37233
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:03:25.155128 16089 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:03:25.155395 16089 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:03:25.155422 16089 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:03:25.156831 16089 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:03:25.156905 16089 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:03:25.156922 16089 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:03:25.156935 16089 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:03:25.156948 16089 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:03:25.160241 16089 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:42703
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.36.254:37233
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=kudu/127.15.36.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:37233
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.36.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16089
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:03:25.160526 16089 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:03:25.161038 16089 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:03:25.168145 16097 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:25.168145 16095 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:25.168387 16094 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:03:25.169072 16089 server_base.cc:1034] running on GCE node
I20260811 08:03:25.169409 16089 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:03:25.169785 16089 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:03:25.171044 16089 hybrid_clock.cc:648] HybridClock initialized: now 1786435405171004 us; error 47 us; skew 500 ppm
Aug 11 08:03:25 dist-test-slave-2w3w krb5kdc[16076](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435405, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:03:25.175235 16089 init.cc:377] Logged in from keytab as kudu/127.15.36.254@KRBTEST.COM (short username kudu)
I20260811 08:03:25.176043 16089 webserver.cc:460] Webserver started at http://127.15.36.254:46195/ using document root <none> and password file <none>
I20260811 08:03:25.176350 16089 fs_manager.cc:359] Metadata directory not provided
I20260811 08:03:25.176430 16089 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:03:25.176596 16089 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:03:25.177790 16089 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/minicluster-data/master-0/data/instance:
uuid: "1d4ee7107d254d68b64faabafd6ea54e"
format_stamp: "Formatted at 2026-08-11 08:03:25 on dist-test-slave-2w3w"
server_key: "d69807bf217848172234a18be30aada5"
server_key_iv: "250a952ac8150f8a2497143d7091fbf6"
server_key_version: "encryptionkey@0"
I20260811 08:03:25.178226 16089 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/minicluster-data/master-0/wal/instance:
uuid: "1d4ee7107d254d68b64faabafd6ea54e"
format_stamp: "Formatted at 2026-08-11 08:03:25 on dist-test-slave-2w3w"
server_key: "d69807bf217848172234a18be30aada5"
server_key_iv: "250a952ac8150f8a2497143d7091fbf6"
server_key_version: "encryptionkey@0"
I20260811 08:03:25.180212 16089 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.003s
I20260811 08:03:25.181492 16105 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:25.181748 16089 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:03:25.181931 16089 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/minicluster-data/master-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/minicluster-data/master-0/wal
uuid: "1d4ee7107d254d68b64faabafd6ea54e"
format_stamp: "Formatted at 2026-08-11 08:03:25 on dist-test-slave-2w3w"
server_key: "d69807bf217848172234a18be30aada5"
server_key_iv: "250a952ac8150f8a2497143d7091fbf6"
server_key_version: "encryptionkey@0"
I20260811 08:03:25.182192 16089 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:03:25.199357 16089 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:03:25.203044 16089 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:03:25.203281 16089 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:03:25.209668 16089 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.254:37233
I20260811 08:03:25.209990 16159 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.254:37233 every 8 connection(s)
I20260811 08:03:25.210484 16089 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
I20260811 08:03:25.211876 16160 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:03:25.214421 16160 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d4ee7107d254d68b64faabafd6ea54e: Bootstrap starting.
I20260811 08:03:25.215103 16160 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1d4ee7107d254d68b64faabafd6ea54e: Neither blocks nor log segments found. Creating new log.
I20260811 08:03:25.215363 16160 log.cc:824] T 00000000000000000000000000000000 P 1d4ee7107d254d68b64faabafd6ea54e: Log is configured to *not* fsync() on all Append() calls
I20260811 08:03:25.216176 16160 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d4ee7107d254d68b64faabafd6ea54e: No bootstrap required, opened a new log
I20260811 08:03:25.217871 16160 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1d4ee7107d254d68b64faabafd6ea54e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d4ee7107d254d68b64faabafd6ea54e" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 37233 } }
I20260811 08:03:25.218044 16160 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1d4ee7107d254d68b64faabafd6ea54e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:03:25.218068 16160 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1d4ee7107d254d68b64faabafd6ea54e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d4ee7107d254d68b64faabafd6ea54e, State: Initialized, Role: FOLLOWER
I20260811 08:03:25.218231 16160 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1d4ee7107d254d68b64faabafd6ea54e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d4ee7107d254d68b64faabafd6ea54e" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 37233 } }
I20260811 08:03:25.218313 16160 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1d4ee7107d254d68b64faabafd6ea54e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:03:25.218339 16160 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1d4ee7107d254d68b64faabafd6ea54e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:03:25.218389 16160 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1d4ee7107d254d68b64faabafd6ea54e [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:03:25.219452 16160 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1d4ee7107d254d68b64faabafd6ea54e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d4ee7107d254d68b64faabafd6ea54e" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 37233 } }
I20260811 08:03:25.219575 16160 leader_election.cc:302] T 00000000000000000000000000000000 P 1d4ee7107d254d68b64faabafd6ea54e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1d4ee7107d254d68b64faabafd6ea54e; no voters:
I20260811 08:03:25.219790 16160 leader_election.cc:288] T 00000000000000000000000000000000 P 1d4ee7107d254d68b64faabafd6ea54e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:03:25.219828 16163 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1d4ee7107d254d68b64faabafd6ea54e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:03:25.219967 16163 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1d4ee7107d254d68b64faabafd6ea54e [term 1 LEADER]: Becoming Leader. State: Replica: 1d4ee7107d254d68b64faabafd6ea54e, State: Running, Role: LEADER
I20260811 08:03:25.220062 16163 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1d4ee7107d254d68b64faabafd6ea54e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d4ee7107d254d68b64faabafd6ea54e" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 37233 } }
I20260811 08:03:25.220104 16160 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1d4ee7107d254d68b64faabafd6ea54e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:03:25.220373 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 16089
I20260811 08:03:25.220469 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/minicluster-data/master-0/wal/instance
I20260811 08:03:25.220649 15507 external_mini_cluster.cc:1428] Setting key fcb22d950b52623d081e8ba1c920878f
I20260811 08:03:25.220793 16164 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d4ee7107d254d68b64faabafd6ea54e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1d4ee7107d254d68b64faabafd6ea54e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d4ee7107d254d68b64faabafd6ea54e" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 37233 } } }
I20260811 08:03:25.220885 16164 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d4ee7107d254d68b64faabafd6ea54e [sys.catalog]: This master's current role is: LEADER
I20260811 08:03:25.220923 16166 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d4ee7107d254d68b64faabafd6ea54e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1d4ee7107d254d68b64faabafd6ea54e. Latest consensus state: current_term: 1 leader_uuid: "1d4ee7107d254d68b64faabafd6ea54e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d4ee7107d254d68b64faabafd6ea54e" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 37233 } } }
I20260811 08:03:25.221017 16166 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d4ee7107d254d68b64faabafd6ea54e [sys.catalog]: This master's current role is: LEADER
I20260811 08:03:25.221199 16173 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:03:25.221810 16173 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:03:25.223716 16173 catalog_manager.cc:1347] Generated new cluster ID: 383c49363a764505b7a4f5710c6b33cf
I20260811 08:03:25.224030 16173 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 08:03:25 dist-test-slave-2w3w krb5kdc[16076](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435404, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:03:25.235862 16180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:25.221389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54634 (local address 127.15.36.254:37233)
0811 08:03:25.221794 (+ 405us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:25.221805 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:25.221840 (+ 35us) server_negotiation.cc:407] Connection header received
0811 08:03:25.221977 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:25.221984 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:25.222051 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:25.222201 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:25.222917 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:25.224858 (+ 1941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:25.226345 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:25.227202 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:25.227331 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:25.231105 (+ 3774us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:25.231112 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:25.231112 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:25.231130 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:25.233666 (+ 2536us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:25.234192 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:25.234197 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:25.234198 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:25.234348 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:25.234616 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:25.234617 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:25.234618 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:25.234997 (+ 379us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:25.235342 (+ 345us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:25.235432 (+ 90us) server_negotiation.cc:299] Negotiation successful
0811 08:03:25.235601 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":343,"thread_start_us":73,"threads_started":1}
I20260811 08:03:25.235984 16173 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:03:25.236672 16173 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:03:25.244390 16173 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1d4ee7107d254d68b64faabafd6ea54e: Generated new TSK 0
I20260811 08:03:25.244634 16173 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.36.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab.
Entry for principal kudu/127.15.36.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab.
I20260811 08:03:25.303839 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.193:0
--local_ip_for_outbound_sockets=127.15.36.193
--webserver_interface=127.15.36.193
--webserver_port=0
--tserver_master_addrs=127.15.36.254:37233
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab
--principal=kudu/127.15.36.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:42703
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:03:25.410208 16189 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:03:25.410538 16189 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:03:25.410589 16189 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:03:25.412184 16189 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:03:25.412267 16189 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:03:25.412302 16189 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.193
I20260811 08:03:25.414217 16189 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:42703
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab
--principal=kudu/127.15.36.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.36.193
--webserver_port=0
--tserver_master_addrs=127.15.36.254:37233
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16189
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.193
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:03:25.414482 16189 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:03:25.414793 16189 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:03:25.421155 16197 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:25.421159 16195 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:25.421519 16194 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:03:25.422358 16189 server_base.cc:1034] running on GCE node
I20260811 08:03:25.422700 16189 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:03:25.423050 16189 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:03:25.424258 16189 hybrid_clock.cc:648] HybridClock initialized: now 1786435405424206 us; error 71 us; skew 500 ppm
Aug 11 08:03:25 dist-test-slave-2w3w krb5kdc[16076](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435405, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:03:25.428771 16189 init.cc:377] Logged in from keytab as kudu/127.15.36.193@KRBTEST.COM (short username kudu)
I20260811 08:03:25.429751 16189 webserver.cc:460] Webserver started at http://127.15.36.193:42043/ using document root <none> and password file <none>
I20260811 08:03:25.432927 16189 fs_manager.cc:359] Metadata directory not provided
I20260811 08:03:25.433406 16189 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:03:25.433607 16189 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:03:25.438634 16189 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/minicluster-data/ts-0/data/instance:
uuid: "b7ac789317c6435ca175a647884a4f2a"
format_stamp: "Formatted at 2026-08-11 08:03:25 on dist-test-slave-2w3w"
server_key: "30cf85aaedf4276b1afe7cc756f11dff"
server_key_iv: "90b6dc7382a9cf225dd867ab05d20ada"
server_key_version: "encryptionkey@0"
I20260811 08:03:25.439455 16189 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/minicluster-data/ts-0/wal/instance:
uuid: "b7ac789317c6435ca175a647884a4f2a"
format_stamp: "Formatted at 2026-08-11 08:03:25 on dist-test-slave-2w3w"
server_key: "30cf85aaedf4276b1afe7cc756f11dff"
server_key_iv: "90b6dc7382a9cf225dd867ab05d20ada"
server_key_version: "encryptionkey@0"
I20260811 08:03:25.441318 16189 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.001s
I20260811 08:03:25.442843 16204 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:25.443210 16189 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:03:25.443436 16189 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/minicluster-data/ts-0/wal
uuid: "b7ac789317c6435ca175a647884a4f2a"
format_stamp: "Formatted at 2026-08-11 08:03:25 on dist-test-slave-2w3w"
server_key: "30cf85aaedf4276b1afe7cc756f11dff"
server_key_iv: "90b6dc7382a9cf225dd867ab05d20ada"
server_key_version: "encryptionkey@0"
I20260811 08:03:25.443537 16189 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:03:25.464121 16189 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:03:25.467476 16189 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:03:25.467675 16189 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:03:25.467963 16189 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:03:25.468708 16189 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:03:25.468778 16189 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:25.468822 16189 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:03:25.468855 16189 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:25.480906 16189 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.193:42343
I20260811 08:03:25.480945 16329 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.193:42343 every 8 connection(s)
I20260811 08:03:25.481627 16189 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
I20260811 08:03:25.482507 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 16189
I20260811 08:03:25.482613 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/minicluster-data/ts-0/wal/instance
I20260811 08:03:25.482828 15507 external_mini_cluster.cc:1428] Setting key 1ae5af80c7de0d4130d456ed7cdb37d5
WARNING: no policy specified for kudu/127.15.36.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.194@KRBTEST.COM" created.
Aug 11 08:03:25 dist-test-slave-2w3w krb5kdc[16076](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435405, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.193@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:03:25.505178 16180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:25.482899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:54589 (local address 127.15.36.254:37233)
0811 08:03:25.482988 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:25.482990 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:25.483060 (+ 70us) server_negotiation.cc:407] Connection header received
0811 08:03:25.484088 (+ 1028us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:25.484090 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:25.484108 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:25.484178 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:25.485030 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:25.485711 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:25.486917 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:25.487212 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:25.487299 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:25.500420 (+ 13121us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:25.500421 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:25.500422 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:25.500432 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:25.503126 (+ 2694us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:25.503746 (+ 620us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:25.503747 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:25.503748 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:25.503842 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:25.504173 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:25.504174 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:25.504174 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:25.504367 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:25.504461 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:25.504917 (+ 456us) server_negotiation.cc:299] Negotiation successful
0811 08:03:25.505046 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 08:03:25.505398 16332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:25.482611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:37233 (local address 127.15.36.193:54589)
0811 08:03:25.482819 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:25.482859 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:25.483964 (+ 1105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:25.484307 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:25.484312 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:25.484693 (+ 381us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:03:25.484931 (+ 238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:25.484936 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:25.485841 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:25.485842 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:25.486797 (+ 955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:25.486800 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:25.487318 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:25.487319 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:25.487479 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:25.492679 (+ 5200us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:03:25.492691 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:03:25.499991 (+ 7300us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:03:25.503278 (+ 3287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:25.503303 (+ 25us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:25.503305 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:25.503635 (+ 330us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:25.503946 (+ 311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:25.503947 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:25.503947 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:25.504087 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:25.504461 (+ 374us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:03:25.504469 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:03:25.504629 (+ 160us) client_negotiation.cc:769] Sending connection context
0811 08:03:25.504864 (+ 235us) client_negotiation.cc:240] Negotiation successful
0811 08:03:25.505128 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":105,"threads_started":1}
I20260811 08:03:25.506152 16330 heartbeater.cc:347] Connected to a master server at 127.15.36.254:37233
I20260811 08:03:25.506265 16330 heartbeater.cc:464] Registering TS with master...
I20260811 08:03:25.506497 16330 heartbeater.cc:511] Master 127.15.36.254:37233 requested a full tablet report, sending...
I20260811 08:03:25.507203 16122 ts_manager.cc:194] Registered new tserver with Master: b7ac789317c6435ca175a647884a4f2a (127.15.36.193:42343)
I20260811 08:03:25.507859 16122 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.36.193@KRBTEST.COM'} at 127.15.36.193:54589
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab.
Entry for principal kudu/127.15.36.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab.
I20260811 08:03:25.529893 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.194:0
--local_ip_for_outbound_sockets=127.15.36.194
--webserver_interface=127.15.36.194
--webserver_port=0
--tserver_master_addrs=127.15.36.254:37233
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab
--principal=kudu/127.15.36.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:42703
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:03:25.628664 16336 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:03:25.628932 16336 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:03:25.628962 16336 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:03:25.630659 16336 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:03:25.630741 16336 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:03:25.630887 16336 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.194
I20260811 08:03:25.633908 16336 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:42703
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab
--principal=kudu/127.15.36.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.36.194
--webserver_port=0
--tserver_master_addrs=127.15.36.254:37233
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16336
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.194
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:03:25.634215 16336 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:03:25.634438 16336 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:03:25.640514 16343 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:25.640511 16345 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:25.640523 16342 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:03:25.640798 16336 server_base.cc:1034] running on GCE node
I20260811 08:03:25.641273 16336 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:03:25.641563 16336 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:03:25.642755 16336 hybrid_clock.cc:648] HybridClock initialized: now 1786435405642731 us; error 39 us; skew 500 ppm
Aug 11 08:03:25 dist-test-slave-2w3w krb5kdc[16076](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435405, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:03:25.646131 16336 init.cc:377] Logged in from keytab as kudu/127.15.36.194@KRBTEST.COM (short username kudu)
I20260811 08:03:25.646719 16336 webserver.cc:460] Webserver started at http://127.15.36.194:36715/ using document root <none> and password file <none>
I20260811 08:03:25.647428 16336 fs_manager.cc:359] Metadata directory not provided
I20260811 08:03:25.647576 16336 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:03:25.647770 16336 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:03:25.649082 16336 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/minicluster-data/ts-1/data/instance:
uuid: "dbd7b26f99924aa28b08f47e6b5a6c1d"
format_stamp: "Formatted at 2026-08-11 08:03:25 on dist-test-slave-2w3w"
server_key: "c994045ff1781a5091cd345d426ae8c4"
server_key_iv: "317515fde54ae45ecbbf2106c5dfa964"
server_key_version: "encryptionkey@0"
I20260811 08:03:25.649659 16336 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/minicluster-data/ts-1/wal/instance:
uuid: "dbd7b26f99924aa28b08f47e6b5a6c1d"
format_stamp: "Formatted at 2026-08-11 08:03:25 on dist-test-slave-2w3w"
server_key: "c994045ff1781a5091cd345d426ae8c4"
server_key_iv: "317515fde54ae45ecbbf2106c5dfa964"
server_key_version: "encryptionkey@0"
I20260811 08:03:25.651865 16336 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.003s
I20260811 08:03:25.653182 16353 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:25.653637 16336 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:03:25.653797 16336 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/minicluster-data/ts-1/wal
uuid: "dbd7b26f99924aa28b08f47e6b5a6c1d"
format_stamp: "Formatted at 2026-08-11 08:03:25 on dist-test-slave-2w3w"
server_key: "c994045ff1781a5091cd345d426ae8c4"
server_key_iv: "317515fde54ae45ecbbf2106c5dfa964"
server_key_version: "encryptionkey@0"
I20260811 08:03:25.653900 16336 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:03:25.673336 16336 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:03:25.677315 16336 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:03:25.677518 16336 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:03:25.677839 16336 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:03:25.678292 16336 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:03:25.678361 16336 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:25.678398 16336 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:03:25.678427 16336 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:25.686755 16336 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.194:40615
I20260811 08:03:25.686919 16476 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.194:40615 every 8 connection(s)
I20260811 08:03:25.687355 16336 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
Aug 11 08:03:25 dist-test-slave-2w3w krb5kdc[16076](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435405, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.194@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:03:25.697542 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 16336
I20260811 08:03:25.697705 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/minicluster-data/ts-1/wal/instance
I20260811 08:03:25.697881 15507 external_mini_cluster.cc:1428] Setting key e3be2e75db52307abbe71e776840c2ee
I20260811 08:03:25.703141 16180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:25.688407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:35803 (local address 127.15.36.254:37233)
0811 08:03:25.688634 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:25.688636 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:25.688654 (+ 18us) server_negotiation.cc:407] Connection header received
0811 08:03:25.689744 (+ 1090us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:25.689746 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:25.689759 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:25.689879 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:25.690651 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:25.691671 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:25.693213 (+ 1542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:25.693449 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:25.693711 (+ 262us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:25.697869 (+ 4158us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:25.697872 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:25.697872 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:25.697881 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:25.700011 (+ 2130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:25.700781 (+ 770us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:25.700783 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:25.700783 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:25.700922 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:25.701525 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:25.701527 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:25.701527 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:25.702009 (+ 482us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:25.702485 (+ 476us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:25.702884 (+ 399us) server_negotiation.cc:299] Negotiation successful
0811 08:03:25.703051 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":189}
I20260811 08:03:25.703583 16479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:25.688324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:37233 (local address 127.15.36.194:35803)
0811 08:03:25.688518 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:25.688567 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:25.689593 (+ 1026us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:25.689966 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:25.689971 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:25.690311 (+ 340us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:03:25.690523 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:25.690528 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:25.691814 (+ 1286us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:25.691816 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:25.693064 (+ 1248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:25.693068 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:25.693782 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:25.693784 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:25.693997 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:25.694937 (+ 940us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:03:25.694947 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:03:25.697375 (+ 2428us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:03:25.700132 (+ 2757us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:25.700148 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:25.700151 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:25.700635 (+ 484us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:25.701060 (+ 425us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:25.701061 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:25.701062 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:25.701352 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:25.702519 (+ 1167us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:03:25.702528 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:03:25.702704 (+ 176us) client_negotiation.cc:769] Sending connection context
0811 08:03:25.702822 (+ 118us) client_negotiation.cc:240] Negotiation successful
0811 08:03:25.703254 (+ 432us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":108,"threads_started":1}
I20260811 08:03:25.704679 16477 heartbeater.cc:347] Connected to a master server at 127.15.36.254:37233
I20260811 08:03:25.704816 16477 heartbeater.cc:464] Registering TS with master...
I20260811 08:03:25.705091 16477 heartbeater.cc:511] Master 127.15.36.254:37233 requested a full tablet report, sending...
I20260811 08:03:25.705657 16122 ts_manager.cc:194] Registered new tserver with Master: dbd7b26f99924aa28b08f47e6b5a6c1d (127.15.36.194:40615)
I20260811 08:03:25.706111 16122 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.36.194@KRBTEST.COM'} at 127.15.36.194:35803
WARNING: no policy specified for kudu/127.15.36.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab.
Entry for principal kudu/127.15.36.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab.
I20260811 08:03:25.745445 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.195:0
--local_ip_for_outbound_sockets=127.15.36.195
--webserver_interface=127.15.36.195
--webserver_port=0
--tserver_master_addrs=127.15.36.254:37233
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab
--principal=kudu/127.15.36.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:42703
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:03:25.851629 16482 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:03:25.851959 16482 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:03:25.851991 16482 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:03:25.853895 16482 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:03:25.854493 16482 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:03:25.854604 16482 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.195
I20260811 08:03:25.856824 16482 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:42703
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab
--principal=kudu/127.15.36.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.36.195
--webserver_port=0
--tserver_master_addrs=127.15.36.254:37233
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16482
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.195
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:03:25.857705 16482 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:03:25.858114 16482 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:03:25.864025 16491 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:25.864027 16489 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:25.864027 16488 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:03:25.864452 16482 server_base.cc:1034] running on GCE node
I20260811 08:03:25.864720 16482 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:03:25.864971 16482 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:03:25.866235 16482 hybrid_clock.cc:648] HybridClock initialized: now 1786435405866223 us; error 37 us; skew 500 ppm
Aug 11 08:03:25 dist-test-slave-2w3w krb5kdc[16076](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435405, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:03:25.869508 16482 init.cc:377] Logged in from keytab as kudu/127.15.36.195@KRBTEST.COM (short username kudu)
I20260811 08:03:25.870083 16482 webserver.cc:460] Webserver started at http://127.15.36.195:37919/ using document root <none> and password file <none>
I20260811 08:03:25.870361 16482 fs_manager.cc:359] Metadata directory not provided
I20260811 08:03:25.870440 16482 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:03:25.870604 16482 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:03:25.871872 16482 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/minicluster-data/ts-2/data/instance:
uuid: "588560ee07964fefba8ca56eaae8c54c"
format_stamp: "Formatted at 2026-08-11 08:03:25 on dist-test-slave-2w3w"
server_key: "a99a8b1faed17d403e65c450832e5d77"
server_key_iv: "c11f2363dadf7e9fa4bb35fff1da7e24"
server_key_version: "encryptionkey@0"
I20260811 08:03:25.872272 16482 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/minicluster-data/ts-2/wal/instance:
uuid: "588560ee07964fefba8ca56eaae8c54c"
format_stamp: "Formatted at 2026-08-11 08:03:25 on dist-test-slave-2w3w"
server_key: "a99a8b1faed17d403e65c450832e5d77"
server_key_iv: "c11f2363dadf7e9fa4bb35fff1da7e24"
server_key_version: "encryptionkey@0"
I20260811 08:03:25.873931 16482 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 08:03:25.874933 16498 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:25.875411 16482 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:03:25.875679 16482 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/minicluster-data/ts-2/wal
uuid: "588560ee07964fefba8ca56eaae8c54c"
format_stamp: "Formatted at 2026-08-11 08:03:25 on dist-test-slave-2w3w"
server_key: "a99a8b1faed17d403e65c450832e5d77"
server_key_iv: "c11f2363dadf7e9fa4bb35fff1da7e24"
server_key_version: "encryptionkey@0"
I20260811 08:03:25.875811 16482 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:03:25.891287 16482 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:03:25.894644 16482 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:03:25.895238 16482 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:03:25.895948 16482 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:03:25.896461 16482 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:03:25.896521 16482 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:25.896556 16482 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:03:25.896589 16482 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:25.906307 16482 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.195:46133
I20260811 08:03:25.906353 16632 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.195:46133 every 8 connection(s)
I20260811 08:03:25.906797 16482 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
I20260811 08:03:25.914229 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 16482
I20260811 08:03:25.914364 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786435400844580-15507-0/minicluster-data/ts-2/wal/instance
I20260811 08:03:25.914577 15507 external_mini_cluster.cc:1428] Setting key 83b0a13584fb576a144fee7aa904775d
Aug 11 08:03:25 dist-test-slave-2w3w krb5kdc[16076](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435405, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.195@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:03:25.920084 16180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:25.907779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:32957 (local address 127.15.36.254:37233)
0811 08:03:25.907916 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:25.907919 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:25.908124 (+ 205us) server_negotiation.cc:407] Connection header received
0811 08:03:25.909374 (+ 1250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:25.909376 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:25.909391 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:25.909445 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:25.910157 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:25.910680 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:25.912629 (+ 1949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:25.912842 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:25.912934 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:25.916342 (+ 3408us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:25.916344 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:25.916344 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:25.916354 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:25.917944 (+ 1590us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:25.918705 (+ 761us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:25.918706 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:25.918706 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:25.918769 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:25.919208 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:25.919209 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:25.919209 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:25.919383 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:25.919447 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:25.919917 (+ 470us) server_negotiation.cc:299] Negotiation successful
0811 08:03:25.920000 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260811 08:03:25.920256 16635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:25.907726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:37233 (local address 127.15.36.195:32957)
0811 08:03:25.907959 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:25.908032 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:25.909221 (+ 1189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:25.909522 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:25.909527 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:25.909832 (+ 305us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:03:25.910052 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:25.910056 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:25.910894 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:25.910895 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:25.912490 (+ 1595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:25.912494 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:25.912949 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:25.912951 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:25.913314 (+ 363us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:25.914098 (+ 784us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:03:25.914111 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:03:25.916186 (+ 2075us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:03:25.918306 (+ 2120us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:25.918318 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:25.918320 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:25.918600 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:25.918867 (+ 267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:25.918868 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:25.918869 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:25.919149 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:25.919482 (+ 333us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:03:25.919492 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:03:25.919651 (+ 159us) client_negotiation.cc:769] Sending connection context
0811 08:03:25.919743 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 08:03:25.920011 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":95,"threads_started":1}
I20260811 08:03:25.921406 16633 heartbeater.cc:347] Connected to a master server at 127.15.36.254:37233
I20260811 08:03:25.921540 16633 heartbeater.cc:464] Registering TS with master...
I20260811 08:03:25.921826 16633 heartbeater.cc:511] Master 127.15.36.254:37233 requested a full tablet report, sending...
I20260811 08:03:25.922391 16122 ts_manager.cc:194] Registered new tserver with Master: 588560ee07964fefba8ca56eaae8c54c (127.15.36.195:46133)
I20260811 08:03:25.922875 16122 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.36.195@KRBTEST.COM'} at 127.15.36.195:32957
I20260811 08:03:25.927822 15507 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 08:03:25.937659 16180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:25.929805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54636 (local address 127.15.36.254:37233)
0811 08:03:25.929909 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:25.929912 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:25.930033 (+ 121us) server_negotiation.cc:407] Connection header received
0811 08:03:25.930135 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:25.930136 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:25.930147 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:25.930210 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:25.930900 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:25.931839 (+ 939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:25.932661 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:25.932872 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:25.932955 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:25.934540 (+ 1585us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:25.934542 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:25.934542 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:25.934551 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:25.936308 (+ 1757us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:25.936721 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:25.936722 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:25.936723 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:25.936795 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:25.937016 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:25.937017 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:25.937018 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:25.937198 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:25.937319 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:25.937453 (+ 134us) server_negotiation.cc:299] Negotiation successful
0811 08:03:25.937551 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 08:03:25.940884 16122 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54636:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:03:25.942742 16122 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:03:25.952184 16650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:25.946647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.193:42343 (local address 127.0.0.1:60416)
0811 08:03:25.947310 (+ 663us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:25.947319 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:25.947398 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:25.947634 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:25.947635 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:25.947637 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:03:25.947677 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:25.947679 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:25.949623 (+ 1944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:25.949624 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:25.950619 (+ 995us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:25.950624 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:25.951639 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:25.951640 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:25.951756 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:25.951827 (+ 71us) client_negotiation.cc:769] Sending connection context
0811 08:03:25.951924 (+ 97us) client_negotiation.cc:240] Negotiation successful
0811 08:03:25.951997 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":645,"thread_start_us":79,"threads_started":1}
I20260811 08:03:25.952376 16651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:25.946926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60416 (local address 127.15.36.193:42343)
0811 08:03:25.947090 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:25.947094 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:25.947462 (+ 368us) server_negotiation.cc:407] Connection header received
0811 08:03:25.947510 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:25.947512 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:25.947529 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:25.947607 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:03:25.947768 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:25.949453 (+ 1685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:25.950904 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:25.951520 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:25.951633 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:25.951704 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:25.952200 (+ 496us) server_negotiation.cc:299] Negotiation successful
0811 08:03:25.952273 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":96,"threads_started":1}
I20260811 08:03:25.953049 16258 tablet_service.cc:1467] Processing CreateTablet for tablet 8b33af2ef04746e8b6163a42fdf8e6e0 (DEFAULT_TABLE table=test-table [id=fa874e51210a4f57bf954925f6744c44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:03:25.953486 16258 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b33af2ef04746e8b6163a42fdf8e6e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:03:25.955147 16645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:25.946431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.195:46133 (local address 127.0.0.1:48766)
0811 08:03:25.946815 (+ 384us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:25.946828 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:25.946888 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:25.947244 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:25.947245 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:25.947248 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:03:25.947297 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:25.947298 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:25.950776 (+ 3478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:25.950777 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:25.953468 (+ 2691us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:25.953473 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:25.954751 (+ 1278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:25.954753 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:25.954832 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:25.954838 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 08:03:25.954944 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 08:03:25.955041 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":368,"mutex_wait_us":8,"thread_start_us":64,"threads_started":1}
I20260811 08:03:25.955154 16649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:25.946642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48766 (local address 127.15.36.195:46133)
0811 08:03:25.947049 (+ 407us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:25.947054 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:25.947066 (+ 12us) server_negotiation.cc:407] Connection header received
0811 08:03:25.947122 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:25.947124 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:25.947140 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:25.947219 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:03:25.947392 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:25.949107 (+ 1715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:25.953656 (+ 4549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:25.954602 (+ 946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:25.954700 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:25.954796 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:25.955005 (+ 209us) server_negotiation.cc:299] Negotiation successful
0811 08:03:25.955063 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":369,"thread_start_us":84,"threads_started":1}
I20260811 08:03:25.955258 16647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:25.946431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.194:40615 (local address 127.0.0.1:57698)
0811 08:03:25.946622 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:25.946675 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:25.946766 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:25.947088 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:25.947091 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:25.947094 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:03:25.947188 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:25.947190 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:25.952185 (+ 4995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:25.952186 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:25.953821 (+ 1635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:25.953824 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:25.955039 (+ 1215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:25.955040 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:25.955105 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:25.955109 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:03:25.955141 (+ 32us) client_negotiation.cc:240] Negotiation successful
0811 08:03:25.955186 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":113,"threads_started":1}
I20260811 08:03:25.955847 16648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:25.946603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57698 (local address 127.15.36.194:40615)
0811 08:03:25.946809 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:25.946814 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:25.946825 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:03:25.946882 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:25.946884 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:25.946906 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:25.947294 (+ 388us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:03:25.947378 (+ 84us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:25.952023 (+ 4645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:25.954132 (+ 2109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:25.954904 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:25.955584 (+ 680us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:25.955688 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:25.955724 (+ 36us) server_negotiation.cc:299] Negotiation successful
0811 08:03:25.955768 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":90,"threads_started":1}
I20260811 08:03:25.956040 16552 tablet_service.cc:1467] Processing CreateTablet for tablet 8b33af2ef04746e8b6163a42fdf8e6e0 (DEFAULT_TABLE table=test-table [id=fa874e51210a4f57bf954925f6744c44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:03:25.956456 16552 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b33af2ef04746e8b6163a42fdf8e6e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:03:25.959187 16403 tablet_service.cc:1467] Processing CreateTablet for tablet 8b33af2ef04746e8b6163a42fdf8e6e0 (DEFAULT_TABLE table=test-table [id=fa874e51210a4f57bf954925f6744c44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:03:25.959641 16403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b33af2ef04746e8b6163a42fdf8e6e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:03:25.959729 16653 tablet_bootstrap.cc:492] T 8b33af2ef04746e8b6163a42fdf8e6e0 P b7ac789317c6435ca175a647884a4f2a: Bootstrap starting.
I20260811 08:03:25.960601 16653 tablet_bootstrap.cc:654] T 8b33af2ef04746e8b6163a42fdf8e6e0 P b7ac789317c6435ca175a647884a4f2a: Neither blocks nor log segments found. Creating new log.
I20260811 08:03:25.961506 16653 log.cc:824] T 8b33af2ef04746e8b6163a42fdf8e6e0 P b7ac789317c6435ca175a647884a4f2a: Log is configured to *not* fsync() on all Append() calls
I20260811 08:03:25.963480 16653 tablet_bootstrap.cc:492] T 8b33af2ef04746e8b6163a42fdf8e6e0 P b7ac789317c6435ca175a647884a4f2a: No bootstrap required, opened a new log
I20260811 08:03:25.963599 16653 ts_tablet_manager.cc:1397] T 8b33af2ef04746e8b6163a42fdf8e6e0 P b7ac789317c6435ca175a647884a4f2a: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260811 08:03:25.963889 16655 tablet_bootstrap.cc:492] T 8b33af2ef04746e8b6163a42fdf8e6e0 P 588560ee07964fefba8ca56eaae8c54c: Bootstrap starting.
I20260811 08:03:25.964331 16656 tablet_bootstrap.cc:492] T 8b33af2ef04746e8b6163a42fdf8e6e0 P dbd7b26f99924aa28b08f47e6b5a6c1d: Bootstrap starting.
I20260811 08:03:25.964737 16655 tablet_bootstrap.cc:654] T 8b33af2ef04746e8b6163a42fdf8e6e0 P 588560ee07964fefba8ca56eaae8c54c: Neither blocks nor log segments found. Creating new log.
I20260811 08:03:25.965065 16656 tablet_bootstrap.cc:654] T 8b33af2ef04746e8b6163a42fdf8e6e0 P dbd7b26f99924aa28b08f47e6b5a6c1d: Neither blocks nor log segments found. Creating new log.
I20260811 08:03:25.965526 16655 log.cc:824] T 8b33af2ef04746e8b6163a42fdf8e6e0 P 588560ee07964fefba8ca56eaae8c54c: Log is configured to *not* fsync() on all Append() calls
I20260811 08:03:25.965641 16656 log.cc:824] T 8b33af2ef04746e8b6163a42fdf8e6e0 P dbd7b26f99924aa28b08f47e6b5a6c1d: Log is configured to *not* fsync() on all Append() calls
I20260811 08:03:25.966490 16656 tablet_bootstrap.cc:492] T 8b33af2ef04746e8b6163a42fdf8e6e0 P dbd7b26f99924aa28b08f47e6b5a6c1d: No bootstrap required, opened a new log
I20260811 08:03:25.966499 16655 tablet_bootstrap.cc:492] T 8b33af2ef04746e8b6163a42fdf8e6e0 P 588560ee07964fefba8ca56eaae8c54c: No bootstrap required, opened a new log
I20260811 08:03:25.966409 16653 raft_consensus.cc:348] T 8b33af2ef04746e8b6163a42fdf8e6e0 P b7ac789317c6435ca175a647884a4f2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd7b26f99924aa28b08f47e6b5a6c1d" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 40615 } } peers { permanent_uuid: "b7ac789317c6435ca175a647884a4f2a" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 42343 } } peers { permanent_uuid: "588560ee07964fefba8ca56eaae8c54c" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 46133 } }
I20260811 08:03:25.966578 16655 ts_tablet_manager.cc:1397] T 8b33af2ef04746e8b6163a42fdf8e6e0 P 588560ee07964fefba8ca56eaae8c54c: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 08:03:25.966579 16656 ts_tablet_manager.cc:1397] T 8b33af2ef04746e8b6163a42fdf8e6e0 P dbd7b26f99924aa28b08f47e6b5a6c1d: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 08:03:25.966600 16653 raft_consensus.cc:374] T 8b33af2ef04746e8b6163a42fdf8e6e0 P b7ac789317c6435ca175a647884a4f2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:03:25.966646 16653 raft_consensus.cc:729] T 8b33af2ef04746e8b6163a42fdf8e6e0 P b7ac789317c6435ca175a647884a4f2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7ac789317c6435ca175a647884a4f2a, State: Initialized, Role: FOLLOWER
I20260811 08:03:25.966773 16653 consensus_queue.cc:260] T 8b33af2ef04746e8b6163a42fdf8e6e0 P b7ac789317c6435ca175a647884a4f2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd7b26f99924aa28b08f47e6b5a6c1d" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 40615 } } peers { permanent_uuid: "b7ac789317c6435ca175a647884a4f2a" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 42343 } } peers { permanent_uuid: "588560ee07964fefba8ca56eaae8c54c" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 46133 } }
I20260811 08:03:25.967118 16653 ts_tablet_manager.cc:1428] T 8b33af2ef04746e8b6163a42fdf8e6e0 P b7ac789317c6435ca175a647884a4f2a: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 08:03:25.968744 16656 raft_consensus.cc:348] T 8b33af2ef04746e8b6163a42fdf8e6e0 P dbd7b26f99924aa28b08f47e6b5a6c1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd7b26f99924aa28b08f47e6b5a6c1d" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 40615 } } peers { permanent_uuid: "b7ac789317c6435ca175a647884a4f2a" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 42343 } } peers { permanent_uuid: "588560ee07964fefba8ca56eaae8c54c" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 46133 } }
I20260811 08:03:25.968863 16655 raft_consensus.cc:348] T 8b33af2ef04746e8b6163a42fdf8e6e0 P 588560ee07964fefba8ca56eaae8c54c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd7b26f99924aa28b08f47e6b5a6c1d" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 40615 } } peers { permanent_uuid: "b7ac789317c6435ca175a647884a4f2a" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 42343 } } peers { permanent_uuid: "588560ee07964fefba8ca56eaae8c54c" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 46133 } }
I20260811 08:03:25.969162 16655 raft_consensus.cc:374] T 8b33af2ef04746e8b6163a42fdf8e6e0 P 588560ee07964fefba8ca56eaae8c54c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:03:25.969180 16656 raft_consensus.cc:374] T 8b33af2ef04746e8b6163a42fdf8e6e0 P dbd7b26f99924aa28b08f47e6b5a6c1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:03:25.969311 16656 raft_consensus.cc:729] T 8b33af2ef04746e8b6163a42fdf8e6e0 P dbd7b26f99924aa28b08f47e6b5a6c1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbd7b26f99924aa28b08f47e6b5a6c1d, State: Initialized, Role: FOLLOWER
I20260811 08:03:25.969475 16656 consensus_queue.cc:260] T 8b33af2ef04746e8b6163a42fdf8e6e0 P dbd7b26f99924aa28b08f47e6b5a6c1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd7b26f99924aa28b08f47e6b5a6c1d" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 40615 } } peers { permanent_uuid: "b7ac789317c6435ca175a647884a4f2a" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 42343 } } peers { permanent_uuid: "588560ee07964fefba8ca56eaae8c54c" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 46133 } }
I20260811 08:03:25.969188 16655 raft_consensus.cc:729] T 8b33af2ef04746e8b6163a42fdf8e6e0 P 588560ee07964fefba8ca56eaae8c54c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 588560ee07964fefba8ca56eaae8c54c, State: Initialized, Role: FOLLOWER
I20260811 08:03:25.969733 16655 consensus_queue.cc:260] T 8b33af2ef04746e8b6163a42fdf8e6e0 P 588560ee07964fefba8ca56eaae8c54c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd7b26f99924aa28b08f47e6b5a6c1d" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 40615 } } peers { permanent_uuid: "b7ac789317c6435ca175a647884a4f2a" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 42343 } } peers { permanent_uuid: "588560ee07964fefba8ca56eaae8c54c" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 46133 } }
I20260811 08:03:25.969843 16656 ts_tablet_manager.cc:1428] T 8b33af2ef04746e8b6163a42fdf8e6e0 P dbd7b26f99924aa28b08f47e6b5a6c1d: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260811 08:03:25.969906 16477 heartbeater.cc:503] Master 127.15.36.254:37233 was elected leader, sending a full tablet report...
I20260811 08:03:25.970118 16655 ts_tablet_manager.cc:1428] T 8b33af2ef04746e8b6163a42fdf8e6e0 P 588560ee07964fefba8ca56eaae8c54c: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260811 08:03:25.970208 16633 heartbeater.cc:503] Master 127.15.36.254:37233 was elected leader, sending a full tablet report...
I20260811 08:03:25.970310 16330 heartbeater.cc:503] Master 127.15.36.254:37233 was elected leader, sending a full tablet report...
W20260811 08:03:25.982674 16331 tablet.cc:2369] T 8b33af2ef04746e8b6163a42fdf8e6e0 P b7ac789317c6435ca175a647884a4f2a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:03:25.990916 16660 raft_consensus.cc:482] T 8b33af2ef04746e8b6163a42fdf8e6e0 P dbd7b26f99924aa28b08f47e6b5a6c1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:03:25.991094 16660 raft_consensus.cc:504] T 8b33af2ef04746e8b6163a42fdf8e6e0 P dbd7b26f99924aa28b08f47e6b5a6c1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd7b26f99924aa28b08f47e6b5a6c1d" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 40615 } } peers { permanent_uuid: "b7ac789317c6435ca175a647884a4f2a" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 42343 } } peers { permanent_uuid: "588560ee07964fefba8ca56eaae8c54c" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 46133 } }
I20260811 08:03:25.991487 16660 leader_election.cc:288] T 8b33af2ef04746e8b6163a42fdf8e6e0 P dbd7b26f99924aa28b08f47e6b5a6c1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7ac789317c6435ca175a647884a4f2a (127.15.36.193:42343), 588560ee07964fefba8ca56eaae8c54c (127.15.36.195:46133)
I20260811 08:03:25.994660 16649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:25.991870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:48267 (local address 127.15.36.195:46133)
0811 08:03:25.991929 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:25.991931 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:25.991998 (+ 67us) server_negotiation.cc:407] Connection header received
0811 08:03:25.992035 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:25.992035 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:25.992046 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:25.992122 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:03:25.992300 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:25.992848 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:25.993889 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:25.994283 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:25.994380 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:25.994389 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:25.994540 (+ 151us) server_negotiation.cc:299] Negotiation successful
0811 08:03:25.994579 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 08:03:25.994678 16663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:25.991749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.195:46133 (local address 127.15.36.194:48267)
0811 08:03:25.991926 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:25.991936 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:25.991985 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:25.992143 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:25.992145 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:25.992147 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:03:25.992224 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:25.992225 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:25.992949 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:25.992950 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:25.993749 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:25.993752 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:25.994380 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:25.994381 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:25.994461 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:25.994465 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:03:25.994534 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 08:03:25.994579 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":123,"threads_started":1}
I20260811 08:03:25.994779 16651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:25.991791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:60285 (local address 127.15.36.193:42343)
0811 08:03:25.991918 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:25.991921 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:25.991933 (+ 12us) server_negotiation.cc:407] Connection header received
0811 08:03:25.991967 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:25.991968 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:25.992049 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:25.992160 (+ 111us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:03:25.992369 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:25.992849 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:25.993868 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:25.994367 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:25.994460 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:25.994469 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:25.994636 (+ 167us) server_negotiation.cc:299] Negotiation successful
0811 08:03:25.994682 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 08:03:25.994817 16479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:25.991702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.193:42343 (local address 127.15.36.194:60285)
0811 08:03:25.991763 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:25.991778 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:25.991824 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:25.992167 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:25.992168 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:25.992171 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:03:25.992248 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:25.992250 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:25.992946 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:25.992947 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:25.993746 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:25.993749 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:25.994460 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:25.994461 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:25.994553 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:25.994556 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:03:25.994628 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 08:03:25.994675 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41,"mutex_wait_us":1}
I20260811 08:03:25.995209 16280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b33af2ef04746e8b6163a42fdf8e6e0" candidate_uuid: "dbd7b26f99924aa28b08f47e6b5a6c1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ac789317c6435ca175a647884a4f2a" is_pre_election: true
I20260811 08:03:25.995154 16575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b33af2ef04746e8b6163a42fdf8e6e0" candidate_uuid: "dbd7b26f99924aa28b08f47e6b5a6c1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "588560ee07964fefba8ca56eaae8c54c" is_pre_election: true
I20260811 08:03:25.995420 16280 raft_consensus.cc:2454] T 8b33af2ef04746e8b6163a42fdf8e6e0 P b7ac789317c6435ca175a647884a4f2a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbd7b26f99924aa28b08f47e6b5a6c1d in term 0.
I20260811 08:03:25.995544 16575 raft_consensus.cc:2454] T 8b33af2ef04746e8b6163a42fdf8e6e0 P 588560ee07964fefba8ca56eaae8c54c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbd7b26f99924aa28b08f47e6b5a6c1d in term 0.
I20260811 08:03:25.995719 16355 leader_election.cc:302] T 8b33af2ef04746e8b6163a42fdf8e6e0 P dbd7b26f99924aa28b08f47e6b5a6c1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ac789317c6435ca175a647884a4f2a, dbd7b26f99924aa28b08f47e6b5a6c1d; no voters:
I20260811 08:03:25.996096 16660 raft_consensus.cc:2781] T 8b33af2ef04746e8b6163a42fdf8e6e0 P dbd7b26f99924aa28b08f47e6b5a6c1d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:03:25.996188 16660 raft_consensus.cc:482] T 8b33af2ef04746e8b6163a42fdf8e6e0 P dbd7b26f99924aa28b08f47e6b5a6c1d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:03:25.996210 16660 raft_consensus.cc:3037] T 8b33af2ef04746e8b6163a42fdf8e6e0 P dbd7b26f99924aa28b08f47e6b5a6c1d [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:03:25.997042 16660 raft_consensus.cc:504] T 8b33af2ef04746e8b6163a42fdf8e6e0 P dbd7b26f99924aa28b08f47e6b5a6c1d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd7b26f99924aa28b08f47e6b5a6c1d" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 40615 } } peers { permanent_uuid: "b7ac789317c6435ca175a647884a4f2a" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 42343 } } peers { permanent_uuid: "588560ee07964fefba8ca56eaae8c54c" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 46133 } }
I20260811 08:03:25.997267 16660 leader_election.cc:288] T 8b33af2ef04746e8b6163a42fdf8e6e0 P dbd7b26f99924aa28b08f47e6b5a6c1d [CANDIDATE]: Term 1 election: Requested vote from peers b7ac789317c6435ca175a647884a4f2a (127.15.36.193:42343), 588560ee07964fefba8ca56eaae8c54c (127.15.36.195:46133)
I20260811 08:03:25.997550 16575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b33af2ef04746e8b6163a42fdf8e6e0" candidate_uuid: "dbd7b26f99924aa28b08f47e6b5a6c1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "588560ee07964fefba8ca56eaae8c54c"
I20260811 08:03:25.997653 16575 raft_consensus.cc:3037] T 8b33af2ef04746e8b6163a42fdf8e6e0 P 588560ee07964fefba8ca56eaae8c54c [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:03:25.998004 16280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b33af2ef04746e8b6163a42fdf8e6e0" candidate_uuid: "dbd7b26f99924aa28b08f47e6b5a6c1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ac789317c6435ca175a647884a4f2a"
I20260811 08:03:25.998116 16280 raft_consensus.cc:3037] T 8b33af2ef04746e8b6163a42fdf8e6e0 P b7ac789317c6435ca175a647884a4f2a [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:03:25.999023 16575 raft_consensus.cc:2454] T 8b33af2ef04746e8b6163a42fdf8e6e0 P 588560ee07964fefba8ca56eaae8c54c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbd7b26f99924aa28b08f47e6b5a6c1d in term 1.
I20260811 08:03:25.999274 16354 leader_election.cc:302] T 8b33af2ef04746e8b6163a42fdf8e6e0 P dbd7b26f99924aa28b08f47e6b5a6c1d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 588560ee07964fefba8ca56eaae8c54c, dbd7b26f99924aa28b08f47e6b5a6c1d; no voters:
I20260811 08:03:25.999444 16660 raft_consensus.cc:2781] T 8b33af2ef04746e8b6163a42fdf8e6e0 P dbd7b26f99924aa28b08f47e6b5a6c1d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:03:25.999629 16280 raft_consensus.cc:2454] T 8b33af2ef04746e8b6163a42fdf8e6e0 P b7ac789317c6435ca175a647884a4f2a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbd7b26f99924aa28b08f47e6b5a6c1d in term 1.
I20260811 08:03:25.999684 16660 raft_consensus.cc:686] T 8b33af2ef04746e8b6163a42fdf8e6e0 P dbd7b26f99924aa28b08f47e6b5a6c1d [term 1 LEADER]: Becoming Leader. State: Replica: dbd7b26f99924aa28b08f47e6b5a6c1d, State: Running, Role: LEADER
I20260811 08:03:25.999847 16660 consensus_queue.cc:237] T 8b33af2ef04746e8b6163a42fdf8e6e0 P dbd7b26f99924aa28b08f47e6b5a6c1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd7b26f99924aa28b08f47e6b5a6c1d" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 40615 } } peers { permanent_uuid: "b7ac789317c6435ca175a647884a4f2a" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 42343 } } peers { permanent_uuid: "588560ee07964fefba8ca56eaae8c54c" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 46133 } }
I20260811 08:03:26.001122 16122 catalog_manager.cc:5495] T 8b33af2ef04746e8b6163a42fdf8e6e0 P dbd7b26f99924aa28b08f47e6b5a6c1d reported cstate change: term changed from 0 to 1, leader changed from <none> to dbd7b26f99924aa28b08f47e6b5a6c1d (127.15.36.194). New cstate: current_term: 1 leader_uuid: "dbd7b26f99924aa28b08f47e6b5a6c1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd7b26f99924aa28b08f47e6b5a6c1d" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 40615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ac789317c6435ca175a647884a4f2a" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 42343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "588560ee07964fefba8ca56eaae8c54c" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 46133 } health_report { overall_health: UNKNOWN } } }
Aug 11 08:03:26 dist-test-slave-2w3w krb5kdc[16076](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435404, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.36.193@KRBTEST.COM
I20260811 08:03:26.024407 16651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:26.013235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60430 (local address 127.15.36.193:42343)
0811 08:03:26.013330 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:26.013332 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:26.013511 (+ 179us) server_negotiation.cc:407] Connection header received
0811 08:03:26.013602 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:26.013603 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:26.013614 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:26.013698 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:26.014379 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:26.014898 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:26.015825 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:26.016031 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:26.016116 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:26.020444 (+ 4328us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:26.020463 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:26.020464 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:26.020482 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:26.023019 (+ 2537us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:26.023477 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:26.023481 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:26.023482 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:26.023559 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:26.023774 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:26.023775 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:26.023775 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:26.023948 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:26.024105 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:26.024187 (+ 82us) server_negotiation.cc:299] Negotiation successful
0811 08:03:26.024282 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
Aug 11 08:03:26 dist-test-slave-2w3w krb5kdc[16076](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435406, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 08:03:26 dist-test-slave-2w3w krb5kdc[16076](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435406, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.15.36.193@KRBTEST.COM
I20260811 08:03:26.057616 16651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:26.047574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60446 (local address 127.15.36.193:42343)
0811 08:03:26.047654 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:26.047656 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:26.047690 (+ 34us) server_negotiation.cc:407] Connection header received
0811 08:03:26.047775 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:26.047775 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:26.047786 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:26.047852 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:26.048577 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:26.049104 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:26.050104 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:26.050310 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:26.050379 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:26.053343 (+ 2964us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:26.053344 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:26.053344 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:26.053353 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:26.054861 (+ 1508us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:26.055311 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:26.055312 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:26.055313 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:26.055380 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:26.055614 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:26.055615 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:26.055615 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:26.055730 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:26.055849 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:26.056861 (+ 1012us) server_negotiation.cc:299] Negotiation successful
0811 08:03:26.057447 (+ 586us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
Aug 11 08:03:26 dist-test-slave-2w3w krb5kdc[16076](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435406, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 08:03:26 dist-test-slave-2w3w krb5kdc[16076](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435406, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.36.193@KRBTEST.COM
I20260811 08:03:26.088413 16651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:26.078797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60448 (local address 127.15.36.193:42343)
0811 08:03:26.078916 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:26.078919 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:26.079083 (+ 164us) server_negotiation.cc:407] Connection header received
0811 08:03:26.079193 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:26.079194 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:26.079205 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:26.079284 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:26.079972 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:26.080519 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:26.081311 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:26.081525 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:26.081612 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:26.084512 (+ 2900us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:26.084514 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:26.084514 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:26.084523 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:26.086410 (+ 1887us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:26.086909 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:26.086910 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:26.086910 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:26.087060 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:26.087506 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:26.087508 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:26.087508 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:26.087643 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:26.087747 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:26.088128 (+ 381us) server_negotiation.cc:299] Negotiation successful
0811 08:03:26.088309 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
W20260811 08:03:26.089440 16233 tablet_service.cc:2908] Rejecting scan request for tablet 8b33af2ef04746e8b6163a42fdf8e6e0: Uninitialized: clean time has not yet been initialized
I20260811 08:03:26.090898 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 16189
I20260811 08:03:26.100102 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 16336
I20260811 08:03:26.108562 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 16482
I20260811 08:03:26.115082 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 16089
2026-08-11T08:03:26Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2644 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:03:26 dist-test-slave-2w3w krb5kdc[16678](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:03:26 dist-test-slave-2w3w krb5kdc[16678](info): set up 2 sockets
Aug 11 08:03:26 dist-test-slave-2w3w krb5kdc[16678](info): commencing operation
krb5kdc: starting...
W20260811 08:03:27.395455 15507 mini_kdc.cc:121] Time spent starting KDC: real 1.256s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Aug 11 08:03:27 dist-test-slave-2w3w krb5kdc[16678](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435407, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:03:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:03:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.36.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab.
Entry for principal kudu/127.15.36.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab.
I20260811 08:03:27.574376 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:34345
--webserver_interface=127.15.36.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=kudu/127.15.36.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:44985
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.36.254:34345
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:03:27.676106 16692 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:03:27.676384 16692 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:03:27.676412 16692 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:03:27.677838 16692 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:03:27.677911 16692 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 08:03:27.677927 16692 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:03:27.677940 16692 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:03:27.677955 16692 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:03:27.677968 16692 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:03:27.679924 16692 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:44985
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.36.254:34345
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=kudu/127.15.36.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:34345
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.36.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16692
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:03:27.680481 16692 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:03:27.680840 16692 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:03:27.687769 16701 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:27.687907 16698 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:03:27.688046 16692 server_base.cc:1034] running on GCE node
W20260811 08:03:27.687829 16697 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:03:27.688640 16692 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:03:27.689249 16692 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:03:27.690452 16692 hybrid_clock.cc:648] HybridClock initialized: now 1786435407690439 us; error 45 us; skew 500 ppm
Aug 11 08:03:27 dist-test-slave-2w3w krb5kdc[16678](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435407, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:03:27.695305 16692 init.cc:377] Logged in from keytab as kudu/127.15.36.254@KRBTEST.COM (short username kudu)
I20260811 08:03:27.696347 16692 webserver.cc:460] Webserver started at http://127.15.36.254:37767/ using document root <none> and password file <none>
I20260811 08:03:27.696660 16692 fs_manager.cc:359] Metadata directory not provided
I20260811 08:03:27.696743 16692 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:03:27.696913 16692 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:03:27.698127 16692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/master-0/data/instance:
uuid: "017badd436654c6384c2ad11d1debf3f"
format_stamp: "Formatted at 2026-08-11 08:03:27 on dist-test-slave-2w3w"
server_key: "35fa85e009f470e2f3b4dd5c890af755"
server_key_iv: "10f8a3e8f6b1b4d26fff159501724c59"
server_key_version: "encryptionkey@0"
I20260811 08:03:27.698561 16692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/master-0/wal/instance:
uuid: "017badd436654c6384c2ad11d1debf3f"
format_stamp: "Formatted at 2026-08-11 08:03:27 on dist-test-slave-2w3w"
server_key: "35fa85e009f470e2f3b4dd5c890af755"
server_key_iv: "10f8a3e8f6b1b4d26fff159501724c59"
server_key_version: "encryptionkey@0"
I20260811 08:03:27.703423 16692 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.007s
I20260811 08:03:27.704954 16708 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:27.705554 16692 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.002s
I20260811 08:03:27.705711 16692 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/master-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/master-0/wal
uuid: "017badd436654c6384c2ad11d1debf3f"
format_stamp: "Formatted at 2026-08-11 08:03:27 on dist-test-slave-2w3w"
server_key: "35fa85e009f470e2f3b4dd5c890af755"
server_key_iv: "10f8a3e8f6b1b4d26fff159501724c59"
server_key_version: "encryptionkey@0"
I20260811 08:03:27.705847 16692 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:03:27.717453 16692 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:03:27.720690 16692 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:03:27.720911 16692 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:03:27.730238 16692 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.254:34345
I20260811 08:03:27.730319 16777 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.254:34345 every 8 connection(s)
I20260811 08:03:27.730823 16692 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
I20260811 08:03:27.731730 16779 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:03:27.732527 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 16692
I20260811 08:03:27.732657 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/master-0/wal/instance
I20260811 08:03:27.732861 15507 external_mini_cluster.cc:1428] Setting key 1fd0afca23de5ac8d99ef776a320dd7f
I20260811 08:03:27.735750 16779 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 017badd436654c6384c2ad11d1debf3f: Bootstrap starting.
I20260811 08:03:27.736481 16779 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 017badd436654c6384c2ad11d1debf3f: Neither blocks nor log segments found. Creating new log.
I20260811 08:03:27.736814 16779 log.cc:824] T 00000000000000000000000000000000 P 017badd436654c6384c2ad11d1debf3f: Log is configured to *not* fsync() on all Append() calls
I20260811 08:03:27.737632 16779 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 017badd436654c6384c2ad11d1debf3f: No bootstrap required, opened a new log
I20260811 08:03:27.740875 16779 raft_consensus.cc:348] T 00000000000000000000000000000000 P 017badd436654c6384c2ad11d1debf3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "017badd436654c6384c2ad11d1debf3f" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 34345 } }
I20260811 08:03:27.741237 16779 raft_consensus.cc:374] T 00000000000000000000000000000000 P 017badd436654c6384c2ad11d1debf3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:03:27.741302 16779 raft_consensus.cc:729] T 00000000000000000000000000000000 P 017badd436654c6384c2ad11d1debf3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 017badd436654c6384c2ad11d1debf3f, State: Initialized, Role: FOLLOWER
I20260811 08:03:27.741487 16779 consensus_queue.cc:260] T 00000000000000000000000000000000 P 017badd436654c6384c2ad11d1debf3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "017badd436654c6384c2ad11d1debf3f" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 34345 } }
I20260811 08:03:27.741601 16779 raft_consensus.cc:388] T 00000000000000000000000000000000 P 017badd436654c6384c2ad11d1debf3f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:03:27.741643 16779 raft_consensus.cc:482] T 00000000000000000000000000000000 P 017badd436654c6384c2ad11d1debf3f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:03:27.741695 16779 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 017badd436654c6384c2ad11d1debf3f [term 0 FOLLOWER]: Advancing to term 1
Aug 11 08:03:27 dist-test-slave-2w3w krb5kdc[16678](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435407, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:03:27.742388 16779 raft_consensus.cc:504] T 00000000000000000000000000000000 P 017badd436654c6384c2ad11d1debf3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "017badd436654c6384c2ad11d1debf3f" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 34345 } }
I20260811 08:03:27.742524 16779 leader_election.cc:302] T 00000000000000000000000000000000 P 017badd436654c6384c2ad11d1debf3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 017badd436654c6384c2ad11d1debf3f; no voters:
I20260811 08:03:27.742770 16779 leader_election.cc:288] T 00000000000000000000000000000000 P 017badd436654c6384c2ad11d1debf3f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:03:27.742879 16784 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 017badd436654c6384c2ad11d1debf3f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:03:27.743099 16784 raft_consensus.cc:686] T 00000000000000000000000000000000 P 017badd436654c6384c2ad11d1debf3f [term 1 LEADER]: Becoming Leader. State: Replica: 017badd436654c6384c2ad11d1debf3f, State: Running, Role: LEADER
I20260811 08:03:27.743124 16779 sys_catalog.cc:564] T 00000000000000000000000000000000 P 017badd436654c6384c2ad11d1debf3f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:03:27.743224 16784 consensus_queue.cc:237] T 00000000000000000000000000000000 P 017badd436654c6384c2ad11d1debf3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "017badd436654c6384c2ad11d1debf3f" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 34345 } }
I20260811 08:03:27.744073 16786 sys_catalog.cc:455] T 00000000000000000000000000000000 P 017badd436654c6384c2ad11d1debf3f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 017badd436654c6384c2ad11d1debf3f. Latest consensus state: current_term: 1 leader_uuid: "017badd436654c6384c2ad11d1debf3f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "017badd436654c6384c2ad11d1debf3f" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 34345 } } }
I20260811 08:03:27.744172 16786 sys_catalog.cc:458] T 00000000000000000000000000000000 P 017badd436654c6384c2ad11d1debf3f [sys.catalog]: This master's current role is: LEADER
I20260811 08:03:27.744340 16785 sys_catalog.cc:455] T 00000000000000000000000000000000 P 017badd436654c6384c2ad11d1debf3f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "017badd436654c6384c2ad11d1debf3f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "017badd436654c6384c2ad11d1debf3f" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 34345 } } }
I20260811 08:03:27.744501 16785 sys_catalog.cc:458] T 00000000000000000000000000000000 P 017badd436654c6384c2ad11d1debf3f [sys.catalog]: This master's current role is: LEADER
W20260811 08:03:27.745262 16799 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 017badd436654c6384c2ad11d1debf3f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 08:03:27.745333 16799 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 08:03:27.745390 16800 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:03:27.746321 16800 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:03:27.748051 16782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:27.733487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33368 (local address 127.15.36.254:34345)
0811 08:03:27.733820 (+ 333us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:27.733830 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:27.733866 (+ 36us) server_negotiation.cc:407] Connection header received
0811 08:03:27.734370 (+ 504us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:27.734377 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:27.734431 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:27.734592 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:27.735321 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:27.737242 (+ 1921us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:27.739114 (+ 1872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:27.739715 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:27.740002 (+ 287us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:27.743133 (+ 3131us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:27.743139 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:27.743139 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:27.743156 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:27.745791 (+ 2635us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:27.746607 (+ 816us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:27.746611 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:27.746612 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:27.746739 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:27.747030 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:27.747031 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:27.747031 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:27.747351 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:27.747565 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:27.747652 (+ 87us) server_negotiation.cc:299] Negotiation successful
0811 08:03:27.747807 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":271,"thread_start_us":104,"threads_started":1}
I20260811 08:03:27.748310 16800 catalog_manager.cc:1347] Generated new cluster ID: 736350c09c204559a4cede642149a988
I20260811 08:03:27.748361 16800 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:03:27.762218 16800 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:03:27.763435 16800 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:03:27.769469 16800 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 017badd436654c6384c2ad11d1debf3f: Generated new TSK 0
I20260811 08:03:27.769719 16800 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.36.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab.
Entry for principal kudu/127.15.36.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab.
I20260811 08:03:27.816895 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.193:0
--local_ip_for_outbound_sockets=127.15.36.193
--webserver_interface=127.15.36.193
--webserver_port=0
--tserver_master_addrs=127.15.36.254:34345
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab
--principal=kudu/127.15.36.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:44985
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:03:27.924718 16806 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:03:27.924978 16806 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:03:27.925009 16806 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:03:27.926548 16806 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:03:27.926640 16806 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:03:27.926664 16806 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 08:03:27.926685 16806 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.193
I20260811 08:03:27.929780 16806 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:44985
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab
--principal=kudu/127.15.36.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.36.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.15.36.254:34345
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16806
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.193
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:03:27.930076 16806 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:03:27.930408 16806 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:03:27.936214 16811 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:27.936228 16813 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:27.936218 16815 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:03:27.936753 16806 server_base.cc:1034] running on GCE node
I20260811 08:03:27.937146 16806 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:03:27.937469 16806 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:03:27.938656 16806 hybrid_clock.cc:648] HybridClock initialized: now 1786435407938627 us; error 53 us; skew 500 ppm
Aug 11 08:03:27 dist-test-slave-2w3w krb5kdc[16678](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435407, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:03:27.941706 16806 init.cc:377] Logged in from keytab as kudu/127.15.36.193@KRBTEST.COM (short username kudu)
I20260811 08:03:27.942359 16806 webserver.cc:460] Webserver started at http://127.15.36.193:39559/ using document root <none> and password file <none>
I20260811 08:03:27.942618 16806 fs_manager.cc:359] Metadata directory not provided
I20260811 08:03:27.942691 16806 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:03:27.942859 16806 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:03:27.944530 16806 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/ts-0/data/instance:
uuid: "2bcca3cde237444080a71d1a7660b76a"
format_stamp: "Formatted at 2026-08-11 08:03:27 on dist-test-slave-2w3w"
server_key: "fff6c502a1d6dbc12e5bcbdb518214bf"
server_key_iv: "fed11f103a2a0a2792ae157feed6c73c"
server_key_version: "encryptionkey@0"
I20260811 08:03:27.945029 16806 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/ts-0/wal/instance:
uuid: "2bcca3cde237444080a71d1a7660b76a"
format_stamp: "Formatted at 2026-08-11 08:03:27 on dist-test-slave-2w3w"
server_key: "fff6c502a1d6dbc12e5bcbdb518214bf"
server_key_iv: "fed11f103a2a0a2792ae157feed6c73c"
server_key_version: "encryptionkey@0"
I20260811 08:03:27.947219 16806 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260811 08:03:27.948508 16823 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:27.948980 16806 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:03:27.949223 16806 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/ts-0/wal
uuid: "2bcca3cde237444080a71d1a7660b76a"
format_stamp: "Formatted at 2026-08-11 08:03:27 on dist-test-slave-2w3w"
server_key: "fff6c502a1d6dbc12e5bcbdb518214bf"
server_key_iv: "fed11f103a2a0a2792ae157feed6c73c"
server_key_version: "encryptionkey@0"
I20260811 08:03:27.949326 16806 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:03:27.963254 16806 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:03:27.969172 16806 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:03:27.969403 16806 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:03:27.970191 16806 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:03:27.970249 16806 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:27.970283 16806 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:03:27.970301 16806 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:27.979887 16806 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.193:39515
I20260811 08:03:27.980156 16947 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.193:39515 every 8 connection(s)
I20260811 08:03:27.980705 16806 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
Aug 11 08:03:27 dist-test-slave-2w3w krb5kdc[16678](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435407, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.193@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:03:27.984376 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 16806
I20260811 08:03:27.984607 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/ts-0/wal/instance
I20260811 08:03:27.984783 15507 external_mini_cluster.cc:1428] Setting key d5dcef288bfcf1eb0471e1f17ba83e95
I20260811 08:03:27.988096 16782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:27.970913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:42211 (local address 127.15.36.254:34345)
0811 08:03:27.971125 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:27.971127 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:27.971313 (+ 186us) server_negotiation.cc:407] Connection header received
0811 08:03:27.972406 (+ 1093us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:27.972407 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:27.972440 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:27.972476 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:27.973384 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:27.974100 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:27.976073 (+ 1973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:27.976914 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:27.977735 (+ 821us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:27.981602 (+ 3867us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:27.981604 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:27.981604 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:27.981613 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:27.983280 (+ 1667us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:27.985943 (+ 2663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:27.985944 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:27.985945 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:27.986032 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:27.986403 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:27.986404 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:27.986404 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:27.986575 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:27.986655 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:27.987818 (+ 1163us) server_negotiation.cc:299] Negotiation successful
0811 08:03:27.987961 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":177}
I20260811 08:03:27.988788 16833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:27.970754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:34345 (local address 127.15.36.193:42211)
0811 08:03:27.971140 (+ 386us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:27.971209 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:27.972211 (+ 1002us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:27.972656 (+ 445us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:27.972660 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:27.973016 (+ 356us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:03:27.973277 (+ 261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:27.973284 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:27.974212 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:27.974214 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:27.975713 (+ 1499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:27.975722 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:27.977765 (+ 2043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:27.977767 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:27.977952 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:27.978715 (+ 763us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:03:27.978729 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:03:27.981441 (+ 2712us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:03:27.983459 (+ 2018us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:27.983472 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:27.983475 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:27.985755 (+ 2280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:27.986162 (+ 407us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:27.986163 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:27.986163 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:27.986315 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:27.986856 (+ 541us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:03:27.986864 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:03:27.987599 (+ 735us) client_negotiation.cc:769] Sending connection context
0811 08:03:27.987722 (+ 123us) client_negotiation.cc:240] Negotiation successful
0811 08:03:27.988580 (+ 858us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":106,"threads_started":1}
I20260811 08:03:27.989606 16948 heartbeater.cc:347] Connected to a master server at 127.15.36.254:34345
I20260811 08:03:27.989746 16948 heartbeater.cc:464] Registering TS with master...
I20260811 08:03:27.989995 16948 heartbeater.cc:511] Master 127.15.36.254:34345 requested a full tablet report, sending...
I20260811 08:03:27.990922 16726 ts_manager.cc:194] Registered new tserver with Master: 2bcca3cde237444080a71d1a7660b76a (127.15.36.193:39515)
I20260811 08:03:27.991943 16726 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.36.193@KRBTEST.COM'} at 127.15.36.193:42211
WARNING: no policy specified for kudu/127.15.36.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.194@KRBTEST.COM" created.
I20260811 08:03:28.004155 16782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:27.991575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:55427 (local address 127.15.36.254:34345)
0811 08:03:27.991628 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:27.991631 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:27.992316 (+ 685us) server_negotiation.cc:407] Connection header received
0811 08:03:27.992460 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:27.992461 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:27.992475 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:27.992536 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:27.993243 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:27.994077 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:27.997404 (+ 3327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:27.997631 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:27.997715 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:27.999480 (+ 1765us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:27.999484 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:27.999485 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:27.999497 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:28.002289 (+ 2792us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:28.003163 (+ 874us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:28.003165 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:28.003166 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:28.003252 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:28.003497 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:28.003498 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:28.003499 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:28.003644 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:28.003729 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:28.003932 (+ 203us) server_negotiation.cc:299] Negotiation successful
0811 08:03:28.004037 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 08:03:28.004173 16956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:27.991384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:34345 (local address 127.15.36.193:55427)
0811 08:03:27.992213 (+ 829us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:27.992233 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:27.992357 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:27.992540 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:27.992541 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:27.992886 (+ 345us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:03:27.992961 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:27.992965 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:27.994325 (+ 1360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:27.994326 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:27.997105 (+ 2779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:27.997111 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:27.997758 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:27.997759 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:27.997845 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:27.998718 (+ 873us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:03:27.998745 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:03:27.999238 (+ 493us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:03:28.002470 (+ 3232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:28.002472 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:28.002472 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:28.003040 (+ 568us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:28.003335 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:28.003336 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:28.003336 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:28.003415 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:28.003732 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:03:28.003734 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:03:28.003809 (+ 75us) client_negotiation.cc:769] Sending connection context
0811 08:03:28.003887 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 08:03:28.004039 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":598,"thread_start_us":95,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab.
Entry for principal kudu/127.15.36.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab.
I20260811 08:03:28.035651 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.194:0
--local_ip_for_outbound_sockets=127.15.36.194
--webserver_interface=127.15.36.194
--webserver_port=0
--tserver_master_addrs=127.15.36.254:34345
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab
--principal=kudu/127.15.36.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:44985
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:03:28.148085 16958 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:03:28.148350 16958 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:03:28.148382 16958 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:03:28.149649 16958 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:03:28.149693 16958 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:03:28.149714 16958 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 08:03:28.149732 16958 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.194
I20260811 08:03:28.151675 16958 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:44985
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab
--principal=kudu/127.15.36.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.36.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.15.36.254:34345
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16958
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.194
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:03:28.152048 16958 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:03:28.152272 16958 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:03:28.158453 16964 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:28.158453 16966 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:28.158494 16963 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:03:28.158659 16958 server_base.cc:1034] running on GCE node
I20260811 08:03:28.159072 16958 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:03:28.159403 16958 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:03:28.160619 16958 hybrid_clock.cc:648] HybridClock initialized: now 1786435408160598 us; error 36 us; skew 500 ppm
Aug 11 08:03:28 dist-test-slave-2w3w krb5kdc[16678](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435408, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:03:28.164119 16958 init.cc:377] Logged in from keytab as kudu/127.15.36.194@KRBTEST.COM (short username kudu)
I20260811 08:03:28.165001 16958 webserver.cc:460] Webserver started at http://127.15.36.194:40215/ using document root <none> and password file <none>
I20260811 08:03:28.165295 16958 fs_manager.cc:359] Metadata directory not provided
I20260811 08:03:28.165381 16958 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:03:28.165544 16958 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:03:28.166831 16958 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/ts-1/data/instance:
uuid: "bd902ddf2951402ca95d5433cb488703"
format_stamp: "Formatted at 2026-08-11 08:03:28 on dist-test-slave-2w3w"
server_key: "596758d06b4c517745e6dab608b11e7f"
server_key_iv: "f0c69aff1a2680858482f5de0e01c72b"
server_key_version: "encryptionkey@0"
I20260811 08:03:28.167374 16958 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/ts-1/wal/instance:
uuid: "bd902ddf2951402ca95d5433cb488703"
format_stamp: "Formatted at 2026-08-11 08:03:28 on dist-test-slave-2w3w"
server_key: "596758d06b4c517745e6dab608b11e7f"
server_key_iv: "f0c69aff1a2680858482f5de0e01c72b"
server_key_version: "encryptionkey@0"
I20260811 08:03:28.169020 16958 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:03:28.170097 16973 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:28.170317 16958 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:03:28.170423 16958 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/ts-1/wal
uuid: "bd902ddf2951402ca95d5433cb488703"
format_stamp: "Formatted at 2026-08-11 08:03:28 on dist-test-slave-2w3w"
server_key: "596758d06b4c517745e6dab608b11e7f"
server_key_iv: "f0c69aff1a2680858482f5de0e01c72b"
server_key_version: "encryptionkey@0"
I20260811 08:03:28.170485 16958 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:03:28.200445 16958 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:03:28.203593 16958 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:03:28.203739 16958 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:03:28.204546 16958 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:03:28.204814 16958 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:28.204898 16958 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:03:28.204926 16958 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 08:03:28 dist-test-slave-2w3w krb5kdc[16678](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435408, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.194@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:03:28.213634 16958 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.194:36797
I20260811 08:03:28.213698 17098 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.194:36797 every 8 connection(s)
I20260811 08:03:28.214098 16958 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
I20260811 08:03:28.219669 16782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:28.205454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:39073 (local address 127.15.36.254:34345)
0811 08:03:28.205538 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:28.205541 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:28.205993 (+ 452us) server_negotiation.cc:407] Connection header received
0811 08:03:28.207281 (+ 1288us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:28.207283 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:28.207299 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:28.207395 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:28.208189 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:28.209116 (+ 927us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:28.211145 (+ 2029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:28.211369 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:28.211448 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:28.214014 (+ 2566us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:28.214016 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:28.214017 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:28.214026 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:28.216726 (+ 2700us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:28.217643 (+ 917us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:28.217644 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:28.217645 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:28.217718 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:28.218313 (+ 595us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:28.218316 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:28.218316 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:28.218703 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:28.218831 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:28.219469 (+ 638us) server_negotiation.cc:299] Negotiation successful
0811 08:03:28.219588 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 08:03:28.219924 16983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:28.205403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:34345 (local address 127.15.36.194:39073)
0811 08:03:28.205756 (+ 353us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:28.205800 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:28.207131 (+ 1331us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:28.207508 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:28.207514 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:28.207849 (+ 335us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:03:28.208080 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:28.208085 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:28.209219 (+ 1134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:28.209221 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:28.211017 (+ 1796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:28.211022 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:28.211472 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:28.211473 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:28.211620 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:28.212249 (+ 629us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:03:28.212259 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:03:28.213883 (+ 1624us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:03:28.216850 (+ 2967us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:28.216859 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:28.216861 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:28.217528 (+ 667us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:28.217835 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:28.217836 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:28.217836 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:28.218139 (+ 303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:28.218868 (+ 729us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:03:28.218885 (+ 17us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:03:28.219271 (+ 386us) client_negotiation.cc:769] Sending connection context
0811 08:03:28.219400 (+ 129us) client_negotiation.cc:240] Negotiation successful
0811 08:03:28.219589 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":297,"thread_start_us":254,"threads_started":1}
I20260811 08:03:28.220805 17099 heartbeater.cc:347] Connected to a master server at 127.15.36.254:34345
I20260811 08:03:28.220916 17099 heartbeater.cc:464] Registering TS with master...
I20260811 08:03:28.221158 17099 heartbeater.cc:511] Master 127.15.36.254:34345 requested a full tablet report, sending...
I20260811 08:03:28.221638 16727 ts_manager.cc:194] Registered new tserver with Master: bd902ddf2951402ca95d5433cb488703 (127.15.36.194:36797)
I20260811 08:03:28.222173 16727 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.36.194@KRBTEST.COM'} at 127.15.36.194:39073
I20260811 08:03:28.224117 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 16958
I20260811 08:03:28.224200 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/ts-1/wal/instance
I20260811 08:03:28.224397 15507 external_mini_cluster.cc:1428] Setting key 734d72fa41667b5d6fccf09c229b3455
I20260811 08:03:28.229395 17106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:28.222193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:34345 (local address 127.15.36.194:49561)
0811 08:03:28.222610 (+ 417us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:28.222621 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:28.222718 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:28.223054 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:28.223055 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:28.223393 (+ 338us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:03:28.223457 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:28.223459 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:28.224293 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:28.224294 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:28.224969 (+ 675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:28.224972 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:28.225377 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:28.225378 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:28.225453 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:28.225996 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:03:28.226001 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:03:28.226334 (+ 333us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:03:28.228211 (+ 1877us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:28.228212 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:28.228213 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:28.228435 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:28.228657 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:28.228658 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:28.228658 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:28.228716 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:28.229096 (+ 380us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:03:28.229097 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:03:28.229146 (+ 49us) client_negotiation.cc:769] Sending connection context
0811 08:03:28.229206 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 08:03:28.229317 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":386,"thread_start_us":91,"threads_started":1}
I20260811 08:03:28.229509 16782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:28.222338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:49561 (local address 127.15.36.254:34345)
0811 08:03:28.222466 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:28.222468 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:28.222693 (+ 225us) server_negotiation.cc:407] Connection header received
0811 08:03:28.222924 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:28.222926 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:28.222938 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:28.223041 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:28.223566 (+ 525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:28.224203 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:28.225066 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:28.225293 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:28.225377 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:28.226432 (+ 1055us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:28.226434 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:28.226434 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:28.226441 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:28.228113 (+ 1672us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:28.228516 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:28.228517 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:28.228517 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:28.228586 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:28.228779 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:28.228780 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:28.228780 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:28.229013 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:28.229091 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:28.229255 (+ 164us) server_negotiation.cc:299] Negotiation successful
0811 08:03:28.229362 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
WARNING: no policy specified for kudu/127.15.36.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab.
Entry for principal kudu/127.15.36.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab.
I20260811 08:03:28.266781 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.195:0
--local_ip_for_outbound_sockets=127.15.36.195
--webserver_interface=127.15.36.195
--webserver_port=0
--tserver_master_addrs=127.15.36.254:34345
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab
--principal=kudu/127.15.36.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:44985
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:03:28.384500 17109 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:03:28.384774 17109 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:03:28.384804 17109 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:03:28.386349 17109 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:03:28.386423 17109 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:03:28.386449 17109 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 08:03:28.386469 17109 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.195
I20260811 08:03:28.388312 17109 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:44985
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab
--principal=kudu/127.15.36.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.36.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.15.36.254:34345
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17109
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.195
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:03:28.388609 17109 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:03:28.388887 17109 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:03:28.399499 17114 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:28.399505 17117 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:28.399535 17115 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:03:28.400058 17109 server_base.cc:1034] running on GCE node
I20260811 08:03:28.400291 17109 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:03:28.400555 17109 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:03:28.401731 17109 hybrid_clock.cc:648] HybridClock initialized: now 1786435408401715 us; error 38 us; skew 500 ppm
Aug 11 08:03:28 dist-test-slave-2w3w krb5kdc[16678](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435408, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:03:28.405642 17109 init.cc:377] Logged in from keytab as kudu/127.15.36.195@KRBTEST.COM (short username kudu)
I20260811 08:03:28.406193 17109 webserver.cc:460] Webserver started at http://127.15.36.195:36569/ using document root <none> and password file <none>
I20260811 08:03:28.406459 17109 fs_manager.cc:359] Metadata directory not provided
I20260811 08:03:28.406539 17109 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:03:28.406795 17109 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:03:28.408842 17109 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/ts-2/data/instance:
uuid: "577685d95b5649c2ad338825eddf51d5"
format_stamp: "Formatted at 2026-08-11 08:03:28 on dist-test-slave-2w3w"
server_key: "2be63a9f2467463287b307b1a9d61de7"
server_key_iv: "7d7f5645e0f571351f88b8c42237d21d"
server_key_version: "encryptionkey@0"
I20260811 08:03:28.409544 17109 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/ts-2/wal/instance:
uuid: "577685d95b5649c2ad338825eddf51d5"
format_stamp: "Formatted at 2026-08-11 08:03:28 on dist-test-slave-2w3w"
server_key: "2be63a9f2467463287b307b1a9d61de7"
server_key_iv: "7d7f5645e0f571351f88b8c42237d21d"
server_key_version: "encryptionkey@0"
I20260811 08:03:28.411403 17109 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.003s
I20260811 08:03:28.412482 17125 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:28.412922 17109 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:03:28.413230 17109 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/ts-2/wal
uuid: "577685d95b5649c2ad338825eddf51d5"
format_stamp: "Formatted at 2026-08-11 08:03:28 on dist-test-slave-2w3w"
server_key: "2be63a9f2467463287b307b1a9d61de7"
server_key_iv: "7d7f5645e0f571351f88b8c42237d21d"
server_key_version: "encryptionkey@0"
I20260811 08:03:28.413383 17109 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:03:28.441969 17109 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:03:28.444927 17109 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:03:28.445066 17109 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:03:28.445715 17109 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:03:28.445772 17109 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:28.445816 17109 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:03:28.445833 17109 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:28.453297 17109 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.195:37707
I20260811 08:03:28.453394 17257 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.195:37707 every 8 connection(s)
Aug 11 08:03:28 dist-test-slave-2w3w krb5kdc[16678](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435408, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.195@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:03:28.453797 17109 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
I20260811 08:03:28.456626 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 17109
I20260811 08:03:28.456734 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/ts-2/wal/instance
I20260811 08:03:28.456933 15507 external_mini_cluster.cc:1428] Setting key 01cc10b50e4d6c18ad992d9b83fc37cd
I20260811 08:03:28.457902 16782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:28.446271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:55489 (local address 127.15.36.254:34345)
0811 08:03:28.446350 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:28.446353 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:28.446689 (+ 336us) server_negotiation.cc:407] Connection header received
0811 08:03:28.447348 (+ 659us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:28.447349 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:28.447364 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:28.447432 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:28.448480 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:28.449316 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:28.451001 (+ 1685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:28.451238 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:28.451324 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:28.454263 (+ 2939us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:28.454265 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:28.454266 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:28.454276 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:28.455936 (+ 1660us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:28.456483 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:28.456485 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:28.456486 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:28.456563 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:28.457026 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:28.457028 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:28.457028 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:28.457182 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:28.457266 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:28.457689 (+ 423us) server_negotiation.cc:299] Negotiation successful
0811 08:03:28.457815 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 08:03:28.458056 17135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:28.446350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:34345 (local address 127.15.36.195:55489)
0811 08:03:28.446539 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:28.446584 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:28.447224 (+ 640us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:28.447571 (+ 347us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:28.447577 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:28.448004 (+ 427us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:03:28.448349 (+ 345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:28.448358 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:28.449416 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:28.449417 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:28.450884 (+ 1467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:28.450888 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:28.451335 (+ 447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:28.451336 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:28.451481 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:28.452137 (+ 656us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:03:28.452148 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:03:28.454112 (+ 1964us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:03:28.456086 (+ 1974us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:28.456093 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:28.456096 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:28.456364 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:28.456654 (+ 290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:28.456655 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:28.456655 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:28.456936 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:28.457265 (+ 329us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:03:28.457274 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:03:28.457457 (+ 183us) client_negotiation.cc:769] Sending connection context
0811 08:03:28.457583 (+ 126us) client_negotiation.cc:240] Negotiation successful
0811 08:03:28.457811 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":111,"threads_started":1}
I20260811 08:03:28.458693 17258 heartbeater.cc:347] Connected to a master server at 127.15.36.254:34345
I20260811 08:03:28.458856 17258 heartbeater.cc:464] Registering TS with master...
I20260811 08:03:28.459151 17258 heartbeater.cc:511] Master 127.15.36.254:34345 requested a full tablet report, sending...
I20260811 08:03:28.460235 16727 ts_manager.cc:194] Registered new tserver with Master: 577685d95b5649c2ad338825eddf51d5 (127.15.36.195:37707)
I20260811 08:03:28.461010 16727 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.36.195@KRBTEST.COM'} at 127.15.36.195:55489
I20260811 08:03:28.468420 17264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:28.460491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:34345 (local address 127.15.36.195:44503)
0811 08:03:28.460819 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:28.460833 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:28.460906 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:28.461244 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:28.461246 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:28.461554 (+ 308us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:03:28.461631 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:28.461634 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:28.462359 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:28.462360 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:28.462911 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:28.462913 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:28.463319 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:28.463320 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:28.463394 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:28.463919 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:03:28.463923 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:03:28.464255 (+ 332us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:03:28.466342 (+ 2087us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:28.466343 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:28.466343 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:28.466546 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:28.466862 (+ 316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:28.466864 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:28.466864 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:28.467400 (+ 536us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:28.468033 (+ 633us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:03:28.468034 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:03:28.468100 (+ 66us) client_negotiation.cc:769] Sending connection context
0811 08:03:28.468186 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 08:03:28.468316 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":196,"threads_started":1}
I20260811 08:03:28.468736 16782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:28.460718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:44503 (local address 127.15.36.254:34345)
0811 08:03:28.460760 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:28.460762 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:28.461095 (+ 333us) server_negotiation.cc:407] Connection header received
0811 08:03:28.461127 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:28.461128 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:28.461140 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:28.461232 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:28.461720 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:28.462208 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:28.463040 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:28.463221 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:28.463279 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:28.464350 (+ 1071us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:28.464352 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:28.464352 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:28.464359 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:28.466229 (+ 1870us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:28.466641 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:28.466642 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:28.466643 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:28.466702 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:28.467678 (+ 976us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:28.467679 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:28.467679 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:28.467836 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:28.467909 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:28.468300 (+ 391us) server_negotiation.cc:299] Negotiation successful
0811 08:03:28.468641 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 08:03:28.470189 15507 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 08:03:28 dist-test-slave-2w3w krb5kdc[16678](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435408, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 08:03:28 dist-test-slave-2w3w krb5kdc[16678](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435408, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:03:28.498493 16782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:28.489961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58916 (local address 127.15.36.254:34345)
0811 08:03:28.490154 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:28.490224 (+ 70us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:28.490254 (+ 30us) server_negotiation.cc:407] Connection header received
0811 08:03:28.490367 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:28.490369 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:28.490389 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:28.490457 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:28.491419 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:28.492072 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:28.492924 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:28.493121 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:28.493199 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:28.495814 (+ 2615us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:28.495816 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:28.495817 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:28.495826 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:28.497275 (+ 1449us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:28.497660 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:28.497662 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:28.497662 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:28.497722 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:28.497936 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:28.497937 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:28.497937 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:28.498062 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:28.498172 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:28.498292 (+ 120us) server_negotiation.cc:299] Negotiation successful
0811 08:03:28.498380 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134}
I20260811 08:03:28.500728 16727 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58916:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:03:28.502931 16727 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:03:28.511869 17275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:28.505936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.193:39515 (local address 127.0.0.1:37548)
0811 08:03:28.506483 (+ 547us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:28.506497 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:28.506566 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:28.507111 (+ 545us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:28.507112 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:28.507114 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:03:28.507175 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:28.507177 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:28.508505 (+ 1328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:28.508506 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:28.509786 (+ 1280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:28.509788 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:28.511036 (+ 1248us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:28.511037 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:28.511151 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:28.511172 (+ 21us) client_negotiation.cc:769] Sending connection context
0811 08:03:28.511260 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 08:03:28.511334 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":528,"mutex_wait_us":4,"thread_start_us":142,"threads_started":1}
I20260811 08:03:28.511874 17280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:28.506533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43156 (local address 127.15.36.194:36797)
0811 08:03:28.506729 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:28.506732 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:28.506743 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:03:28.507114 (+ 371us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:28.507116 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:28.507131 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:28.507215 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:03:28.507345 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:28.508419 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:28.510356 (+ 1937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:28.511266 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:28.511353 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:28.511422 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:28.511710 (+ 288us) server_negotiation.cc:299] Negotiation successful
0811 08:03:28.511762 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":90,"threads_started":1}
I20260811 08:03:28.512351 17276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:28.506257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.194:36797 (local address 127.0.0.1:43156)
0811 08:03:28.506656 (+ 399us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:28.506665 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:28.506789 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:28.507231 (+ 442us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:28.507232 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:28.507234 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:03:28.507272 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:28.507274 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:28.508500 (+ 1226us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:28.508501 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:28.510150 (+ 1649us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:28.510158 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:28.511465 (+ 1307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:28.511466 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:28.511546 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:28.511551 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 08:03:28.511603 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 08:03:28.511658 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":380,"mutex_wait_us":44,"thread_start_us":88,"threads_started":1}
I20260811 08:03:28.512490 17279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:28.506366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37548 (local address 127.15.36.193:39515)
0811 08:03:28.506860 (+ 494us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:28.506864 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:28.506874 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:03:28.506909 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:28.506911 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:28.506928 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:28.507041 (+ 113us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:03:28.507255 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:28.508367 (+ 1112us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:28.509895 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:28.510861 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:28.510953 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:28.511726 (+ 773us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:28.512145 (+ 419us) server_negotiation.cc:299] Negotiation successful
0811 08:03:28.512247 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":463,"thread_start_us":51,"threads_started":1}
I20260811 08:03:28.512476 17277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:28.505936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.195:37707 (local address 127.0.0.1:51886)
0811 08:03:28.506408 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:28.506454 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:28.506536 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:28.506830 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:28.506834 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:28.506837 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:03:28.506926 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:28.506928 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:28.508008 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:28.508009 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:28.509513 (+ 1504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:28.509516 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:28.511289 (+ 1773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:28.511307 (+ 18us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:28.511675 (+ 368us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:28.511683 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 08:03:28.512172 (+ 489us) client_negotiation.cc:240] Negotiation successful
0811 08:03:28.512406 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":435,"thread_start_us":143,"threads_started":1}
I20260811 08:03:28.512854 17278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:28.506242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51886 (local address 127.15.36.195:37707)
0811 08:03:28.506465 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:28.506471 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:28.506509 (+ 38us) server_negotiation.cc:407] Connection header received
0811 08:03:28.506635 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:28.506637 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:28.506672 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:28.506743 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:03:28.507060 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:28.507916 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:28.509624 (+ 1708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:28.510789 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:28.510909 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:28.512678 (+ 1769us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:28.512723 (+ 45us) server_negotiation.cc:299] Negotiation successful
0811 08:03:28.512777 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":184,"thread_start_us":141,"threads_started":1}
I20260811 08:03:28.513437 17021 tablet_service.cc:1467] Processing CreateTablet for tablet 6814f7da32754091a82bb8c8e13c389e (DEFAULT_TABLE table=test-table [id=05ecadc329dd4603b8f03ac62b9701ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:03:28.513415 16876 tablet_service.cc:1467] Processing CreateTablet for tablet 6814f7da32754091a82bb8c8e13c389e (DEFAULT_TABLE table=test-table [id=05ecadc329dd4603b8f03ac62b9701ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:03:28.513520 17185 tablet_service.cc:1467] Processing CreateTablet for tablet 6814f7da32754091a82bb8c8e13c389e (DEFAULT_TABLE table=test-table [id=05ecadc329dd4603b8f03ac62b9701ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:03:28.513769 17021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6814f7da32754091a82bb8c8e13c389e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:03:28.513813 17185 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6814f7da32754091a82bb8c8e13c389e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:03:28.513804 16876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6814f7da32754091a82bb8c8e13c389e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:03:28.518380 17284 tablet_bootstrap.cc:492] T 6814f7da32754091a82bb8c8e13c389e P 577685d95b5649c2ad338825eddf51d5: Bootstrap starting.
I20260811 08:03:28.519213 17283 tablet_bootstrap.cc:492] T 6814f7da32754091a82bb8c8e13c389e P 2bcca3cde237444080a71d1a7660b76a: Bootstrap starting.
I20260811 08:03:28.519964 17283 tablet_bootstrap.cc:654] T 6814f7da32754091a82bb8c8e13c389e P 2bcca3cde237444080a71d1a7660b76a: Neither blocks nor log segments found. Creating new log.
I20260811 08:03:28.520373 17283 log.cc:824] T 6814f7da32754091a82bb8c8e13c389e P 2bcca3cde237444080a71d1a7660b76a: Log is configured to *not* fsync() on all Append() calls
I20260811 08:03:28.520462 17284 tablet_bootstrap.cc:654] T 6814f7da32754091a82bb8c8e13c389e P 577685d95b5649c2ad338825eddf51d5: Neither blocks nor log segments found. Creating new log.
I20260811 08:03:28.520905 17284 log.cc:824] T 6814f7da32754091a82bb8c8e13c389e P 577685d95b5649c2ad338825eddf51d5: Log is configured to *not* fsync() on all Append() calls
I20260811 08:03:28.521303 17283 tablet_bootstrap.cc:492] T 6814f7da32754091a82bb8c8e13c389e P 2bcca3cde237444080a71d1a7660b76a: No bootstrap required, opened a new log
I20260811 08:03:28.521217 17286 tablet_bootstrap.cc:492] T 6814f7da32754091a82bb8c8e13c389e P bd902ddf2951402ca95d5433cb488703: Bootstrap starting.
I20260811 08:03:28.521381 17283 ts_tablet_manager.cc:1397] T 6814f7da32754091a82bb8c8e13c389e P 2bcca3cde237444080a71d1a7660b76a: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 08:03:28.521771 17284 tablet_bootstrap.cc:492] T 6814f7da32754091a82bb8c8e13c389e P 577685d95b5649c2ad338825eddf51d5: No bootstrap required, opened a new log
I20260811 08:03:28.521867 17284 ts_tablet_manager.cc:1397] T 6814f7da32754091a82bb8c8e13c389e P 577685d95b5649c2ad338825eddf51d5: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20260811 08:03:28.522056 17286 tablet_bootstrap.cc:654] T 6814f7da32754091a82bb8c8e13c389e P bd902ddf2951402ca95d5433cb488703: Neither blocks nor log segments found. Creating new log.
I20260811 08:03:28.522581 17286 log.cc:824] T 6814f7da32754091a82bb8c8e13c389e P bd902ddf2951402ca95d5433cb488703: Log is configured to *not* fsync() on all Append() calls
I20260811 08:03:28.523782 17286 tablet_bootstrap.cc:492] T 6814f7da32754091a82bb8c8e13c389e P bd902ddf2951402ca95d5433cb488703: No bootstrap required, opened a new log
I20260811 08:03:28.523873 17286 ts_tablet_manager.cc:1397] T 6814f7da32754091a82bb8c8e13c389e P bd902ddf2951402ca95d5433cb488703: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 08:03:28.523954 17284 raft_consensus.cc:348] T 6814f7da32754091a82bb8c8e13c389e P 577685d95b5649c2ad338825eddf51d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "577685d95b5649c2ad338825eddf51d5" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 37707 } } peers { permanent_uuid: "bd902ddf2951402ca95d5433cb488703" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 36797 } } peers { permanent_uuid: "2bcca3cde237444080a71d1a7660b76a" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 39515 } }
I20260811 08:03:28.524220 17284 raft_consensus.cc:374] T 6814f7da32754091a82bb8c8e13c389e P 577685d95b5649c2ad338825eddf51d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:03:28.524260 17284 raft_consensus.cc:729] T 6814f7da32754091a82bb8c8e13c389e P 577685d95b5649c2ad338825eddf51d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 577685d95b5649c2ad338825eddf51d5, State: Initialized, Role: FOLLOWER
I20260811 08:03:28.524381 17284 consensus_queue.cc:260] T 6814f7da32754091a82bb8c8e13c389e P 577685d95b5649c2ad338825eddf51d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "577685d95b5649c2ad338825eddf51d5" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 37707 } } peers { permanent_uuid: "bd902ddf2951402ca95d5433cb488703" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 36797 } } peers { permanent_uuid: "2bcca3cde237444080a71d1a7660b76a" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 39515 } }
I20260811 08:03:28.524689 17284 ts_tablet_manager.cc:1428] T 6814f7da32754091a82bb8c8e13c389e P 577685d95b5649c2ad338825eddf51d5: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 08:03:28.524804 17258 heartbeater.cc:503] Master 127.15.36.254:34345 was elected leader, sending a full tablet report...
I20260811 08:03:28.525939 17283 raft_consensus.cc:348] T 6814f7da32754091a82bb8c8e13c389e P 2bcca3cde237444080a71d1a7660b76a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "577685d95b5649c2ad338825eddf51d5" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 37707 } } peers { permanent_uuid: "bd902ddf2951402ca95d5433cb488703" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 36797 } } peers { permanent_uuid: "2bcca3cde237444080a71d1a7660b76a" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 39515 } }
I20260811 08:03:28.526248 17283 raft_consensus.cc:374] T 6814f7da32754091a82bb8c8e13c389e P 2bcca3cde237444080a71d1a7660b76a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:03:28.526304 17283 raft_consensus.cc:729] T 6814f7da32754091a82bb8c8e13c389e P 2bcca3cde237444080a71d1a7660b76a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bcca3cde237444080a71d1a7660b76a, State: Initialized, Role: FOLLOWER
I20260811 08:03:28.526472 17283 consensus_queue.cc:260] T 6814f7da32754091a82bb8c8e13c389e P 2bcca3cde237444080a71d1a7660b76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "577685d95b5649c2ad338825eddf51d5" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 37707 } } peers { permanent_uuid: "bd902ddf2951402ca95d5433cb488703" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 36797 } } peers { permanent_uuid: "2bcca3cde237444080a71d1a7660b76a" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 39515 } }
I20260811 08:03:28.527168 17283 ts_tablet_manager.cc:1428] T 6814f7da32754091a82bb8c8e13c389e P 2bcca3cde237444080a71d1a7660b76a: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260811 08:03:28.527370 16948 heartbeater.cc:503] Master 127.15.36.254:34345 was elected leader, sending a full tablet report...
I20260811 08:03:28.529009 17286 raft_consensus.cc:348] T 6814f7da32754091a82bb8c8e13c389e P bd902ddf2951402ca95d5433cb488703 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "577685d95b5649c2ad338825eddf51d5" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 37707 } } peers { permanent_uuid: "bd902ddf2951402ca95d5433cb488703" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 36797 } } peers { permanent_uuid: "2bcca3cde237444080a71d1a7660b76a" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 39515 } }
I20260811 08:03:28.529245 17286 raft_consensus.cc:374] T 6814f7da32754091a82bb8c8e13c389e P bd902ddf2951402ca95d5433cb488703 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:03:28.529290 17286 raft_consensus.cc:729] T 6814f7da32754091a82bb8c8e13c389e P bd902ddf2951402ca95d5433cb488703 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd902ddf2951402ca95d5433cb488703, State: Initialized, Role: FOLLOWER
I20260811 08:03:28.529402 17286 consensus_queue.cc:260] T 6814f7da32754091a82bb8c8e13c389e P bd902ddf2951402ca95d5433cb488703 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "577685d95b5649c2ad338825eddf51d5" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 37707 } } peers { permanent_uuid: "bd902ddf2951402ca95d5433cb488703" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 36797 } } peers { permanent_uuid: "2bcca3cde237444080a71d1a7660b76a" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 39515 } }
I20260811 08:03:28.529682 17286 ts_tablet_manager.cc:1428] T 6814f7da32754091a82bb8c8e13c389e P bd902ddf2951402ca95d5433cb488703: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260811 08:03:28.529856 17099 heartbeater.cc:503] Master 127.15.36.254:34345 was elected leader, sending a full tablet report...
I20260811 08:03:28.680773 17289 raft_consensus.cc:482] T 6814f7da32754091a82bb8c8e13c389e P 577685d95b5649c2ad338825eddf51d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:03:28.681034 17289 raft_consensus.cc:504] T 6814f7da32754091a82bb8c8e13c389e P 577685d95b5649c2ad338825eddf51d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "577685d95b5649c2ad338825eddf51d5" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 37707 } } peers { permanent_uuid: "bd902ddf2951402ca95d5433cb488703" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 36797 } } peers { permanent_uuid: "2bcca3cde237444080a71d1a7660b76a" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 39515 } }
I20260811 08:03:28.681515 17289 leader_election.cc:288] T 6814f7da32754091a82bb8c8e13c389e P 577685d95b5649c2ad338825eddf51d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd902ddf2951402ca95d5433cb488703 (127.15.36.194:36797), 2bcca3cde237444080a71d1a7660b76a (127.15.36.193:39515)
I20260811 08:03:28.685074 17279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:28.682091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:58489 (local address 127.15.36.193:39515)
0811 08:03:28.682154 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:28.682156 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:28.682167 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:03:28.682203 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:28.682204 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:28.682215 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:28.682374 (+ 159us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:03:28.682710 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:28.683224 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:28.684293 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:28.684690 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:28.684774 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:28.684785 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:28.684952 (+ 167us) server_negotiation.cc:299] Negotiation successful
0811 08:03:28.684991 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 08:03:28.685074 17135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:28.681787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.193:39515 (local address 127.15.36.195:58489)
0811 08:03:28.681860 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:28.681882 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:28.681976 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:28.682399 (+ 423us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:28.682400 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:28.682402 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:03:28.682577 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:28.682581 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:28.683403 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:28.683404 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:28.684185 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:28.684188 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:28.684792 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:28.684793 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:28.684875 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:28.684879 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:03:28.684947 (+ 68us) client_negotiation.cc:240] Negotiation successful
0811 08:03:28.684990 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47}
I20260811 08:03:28.685544 16897 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6814f7da32754091a82bb8c8e13c389e" candidate_uuid: "577685d95b5649c2ad338825eddf51d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bcca3cde237444080a71d1a7660b76a" is_pre_election: true
I20260811 08:03:28.685745 16897 raft_consensus.cc:2454] T 6814f7da32754091a82bb8c8e13c389e P 2bcca3cde237444080a71d1a7660b76a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 577685d95b5649c2ad338825eddf51d5 in term 0.
I20260811 08:03:28.685767 17292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:28.681961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.194:36797 (local address 127.15.36.195:47461)
0811 08:03:28.682431 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:28.682443 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:28.682716 (+ 273us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:28.683079 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:28.683081 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:28.683083 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:03:28.683179 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:28.683181 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:28.684021 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:28.684022 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:28.684771 (+ 749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:28.684773 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:28.685514 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:28.685515 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:28.685579 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:28.685582 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:03:28.685630 (+ 48us) client_negotiation.cc:240] Negotiation successful
0811 08:03:28.685660 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":439,"thread_start_us":362,"threads_started":1}
I20260811 08:03:28.685775 17280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:28.682124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:47461 (local address 127.15.36.194:36797)
0811 08:03:28.682178 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:28.682181 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:28.682699 (+ 518us) server_negotiation.cc:407] Connection header received
0811 08:03:28.682932 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:28.682934 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:28.682953 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:28.683074 (+ 121us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:03:28.683262 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:28.683927 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:28.684872 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:28.685384 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:28.685461 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:28.685469 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:28.685662 (+ 193us) server_negotiation.cc:299] Negotiation successful
0811 08:03:28.685705 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 08:03:28.686072 17127 leader_election.cc:302] T 6814f7da32754091a82bb8c8e13c389e P 577685d95b5649c2ad338825eddf51d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bcca3cde237444080a71d1a7660b76a, 577685d95b5649c2ad338825eddf51d5; no voters:
I20260811 08:03:28.686132 17048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6814f7da32754091a82bb8c8e13c389e" candidate_uuid: "577685d95b5649c2ad338825eddf51d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd902ddf2951402ca95d5433cb488703" is_pre_election: true
I20260811 08:03:28.686221 17289 raft_consensus.cc:2781] T 6814f7da32754091a82bb8c8e13c389e P 577685d95b5649c2ad338825eddf51d5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:03:28.686369 17048 raft_consensus.cc:2454] T 6814f7da32754091a82bb8c8e13c389e P bd902ddf2951402ca95d5433cb488703 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 577685d95b5649c2ad338825eddf51d5 in term 0.
I20260811 08:03:28.686388 17289 raft_consensus.cc:482] T 6814f7da32754091a82bb8c8e13c389e P 577685d95b5649c2ad338825eddf51d5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:03:28.686424 17289 raft_consensus.cc:3037] T 6814f7da32754091a82bb8c8e13c389e P 577685d95b5649c2ad338825eddf51d5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:03:28.687676 17289 raft_consensus.cc:504] T 6814f7da32754091a82bb8c8e13c389e P 577685d95b5649c2ad338825eddf51d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "577685d95b5649c2ad338825eddf51d5" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 37707 } } peers { permanent_uuid: "bd902ddf2951402ca95d5433cb488703" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 36797 } } peers { permanent_uuid: "2bcca3cde237444080a71d1a7660b76a" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 39515 } }
I20260811 08:03:28.687929 17289 leader_election.cc:288] T 6814f7da32754091a82bb8c8e13c389e P 577685d95b5649c2ad338825eddf51d5 [CANDIDATE]: Term 1 election: Requested vote from peers bd902ddf2951402ca95d5433cb488703 (127.15.36.194:36797), 2bcca3cde237444080a71d1a7660b76a (127.15.36.193:39515)
I20260811 08:03:28.688242 17048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6814f7da32754091a82bb8c8e13c389e" candidate_uuid: "577685d95b5649c2ad338825eddf51d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd902ddf2951402ca95d5433cb488703"
I20260811 08:03:28.688252 16897 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6814f7da32754091a82bb8c8e13c389e" candidate_uuid: "577685d95b5649c2ad338825eddf51d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bcca3cde237444080a71d1a7660b76a"
I20260811 08:03:28.688364 17048 raft_consensus.cc:3037] T 6814f7da32754091a82bb8c8e13c389e P bd902ddf2951402ca95d5433cb488703 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:03:28.688362 16897 raft_consensus.cc:3037] T 6814f7da32754091a82bb8c8e13c389e P 2bcca3cde237444080a71d1a7660b76a [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:03:28.689718 17048 raft_consensus.cc:2454] T 6814f7da32754091a82bb8c8e13c389e P bd902ddf2951402ca95d5433cb488703 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 577685d95b5649c2ad338825eddf51d5 in term 1.
I20260811 08:03:28.689767 16897 raft_consensus.cc:2454] T 6814f7da32754091a82bb8c8e13c389e P 2bcca3cde237444080a71d1a7660b76a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 577685d95b5649c2ad338825eddf51d5 in term 1.
I20260811 08:03:28.690128 17127 leader_election.cc:302] T 6814f7da32754091a82bb8c8e13c389e P 577685d95b5649c2ad338825eddf51d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bcca3cde237444080a71d1a7660b76a, 577685d95b5649c2ad338825eddf51d5; no voters:
I20260811 08:03:28.690285 17289 raft_consensus.cc:2781] T 6814f7da32754091a82bb8c8e13c389e P 577685d95b5649c2ad338825eddf51d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:03:28.690502 17289 raft_consensus.cc:686] T 6814f7da32754091a82bb8c8e13c389e P 577685d95b5649c2ad338825eddf51d5 [term 1 LEADER]: Becoming Leader. State: Replica: 577685d95b5649c2ad338825eddf51d5, State: Running, Role: LEADER
I20260811 08:03:28.690627 17289 consensus_queue.cc:237] T 6814f7da32754091a82bb8c8e13c389e P 577685d95b5649c2ad338825eddf51d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "577685d95b5649c2ad338825eddf51d5" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 37707 } } peers { permanent_uuid: "bd902ddf2951402ca95d5433cb488703" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 36797 } } peers { permanent_uuid: "2bcca3cde237444080a71d1a7660b76a" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 39515 } }
I20260811 08:03:28.691720 16727 catalog_manager.cc:5495] T 6814f7da32754091a82bb8c8e13c389e P 577685d95b5649c2ad338825eddf51d5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 577685d95b5649c2ad338825eddf51d5 (127.15.36.195). New cstate: current_term: 1 leader_uuid: "577685d95b5649c2ad338825eddf51d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "577685d95b5649c2ad338825eddf51d5" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 37707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd902ddf2951402ca95d5433cb488703" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 36797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bcca3cde237444080a71d1a7660b76a" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 39515 } health_report { overall_health: UNKNOWN } } }
I20260811 08:03:28.703869 17278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:28.700666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51888 (local address 127.15.36.195:37707)
0811 08:03:28.700750 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:28.700752 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:28.700763 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:03:28.700987 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:28.700989 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:28.701020 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:28.701108 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:03:28.701291 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:28.701822 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:28.702764 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:28.703074 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:28.703165 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:28.703444 (+ 279us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:03:28.703564 (+ 120us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:03:28.703673 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:28.703723 (+ 50us) server_negotiation.cc:299] Negotiation successful
0811 08:03:28.703750 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
W20260811 08:03:28.704512 17259 tablet.cc:2369] T 6814f7da32754091a82bb8c8e13c389e P 577685d95b5649c2ad338825eddf51d5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:03:28.706182 17048 raft_consensus.cc:1261] T 6814f7da32754091a82bb8c8e13c389e P bd902ddf2951402ca95d5433cb488703 [term 1 FOLLOWER]: Refusing update from remote peer 577685d95b5649c2ad338825eddf51d5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:03:28.706182 16897 raft_consensus.cc:1261] T 6814f7da32754091a82bb8c8e13c389e P 2bcca3cde237444080a71d1a7660b76a [term 1 FOLLOWER]: Refusing update from remote peer 577685d95b5649c2ad338825eddf51d5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:03:28.706590 17293 consensus_queue.cc:1035] T 6814f7da32754091a82bb8c8e13c389e P 577685d95b5649c2ad338825eddf51d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd902ddf2951402ca95d5433cb488703" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:03:28.706732 17289 consensus_queue.cc:1035] T 6814f7da32754091a82bb8c8e13c389e P 577685d95b5649c2ad338825eddf51d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bcca3cde237444080a71d1a7660b76a" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:03:28.709714 17297 mvcc.cc:205] Tried to move back new op lower bound from 7317239434057162752 to 7317239433997668352. Current Snapshot: MvccSnapshot[applied={T|T < 7317239434057162752}]
I20260811 08:03:28.709904 17299 mvcc.cc:205] Tried to move back new op lower bound from 7317239434057162752 to 7317239433997668352. Current Snapshot: MvccSnapshot[applied={T|T < 7317239434057162752}]
I20260811 08:03:28.714942 16726 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58916:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:03:28.715413 16726 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58916:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:03:28.719022 16726 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 017badd436654c6384c2ad11d1debf3f: Sending DeleteTablet for 3 replicas of tablet 6814f7da32754091a82bb8c8e13c389e
I20260811 08:03:28.719563 16876 tablet_service.cc:1514] Processing DeleteTablet for tablet 6814f7da32754091a82bb8c8e13c389e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:03:28 UTC) from {username='kudu', principal='kudu/127.15.36.254@KRBTEST.COM'} at 127.0.0.1:37548
I20260811 08:03:28.719581 17185 tablet_service.cc:1514] Processing DeleteTablet for tablet 6814f7da32754091a82bb8c8e13c389e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:03:28 UTC) from {username='kudu', principal='kudu/127.15.36.254@KRBTEST.COM'} at 127.0.0.1:51886
I20260811 08:03:28.719645 17021 tablet_service.cc:1514] Processing DeleteTablet for tablet 6814f7da32754091a82bb8c8e13c389e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:03:28 UTC) from {username='kudu', principal='kudu/127.15.36.254@KRBTEST.COM'} at 127.0.0.1:43156
I20260811 08:03:28.719962 17308 tablet_replica.cc:330] T 6814f7da32754091a82bb8c8e13c389e P 577685d95b5649c2ad338825eddf51d5: stopping tablet replica
I20260811 08:03:28.720139 17308 raft_consensus.cc:2229] T 6814f7da32754091a82bb8c8e13c389e P 577685d95b5649c2ad338825eddf51d5 [term 1 LEADER]: Raft consensus shutting down.
I20260811 08:03:28.720352 17307 tablet_replica.cc:330] T 6814f7da32754091a82bb8c8e13c389e P 2bcca3cde237444080a71d1a7660b76a: stopping tablet replica
I20260811 08:03:28.720372 17308 raft_consensus.cc:2258] T 6814f7da32754091a82bb8c8e13c389e P 577685d95b5649c2ad338825eddf51d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:03:28.720503 17307 raft_consensus.cc:2229] T 6814f7da32754091a82bb8c8e13c389e P 2bcca3cde237444080a71d1a7660b76a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:03:28.720521 16726 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58916:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 08:03:28.720634 17307 raft_consensus.cc:2258] T 6814f7da32754091a82bb8c8e13c389e P 2bcca3cde237444080a71d1a7660b76a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 08:03:28.720713 16726 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:03:28.721226 17307 ts_tablet_manager.cc:1905] T 6814f7da32754091a82bb8c8e13c389e P 2bcca3cde237444080a71d1a7660b76a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:03:28.721693 17308 ts_tablet_manager.cc:1905] T 6814f7da32754091a82bb8c8e13c389e P 577685d95b5649c2ad338825eddf51d5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:03:28.722540 17185 tablet_service.cc:1467] Processing CreateTablet for tablet 502c160238864f72a636272d39cb0e11 (DEFAULT_TABLE table=test-table [id=18a17ed925ac489eb0af493ee938fa83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:03:28.722597 16876 tablet_service.cc:1467] Processing CreateTablet for tablet 502c160238864f72a636272d39cb0e11 (DEFAULT_TABLE table=test-table [id=18a17ed925ac489eb0af493ee938fa83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:03:28.722688 17185 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 502c160238864f72a636272d39cb0e11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:03:28.722738 16876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 502c160238864f72a636272d39cb0e11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:03:28.723058 17021 tablet_service.cc:1467] Processing CreateTablet for tablet 502c160238864f72a636272d39cb0e11 (DEFAULT_TABLE table=test-table [id=18a17ed925ac489eb0af493ee938fa83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:03:28.723203 17021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 502c160238864f72a636272d39cb0e11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:03:28.724397 17284 tablet_bootstrap.cc:492] T 502c160238864f72a636272d39cb0e11 P 577685d95b5649c2ad338825eddf51d5: Bootstrap starting.
I20260811 08:03:28.724573 17309 tablet_replica.cc:330] T 6814f7da32754091a82bb8c8e13c389e P bd902ddf2951402ca95d5433cb488703: stopping tablet replica
I20260811 08:03:28.724810 17308 ts_tablet_manager.cc:1918] T 6814f7da32754091a82bb8c8e13c389e P 577685d95b5649c2ad338825eddf51d5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:03:28.724730 17286 tablet_bootstrap.cc:492] T 502c160238864f72a636272d39cb0e11 P bd902ddf2951402ca95d5433cb488703: Bootstrap starting.
I20260811 08:03:28.725162 17309 raft_consensus.cc:2229] T 6814f7da32754091a82bb8c8e13c389e P bd902ddf2951402ca95d5433cb488703 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:03:28.725190 17284 tablet_bootstrap.cc:654] T 502c160238864f72a636272d39cb0e11 P 577685d95b5649c2ad338825eddf51d5: Neither blocks nor log segments found. Creating new log.
I20260811 08:03:28.725734 17308 log.cc:1196] T 6814f7da32754091a82bb8c8e13c389e P 577685d95b5649c2ad338825eddf51d5: Deleting WAL directory at /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/ts-2/wal/wals/6814f7da32754091a82bb8c8e13c389e
I20260811 08:03:28.726083 17308 ts_tablet_manager.cc:1939] T 6814f7da32754091a82bb8c8e13c389e P 577685d95b5649c2ad338825eddf51d5: Deleting consensus metadata
I20260811 08:03:28.726636 17309 raft_consensus.cc:2258] T 6814f7da32754091a82bb8c8e13c389e P bd902ddf2951402ca95d5433cb488703 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:03:28.726608 16712 catalog_manager.cc:4841] TS 577685d95b5649c2ad338825eddf51d5 (127.15.36.195:37707): tablet 6814f7da32754091a82bb8c8e13c389e (table test-table [id=05ecadc329dd4603b8f03ac62b9701ac]) successfully deleted
I20260811 08:03:28.727149 17283 tablet_bootstrap.cc:492] T 502c160238864f72a636272d39cb0e11 P 2bcca3cde237444080a71d1a7660b76a: Bootstrap starting.
I20260811 08:03:28.725485 17286 tablet_bootstrap.cc:654] T 502c160238864f72a636272d39cb0e11 P bd902ddf2951402ca95d5433cb488703: Neither blocks nor log segments found. Creating new log.
I20260811 08:03:28.727325 17309 ts_tablet_manager.cc:1905] T 6814f7da32754091a82bb8c8e13c389e P bd902ddf2951402ca95d5433cb488703: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:03:28.727695 17283 tablet_bootstrap.cc:654] T 502c160238864f72a636272d39cb0e11 P 2bcca3cde237444080a71d1a7660b76a: Neither blocks nor log segments found. Creating new log.
I20260811 08:03:28.728044 17284 tablet_bootstrap.cc:492] T 502c160238864f72a636272d39cb0e11 P 577685d95b5649c2ad338825eddf51d5: No bootstrap required, opened a new log
I20260811 08:03:28.728129 17284 ts_tablet_manager.cc:1397] T 502c160238864f72a636272d39cb0e11 P 577685d95b5649c2ad338825eddf51d5: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.001s
I20260811 08:03:28.728312 17284 raft_consensus.cc:348] T 502c160238864f72a636272d39cb0e11 P 577685d95b5649c2ad338825eddf51d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bcca3cde237444080a71d1a7660b76a" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 39515 } } peers { permanent_uuid: "bd902ddf2951402ca95d5433cb488703" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 36797 } } peers { permanent_uuid: "577685d95b5649c2ad338825eddf51d5" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 37707 } }
I20260811 08:03:28.728423 17284 raft_consensus.cc:374] T 502c160238864f72a636272d39cb0e11 P 577685d95b5649c2ad338825eddf51d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:03:28.728467 17284 raft_consensus.cc:729] T 502c160238864f72a636272d39cb0e11 P 577685d95b5649c2ad338825eddf51d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 577685d95b5649c2ad338825eddf51d5, State: Initialized, Role: FOLLOWER
I20260811 08:03:28.728519 17284 consensus_queue.cc:260] T 502c160238864f72a636272d39cb0e11 P 577685d95b5649c2ad338825eddf51d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bcca3cde237444080a71d1a7660b76a" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 39515 } } peers { permanent_uuid: "bd902ddf2951402ca95d5433cb488703" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 36797 } } peers { permanent_uuid: "577685d95b5649c2ad338825eddf51d5" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 37707 } }
I20260811 08:03:28.728629 17284 ts_tablet_manager.cc:1428] T 502c160238864f72a636272d39cb0e11 P 577685d95b5649c2ad338825eddf51d5: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:28.730415 17307 ts_tablet_manager.cc:1918] T 6814f7da32754091a82bb8c8e13c389e P 2bcca3cde237444080a71d1a7660b76a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:03:28.730525 17307 log.cc:1196] T 6814f7da32754091a82bb8c8e13c389e P 2bcca3cde237444080a71d1a7660b76a: Deleting WAL directory at /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/ts-0/wal/wals/6814f7da32754091a82bb8c8e13c389e
I20260811 08:03:28.730827 17307 ts_tablet_manager.cc:1939] T 6814f7da32754091a82bb8c8e13c389e P 2bcca3cde237444080a71d1a7660b76a: Deleting consensus metadata
I20260811 08:03:28.733876 16711 catalog_manager.cc:4841] TS 2bcca3cde237444080a71d1a7660b76a (127.15.36.193:39515): tablet 6814f7da32754091a82bb8c8e13c389e (table test-table [id=05ecadc329dd4603b8f03ac62b9701ac]) successfully deleted
I20260811 08:03:28.735095 17283 tablet_bootstrap.cc:492] T 502c160238864f72a636272d39cb0e11 P 2bcca3cde237444080a71d1a7660b76a: No bootstrap required, opened a new log
I20260811 08:03:28.735170 17283 ts_tablet_manager.cc:1397] T 502c160238864f72a636272d39cb0e11 P 2bcca3cde237444080a71d1a7660b76a: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.000s
I20260811 08:03:28.735342 17283 raft_consensus.cc:348] T 502c160238864f72a636272d39cb0e11 P 2bcca3cde237444080a71d1a7660b76a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bcca3cde237444080a71d1a7660b76a" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 39515 } } peers { permanent_uuid: "bd902ddf2951402ca95d5433cb488703" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 36797 } } peers { permanent_uuid: "577685d95b5649c2ad338825eddf51d5" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 37707 } }
I20260811 08:03:28.735435 17283 raft_consensus.cc:374] T 502c160238864f72a636272d39cb0e11 P 2bcca3cde237444080a71d1a7660b76a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:03:28.735455 17283 raft_consensus.cc:729] T 502c160238864f72a636272d39cb0e11 P 2bcca3cde237444080a71d1a7660b76a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bcca3cde237444080a71d1a7660b76a, State: Initialized, Role: FOLLOWER
I20260811 08:03:28.735500 17283 consensus_queue.cc:260] T 502c160238864f72a636272d39cb0e11 P 2bcca3cde237444080a71d1a7660b76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bcca3cde237444080a71d1a7660b76a" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 39515 } } peers { permanent_uuid: "bd902ddf2951402ca95d5433cb488703" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 36797 } } peers { permanent_uuid: "577685d95b5649c2ad338825eddf51d5" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 37707 } }
I20260811 08:03:28.735613 17283 ts_tablet_manager.cc:1428] T 502c160238864f72a636272d39cb0e11 P 2bcca3cde237444080a71d1a7660b76a: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:28.736060 17286 tablet_bootstrap.cc:492] T 502c160238864f72a636272d39cb0e11 P bd902ddf2951402ca95d5433cb488703: No bootstrap required, opened a new log
I20260811 08:03:28.736124 17286 ts_tablet_manager.cc:1397] T 502c160238864f72a636272d39cb0e11 P bd902ddf2951402ca95d5433cb488703: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20260811 08:03:28.736281 17286 raft_consensus.cc:348] T 502c160238864f72a636272d39cb0e11 P bd902ddf2951402ca95d5433cb488703 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bcca3cde237444080a71d1a7660b76a" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 39515 } } peers { permanent_uuid: "bd902ddf2951402ca95d5433cb488703" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 36797 } } peers { permanent_uuid: "577685d95b5649c2ad338825eddf51d5" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 37707 } }
I20260811 08:03:28.736356 17286 raft_consensus.cc:374] T 502c160238864f72a636272d39cb0e11 P bd902ddf2951402ca95d5433cb488703 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:03:28.736378 17286 raft_consensus.cc:729] T 502c160238864f72a636272d39cb0e11 P bd902ddf2951402ca95d5433cb488703 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd902ddf2951402ca95d5433cb488703, State: Initialized, Role: FOLLOWER
I20260811 08:03:28.736423 17286 consensus_queue.cc:260] T 502c160238864f72a636272d39cb0e11 P bd902ddf2951402ca95d5433cb488703 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bcca3cde237444080a71d1a7660b76a" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 39515 } } peers { permanent_uuid: "bd902ddf2951402ca95d5433cb488703" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 36797 } } peers { permanent_uuid: "577685d95b5649c2ad338825eddf51d5" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 37707 } }
I20260811 08:03:28.736511 17286 ts_tablet_manager.cc:1428] T 502c160238864f72a636272d39cb0e11 P bd902ddf2951402ca95d5433cb488703: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:28.736527 17309 ts_tablet_manager.cc:1918] T 6814f7da32754091a82bb8c8e13c389e P bd902ddf2951402ca95d5433cb488703: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:03:28.736619 17309 log.cc:1196] T 6814f7da32754091a82bb8c8e13c389e P bd902ddf2951402ca95d5433cb488703: Deleting WAL directory at /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/ts-1/wal/wals/6814f7da32754091a82bb8c8e13c389e
I20260811 08:03:28.736958 17309 ts_tablet_manager.cc:1939] T 6814f7da32754091a82bb8c8e13c389e P bd902ddf2951402ca95d5433cb488703: Deleting consensus metadata
I20260811 08:03:28.739064 16712 catalog_manager.cc:4841] TS bd902ddf2951402ca95d5433cb488703 (127.15.36.194:36797): tablet 6814f7da32754091a82bb8c8e13c389e (table test-table [id=05ecadc329dd4603b8f03ac62b9701ac]) successfully deleted
W20260811 08:03:28.965461 17100 tablet.cc:2369] T 502c160238864f72a636272d39cb0e11 P bd902ddf2951402ca95d5433cb488703: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 08:03:28.983127 16949 tablet.cc:2369] T 502c160238864f72a636272d39cb0e11 P 2bcca3cde237444080a71d1a7660b76a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:03:28.993949 17290 raft_consensus.cc:482] T 502c160238864f72a636272d39cb0e11 P 2bcca3cde237444080a71d1a7660b76a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:03:28.994342 17290 raft_consensus.cc:504] T 502c160238864f72a636272d39cb0e11 P 2bcca3cde237444080a71d1a7660b76a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bcca3cde237444080a71d1a7660b76a" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 39515 } } peers { permanent_uuid: "bd902ddf2951402ca95d5433cb488703" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 36797 } } peers { permanent_uuid: "577685d95b5649c2ad338825eddf51d5" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 37707 } }
I20260811 08:03:28.995096 17290 leader_election.cc:288] T 502c160238864f72a636272d39cb0e11 P 2bcca3cde237444080a71d1a7660b76a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd902ddf2951402ca95d5433cb488703 (127.15.36.194:36797), 577685d95b5649c2ad338825eddf51d5 (127.15.36.195:37707)
I20260811 08:03:29.000550 17278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:28.996168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:54493 (local address 127.15.36.195:37707)
0811 08:03:28.996229 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:28.996231 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:28.996240 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:03:28.996267 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:28.996268 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:28.996279 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:28.996343 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:03:28.996827 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:28.998153 (+ 1326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:28.999490 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:29.000099 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:29.000171 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:29.000179 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:29.000448 (+ 269us) server_negotiation.cc:299] Negotiation successful
0811 08:03:29.000492 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 08:03:29.000658 17314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:28.995492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.195:37707 (local address 127.15.36.193:54493)
0811 08:03:28.995815 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:28.995830 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:28.996111 (+ 281us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:28.996372 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:28.996373 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:28.996376 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:03:28.996689 (+ 313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:28.996692 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:28.998357 (+ 1665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:28.998358 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:28.999336 (+ 978us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:28.999339 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:29.000213 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:29.000215 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:29.000308 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:29.000314 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 08:03:29.000395 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 08:03:29.000444 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"mutex_wait_us":135,"thread_start_us":103,"threads_started":1}
I20260811 08:03:29.001010 17207 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "502c160238864f72a636272d39cb0e11" candidate_uuid: "2bcca3cde237444080a71d1a7660b76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "577685d95b5649c2ad338825eddf51d5" is_pre_election: true
I20260811 08:03:29.001318 17207 raft_consensus.cc:2454] T 502c160238864f72a636272d39cb0e11 P 577685d95b5649c2ad338825eddf51d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bcca3cde237444080a71d1a7660b76a in term 0.
I20260811 08:03:29.001432 17313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:28.995331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.194:36797 (local address 127.15.36.193:36181)
0811 08:03:28.995487 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:28.995500 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:28.995565 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:28.996262 (+ 697us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:28.996264 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:28.996267 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:03:28.996424 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:28.996426 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:28.998177 (+ 1751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:28.998178 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:28.999990 (+ 1812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:28.999994 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:29.001030 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:29.001032 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:29.001207 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:29.001212 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 08:03:29.001287 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 08:03:29.001337 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"mutex_wait_us":280,"thread_start_us":57,"threads_started":1}
I20260811 08:03:29.001488 17280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:28.995562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:36181 (local address 127.15.36.194:36797)
0811 08:03:28.995649 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:28.995652 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:28.995728 (+ 76us) server_negotiation.cc:407] Connection header received
0811 08:03:28.995843 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:28.995845 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:28.995856 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:28.996136 (+ 280us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:03:28.996646 (+ 510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:28.997872 (+ 1226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:29.000186 (+ 2314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:29.000866 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:29.000954 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:29.000965 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:29.001350 (+ 385us) server_negotiation.cc:299] Negotiation successful
0811 08:03:29.001406 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 08:03:29.001652 16826 leader_election.cc:302] T 502c160238864f72a636272d39cb0e11 P 2bcca3cde237444080a71d1a7660b76a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bcca3cde237444080a71d1a7660b76a, 577685d95b5649c2ad338825eddf51d5; no voters:
I20260811 08:03:29.001798 17290 raft_consensus.cc:2781] T 502c160238864f72a636272d39cb0e11 P 2bcca3cde237444080a71d1a7660b76a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:03:29.001871 17290 raft_consensus.cc:482] T 502c160238864f72a636272d39cb0e11 P 2bcca3cde237444080a71d1a7660b76a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:03:29.001909 17290 raft_consensus.cc:3037] T 502c160238864f72a636272d39cb0e11 P 2bcca3cde237444080a71d1a7660b76a [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:03:29.002030 17048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "502c160238864f72a636272d39cb0e11" candidate_uuid: "2bcca3cde237444080a71d1a7660b76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd902ddf2951402ca95d5433cb488703" is_pre_election: true
I20260811 08:03:29.002144 17048 raft_consensus.cc:2454] T 502c160238864f72a636272d39cb0e11 P bd902ddf2951402ca95d5433cb488703 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bcca3cde237444080a71d1a7660b76a in term 0.
I20260811 08:03:29.003106 17290 raft_consensus.cc:504] T 502c160238864f72a636272d39cb0e11 P 2bcca3cde237444080a71d1a7660b76a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bcca3cde237444080a71d1a7660b76a" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 39515 } } peers { permanent_uuid: "bd902ddf2951402ca95d5433cb488703" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 36797 } } peers { permanent_uuid: "577685d95b5649c2ad338825eddf51d5" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 37707 } }
I20260811 08:03:29.003247 17290 leader_election.cc:288] T 502c160238864f72a636272d39cb0e11 P 2bcca3cde237444080a71d1a7660b76a [CANDIDATE]: Term 1 election: Requested vote from peers bd902ddf2951402ca95d5433cb488703 (127.15.36.194:36797), 577685d95b5649c2ad338825eddf51d5 (127.15.36.195:37707)
I20260811 08:03:29.003640 17048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "502c160238864f72a636272d39cb0e11" candidate_uuid: "2bcca3cde237444080a71d1a7660b76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd902ddf2951402ca95d5433cb488703"
I20260811 08:03:29.003759 17048 raft_consensus.cc:3037] T 502c160238864f72a636272d39cb0e11 P bd902ddf2951402ca95d5433cb488703 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:03:29.003813 17207 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "502c160238864f72a636272d39cb0e11" candidate_uuid: "2bcca3cde237444080a71d1a7660b76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "577685d95b5649c2ad338825eddf51d5"
I20260811 08:03:29.003955 17207 raft_consensus.cc:3037] T 502c160238864f72a636272d39cb0e11 P 577685d95b5649c2ad338825eddf51d5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:03:29.004642 17048 raft_consensus.cc:2454] T 502c160238864f72a636272d39cb0e11 P bd902ddf2951402ca95d5433cb488703 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bcca3cde237444080a71d1a7660b76a in term 1.
I20260811 08:03:29.004743 17207 raft_consensus.cc:2454] T 502c160238864f72a636272d39cb0e11 P 577685d95b5649c2ad338825eddf51d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bcca3cde237444080a71d1a7660b76a in term 1.
I20260811 08:03:29.005101 16826 leader_election.cc:302] T 502c160238864f72a636272d39cb0e11 P 2bcca3cde237444080a71d1a7660b76a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bcca3cde237444080a71d1a7660b76a, 577685d95b5649c2ad338825eddf51d5; no voters:
I20260811 08:03:29.005261 17290 raft_consensus.cc:2781] T 502c160238864f72a636272d39cb0e11 P 2bcca3cde237444080a71d1a7660b76a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:03:29.005509 17290 raft_consensus.cc:686] T 502c160238864f72a636272d39cb0e11 P 2bcca3cde237444080a71d1a7660b76a [term 1 LEADER]: Becoming Leader. State: Replica: 2bcca3cde237444080a71d1a7660b76a, State: Running, Role: LEADER
I20260811 08:03:29.005578 17290 consensus_queue.cc:237] T 502c160238864f72a636272d39cb0e11 P 2bcca3cde237444080a71d1a7660b76a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bcca3cde237444080a71d1a7660b76a" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 39515 } } peers { permanent_uuid: "bd902ddf2951402ca95d5433cb488703" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 36797 } } peers { permanent_uuid: "577685d95b5649c2ad338825eddf51d5" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 37707 } }
I20260811 08:03:29.006659 16726 catalog_manager.cc:5495] T 502c160238864f72a636272d39cb0e11 P 2bcca3cde237444080a71d1a7660b76a reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bcca3cde237444080a71d1a7660b76a (127.15.36.193). New cstate: current_term: 1 leader_uuid: "2bcca3cde237444080a71d1a7660b76a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bcca3cde237444080a71d1a7660b76a" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd902ddf2951402ca95d5433cb488703" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 36797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "577685d95b5649c2ad338825eddf51d5" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 37707 } health_report { overall_health: UNKNOWN } } }
Aug 11 08:03:29 dist-test-slave-2w3w krb5kdc[16678](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435407, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.254@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:03:29.043059 17324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:29.032019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:34345 (local address 127.0.0.1:58918)
0811 08:03:29.032334 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:29.032347 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:29.032446 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:29.032638 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:29.032639 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:29.033162 (+ 523us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:03:29.033433 (+ 271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:29.033436 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:29.034946 (+ 1510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:29.034948 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:29.035684 (+ 736us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:29.035690 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:29.036476 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:29.036477 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:29.036536 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:29.037202 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:03:29.037207 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:03:29.039350 (+ 2143us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:03:29.041531 (+ 2181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:29.041542 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:29.041545 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:29.041806 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:29.042146 (+ 340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:29.042146 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:29.042147 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:29.042204 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:29.042606 (+ 402us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:03:29.042616 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:03:29.042674 (+ 58us) client_negotiation.cc:769] Sending connection context
0811 08:03:29.042745 (+ 71us) client_negotiation.cc:240] Negotiation successful
0811 08:03:29.042873 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":207,"threads_started":1}
I20260811 08:03:29.043140 17325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:29.032310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58918 (local address 127.15.36.254:34345)
0811 08:03:29.032505 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:29.032507 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:29.032514 (+ 7us) server_negotiation.cc:407] Connection header received
0811 08:03:29.032543 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:29.032544 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:29.032552 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:29.032634 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:29.033561 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:29.034700 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:29.035887 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:29.036355 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:29.036475 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:29.039507 (+ 3032us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:29.039508 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:29.039509 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:29.039517 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:29.041365 (+ 1848us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:29.041945 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:29.041946 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:29.041946 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:29.042016 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:29.042326 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:29.042327 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:29.042327 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:29.042472 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:29.042534 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:29.042817 (+ 283us) server_negotiation.cc:299] Negotiation successful
0811 08:03:29.042941 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":30,"server-negotiator.queue_time_us":167,"thread_start_us":92,"threads_started":1}
I20260811 08:03:29.046205 16726 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.15.36.254@KRBTEST.COM'} at 127.0.0.1:58918:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 08:03:29.046478 16726 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:03:29.048282 17021 tablet_service.cc:1467] Processing CreateTablet for tablet 0a150057f68245dbbfe0b38cd0f1a0ff (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=9534c48831bc40b8909df19ccb5b883b]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 08:03:29.048272 16876 tablet_service.cc:1467] Processing CreateTablet for tablet 0a150057f68245dbbfe0b38cd0f1a0ff (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=9534c48831bc40b8909df19ccb5b883b]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 08:03:29.048339 17185 tablet_service.cc:1467] Processing CreateTablet for tablet 0a150057f68245dbbfe0b38cd0f1a0ff (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=9534c48831bc40b8909df19ccb5b883b]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 08:03:29.048463 16876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a150057f68245dbbfe0b38cd0f1a0ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:03:29.048465 17021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a150057f68245dbbfe0b38cd0f1a0ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:03:29.048516 17185 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a150057f68245dbbfe0b38cd0f1a0ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:03:29.050601 17283 tablet_bootstrap.cc:492] T 0a150057f68245dbbfe0b38cd0f1a0ff P 2bcca3cde237444080a71d1a7660b76a: Bootstrap starting.
I20260811 08:03:29.051488 17283 tablet_bootstrap.cc:654] T 0a150057f68245dbbfe0b38cd0f1a0ff P 2bcca3cde237444080a71d1a7660b76a: Neither blocks nor log segments found. Creating new log.
I20260811 08:03:29.052975 17283 tablet_bootstrap.cc:492] T 0a150057f68245dbbfe0b38cd0f1a0ff P 2bcca3cde237444080a71d1a7660b76a: No bootstrap required, opened a new log
I20260811 08:03:29.053282 17283 ts_tablet_manager.cc:1397] T 0a150057f68245dbbfe0b38cd0f1a0ff P 2bcca3cde237444080a71d1a7660b76a: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260811 08:03:29.053476 17283 raft_consensus.cc:348] T 0a150057f68245dbbfe0b38cd0f1a0ff P 2bcca3cde237444080a71d1a7660b76a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bcca3cde237444080a71d1a7660b76a" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 39515 } } peers { permanent_uuid: "bd902ddf2951402ca95d5433cb488703" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 36797 } } peers { permanent_uuid: "577685d95b5649c2ad338825eddf51d5" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 37707 } }
I20260811 08:03:29.053609 17283 raft_consensus.cc:374] T 0a150057f68245dbbfe0b38cd0f1a0ff P 2bcca3cde237444080a71d1a7660b76a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:03:29.053637 17283 raft_consensus.cc:729] T 0a150057f68245dbbfe0b38cd0f1a0ff P 2bcca3cde237444080a71d1a7660b76a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bcca3cde237444080a71d1a7660b76a, State: Initialized, Role: FOLLOWER
I20260811 08:03:29.053624 17284 tablet_bootstrap.cc:492] T 0a150057f68245dbbfe0b38cd0f1a0ff P 577685d95b5649c2ad338825eddf51d5: Bootstrap starting.
I20260811 08:03:29.053682 17283 consensus_queue.cc:260] T 0a150057f68245dbbfe0b38cd0f1a0ff P 2bcca3cde237444080a71d1a7660b76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bcca3cde237444080a71d1a7660b76a" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 39515 } } peers { permanent_uuid: "bd902ddf2951402ca95d5433cb488703" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 36797 } } peers { permanent_uuid: "577685d95b5649c2ad338825eddf51d5" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 37707 } }
I20260811 08:03:29.053772 17283 ts_tablet_manager.cc:1428] T 0a150057f68245dbbfe0b38cd0f1a0ff P 2bcca3cde237444080a71d1a7660b76a: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 08:03:29.053884 17286 tablet_bootstrap.cc:492] T 0a150057f68245dbbfe0b38cd0f1a0ff P bd902ddf2951402ca95d5433cb488703: Bootstrap starting.
I20260811 08:03:29.054525 17284 tablet_bootstrap.cc:654] T 0a150057f68245dbbfe0b38cd0f1a0ff P 577685d95b5649c2ad338825eddf51d5: Neither blocks nor log segments found. Creating new log.
I20260811 08:03:29.054632 17286 tablet_bootstrap.cc:654] T 0a150057f68245dbbfe0b38cd0f1a0ff P bd902ddf2951402ca95d5433cb488703: Neither blocks nor log segments found. Creating new log.
I20260811 08:03:29.055325 17290 tablet_replica.cc:439] T 0a150057f68245dbbfe0b38cd0f1a0ff P 2bcca3cde237444080a71d1a7660b76a: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bcca3cde237444080a71d1a7660b76a" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 39515 } } peers { permanent_uuid: "bd902ddf2951402ca95d5433cb488703" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 36797 } } peers { permanent_uuid: "577685d95b5649c2ad338825eddf51d5" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 37707 } } }
I20260811 08:03:29.055466 17290 tablet_replica.cc:442] T 0a150057f68245dbbfe0b38cd0f1a0ff P 2bcca3cde237444080a71d1a7660b76a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 08:03:29.055752 17284 tablet_bootstrap.cc:492] T 0a150057f68245dbbfe0b38cd0f1a0ff P 577685d95b5649c2ad338825eddf51d5: No bootstrap required, opened a new log
I20260811 08:03:29.055815 17284 ts_tablet_manager.cc:1397] T 0a150057f68245dbbfe0b38cd0f1a0ff P 577685d95b5649c2ad338825eddf51d5: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260811 08:03:29.055961 17286 tablet_bootstrap.cc:492] T 0a150057f68245dbbfe0b38cd0f1a0ff P bd902ddf2951402ca95d5433cb488703: No bootstrap required, opened a new log
I20260811 08:03:29.056016 17286 ts_tablet_manager.cc:1397] T 0a150057f68245dbbfe0b38cd0f1a0ff P bd902ddf2951402ca95d5433cb488703: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260811 08:03:29.055987 17284 raft_consensus.cc:348] T 0a150057f68245dbbfe0b38cd0f1a0ff P 577685d95b5649c2ad338825eddf51d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bcca3cde237444080a71d1a7660b76a" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 39515 } } peers { permanent_uuid: "bd902ddf2951402ca95d5433cb488703" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 36797 } } peers { permanent_uuid: "577685d95b5649c2ad338825eddf51d5" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 37707 } }
I20260811 08:03:29.056049 17284 raft_consensus.cc:374] T 0a150057f68245dbbfe0b38cd0f1a0ff P 577685d95b5649c2ad338825eddf51d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:03:29.056064 17284 raft_consensus.cc:729] T 0a150057f68245dbbfe0b38cd0f1a0ff P 577685d95b5649c2ad338825eddf51d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 577685d95b5649c2ad338825eddf51d5, State: Initialized, Role: FOLLOWER
I20260811 08:03:29.056106 17284 consensus_queue.cc:260] T 0a150057f68245dbbfe0b38cd0f1a0ff P 577685d95b5649c2ad338825eddf51d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bcca3cde237444080a71d1a7660b76a" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 39515 } } peers { permanent_uuid: "bd902ddf2951402ca95d5433cb488703" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 36797 } } peers { permanent_uuid: "577685d95b5649c2ad338825eddf51d5" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 37707 } }
I20260811 08:03:29.056226 17284 ts_tablet_manager.cc:1428] T 0a150057f68245dbbfe0b38cd0f1a0ff P 577685d95b5649c2ad338825eddf51d5: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 08:03:29.056242 17303 tablet_replica.cc:439] T 0a150057f68245dbbfe0b38cd0f1a0ff P 577685d95b5649c2ad338825eddf51d5: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bcca3cde237444080a71d1a7660b76a" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 39515 } } peers { permanent_uuid: "bd902ddf2951402ca95d5433cb488703" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 36797 } } peers { permanent_uuid: "577685d95b5649c2ad338825eddf51d5" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 37707 } } }
I20260811 08:03:29.056339 17303 tablet_replica.cc:442] T 0a150057f68245dbbfe0b38cd0f1a0ff P 577685d95b5649c2ad338825eddf51d5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 08:03:29.056308 17286 raft_consensus.cc:348] T 0a150057f68245dbbfe0b38cd0f1a0ff P bd902ddf2951402ca95d5433cb488703 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bcca3cde237444080a71d1a7660b76a" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 39515 } } peers { permanent_uuid: "bd902ddf2951402ca95d5433cb488703" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 36797 } } peers { permanent_uuid: "577685d95b5649c2ad338825eddf51d5" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 37707 } }
I20260811 08:03:29.056440 17286 raft_consensus.cc:374] T 0a150057f68245dbbfe0b38cd0f1a0ff P bd902ddf2951402ca95d5433cb488703 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:03:29.056519 17286 raft_consensus.cc:729] T 0a150057f68245dbbfe0b38cd0f1a0ff P bd902ddf2951402ca95d5433cb488703 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd902ddf2951402ca95d5433cb488703, State: Initialized, Role: FOLLOWER
I20260811 08:03:29.056597 17286 consensus_queue.cc:260] T 0a150057f68245dbbfe0b38cd0f1a0ff P bd902ddf2951402ca95d5433cb488703 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bcca3cde237444080a71d1a7660b76a" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 39515 } } peers { permanent_uuid: "bd902ddf2951402ca95d5433cb488703" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 36797 } } peers { permanent_uuid: "577685d95b5649c2ad338825eddf51d5" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 37707 } }
I20260811 08:03:29.056715 17286 ts_tablet_manager.cc:1428] T 0a150057f68245dbbfe0b38cd0f1a0ff P bd902ddf2951402ca95d5433cb488703: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260811 08:03:29.056798 17291 tablet_replica.cc:439] T 0a150057f68245dbbfe0b38cd0f1a0ff P bd902ddf2951402ca95d5433cb488703: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bcca3cde237444080a71d1a7660b76a" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 39515 } } peers { permanent_uuid: "bd902ddf2951402ca95d5433cb488703" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 36797 } } peers { permanent_uuid: "577685d95b5649c2ad338825eddf51d5" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 37707 } } }
I20260811 08:03:29.056908 17291 tablet_replica.cc:442] T 0a150057f68245dbbfe0b38cd0f1a0ff P bd902ddf2951402ca95d5433cb488703: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 08:03:29.096546 17303 raft_consensus.cc:482] T 0a150057f68245dbbfe0b38cd0f1a0ff P 577685d95b5649c2ad338825eddf51d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:03:29.096706 17303 raft_consensus.cc:504] T 0a150057f68245dbbfe0b38cd0f1a0ff P 577685d95b5649c2ad338825eddf51d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bcca3cde237444080a71d1a7660b76a" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 39515 } } peers { permanent_uuid: "bd902ddf2951402ca95d5433cb488703" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 36797 } } peers { permanent_uuid: "577685d95b5649c2ad338825eddf51d5" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 37707 } }
I20260811 08:03:29.097157 17303 leader_election.cc:288] T 0a150057f68245dbbfe0b38cd0f1a0ff P 577685d95b5649c2ad338825eddf51d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bcca3cde237444080a71d1a7660b76a (127.15.36.193:39515), bd902ddf2951402ca95d5433cb488703 (127.15.36.194:36797)
I20260811 08:03:29.097486 16897 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a150057f68245dbbfe0b38cd0f1a0ff" candidate_uuid: "577685d95b5649c2ad338825eddf51d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bcca3cde237444080a71d1a7660b76a" is_pre_election: true
I20260811 08:03:29.097532 17048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a150057f68245dbbfe0b38cd0f1a0ff" candidate_uuid: "577685d95b5649c2ad338825eddf51d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd902ddf2951402ca95d5433cb488703" is_pre_election: true
I20260811 08:03:29.097731 17048 raft_consensus.cc:2454] T 0a150057f68245dbbfe0b38cd0f1a0ff P bd902ddf2951402ca95d5433cb488703 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 577685d95b5649c2ad338825eddf51d5 in term 0.
I20260811 08:03:29.097630 16897 raft_consensus.cc:2454] T 0a150057f68245dbbfe0b38cd0f1a0ff P 2bcca3cde237444080a71d1a7660b76a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 577685d95b5649c2ad338825eddf51d5 in term 0.
I20260811 08:03:29.098173 17127 leader_election.cc:302] T 0a150057f68245dbbfe0b38cd0f1a0ff P 577685d95b5649c2ad338825eddf51d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bcca3cde237444080a71d1a7660b76a, 577685d95b5649c2ad338825eddf51d5; no voters:
I20260811 08:03:29.098297 17303 raft_consensus.cc:2781] T 0a150057f68245dbbfe0b38cd0f1a0ff P 577685d95b5649c2ad338825eddf51d5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:03:29.098340 17303 raft_consensus.cc:482] T 0a150057f68245dbbfe0b38cd0f1a0ff P 577685d95b5649c2ad338825eddf51d5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:03:29.098366 17303 raft_consensus.cc:3037] T 0a150057f68245dbbfe0b38cd0f1a0ff P 577685d95b5649c2ad338825eddf51d5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:03:29.131258 17303 raft_consensus.cc:504] T 0a150057f68245dbbfe0b38cd0f1a0ff P 577685d95b5649c2ad338825eddf51d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bcca3cde237444080a71d1a7660b76a" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 39515 } } peers { permanent_uuid: "bd902ddf2951402ca95d5433cb488703" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 36797 } } peers { permanent_uuid: "577685d95b5649c2ad338825eddf51d5" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 37707 } }
I20260811 08:03:29.131811 17303 leader_election.cc:288] T 0a150057f68245dbbfe0b38cd0f1a0ff P 577685d95b5649c2ad338825eddf51d5 [CANDIDATE]: Term 1 election: Requested vote from peers 2bcca3cde237444080a71d1a7660b76a (127.15.36.193:39515), bd902ddf2951402ca95d5433cb488703 (127.15.36.194:36797)
I20260811 08:03:29.132098 17048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a150057f68245dbbfe0b38cd0f1a0ff" candidate_uuid: "577685d95b5649c2ad338825eddf51d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd902ddf2951402ca95d5433cb488703"
I20260811 08:03:29.132215 17048 raft_consensus.cc:3037] T 0a150057f68245dbbfe0b38cd0f1a0ff P bd902ddf2951402ca95d5433cb488703 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:03:29.132452 16897 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a150057f68245dbbfe0b38cd0f1a0ff" candidate_uuid: "577685d95b5649c2ad338825eddf51d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bcca3cde237444080a71d1a7660b76a"
I20260811 08:03:29.132558 16897 raft_consensus.cc:3037] T 0a150057f68245dbbfe0b38cd0f1a0ff P 2bcca3cde237444080a71d1a7660b76a [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:03:29.134696 17048 raft_consensus.cc:2454] T 0a150057f68245dbbfe0b38cd0f1a0ff P bd902ddf2951402ca95d5433cb488703 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 577685d95b5649c2ad338825eddf51d5 in term 1.
I20260811 08:03:29.134820 16897 raft_consensus.cc:2454] T 0a150057f68245dbbfe0b38cd0f1a0ff P 2bcca3cde237444080a71d1a7660b76a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 577685d95b5649c2ad338825eddf51d5 in term 1.
I20260811 08:03:29.135214 17129 leader_election.cc:302] T 0a150057f68245dbbfe0b38cd0f1a0ff P 577685d95b5649c2ad338825eddf51d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 577685d95b5649c2ad338825eddf51d5, bd902ddf2951402ca95d5433cb488703; no voters:
I20260811 08:03:29.135394 17303 raft_consensus.cc:2781] T 0a150057f68245dbbfe0b38cd0f1a0ff P 577685d95b5649c2ad338825eddf51d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:03:29.135586 17303 raft_consensus.cc:686] T 0a150057f68245dbbfe0b38cd0f1a0ff P 577685d95b5649c2ad338825eddf51d5 [term 1 LEADER]: Becoming Leader. State: Replica: 577685d95b5649c2ad338825eddf51d5, State: Running, Role: LEADER
I20260811 08:03:29.135838 17303 consensus_queue.cc:237] T 0a150057f68245dbbfe0b38cd0f1a0ff P 577685d95b5649c2ad338825eddf51d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bcca3cde237444080a71d1a7660b76a" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 39515 } } peers { permanent_uuid: "bd902ddf2951402ca95d5433cb488703" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 36797 } } peers { permanent_uuid: "577685d95b5649c2ad338825eddf51d5" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 37707 } }
I20260811 08:03:29.136237 17289 tablet_replica.cc:439] T 0a150057f68245dbbfe0b38cd0f1a0ff P 577685d95b5649c2ad338825eddf51d5: TxnStatusTablet state changed. Reason: New leader 577685d95b5649c2ad338825eddf51d5. Latest consensus state: current_term: 1 leader_uuid: "577685d95b5649c2ad338825eddf51d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bcca3cde237444080a71d1a7660b76a" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 39515 } } peers { permanent_uuid: "bd902ddf2951402ca95d5433cb488703" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 36797 } } peers { permanent_uuid: "577685d95b5649c2ad338825eddf51d5" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 37707 } } }
I20260811 08:03:29.136780 17289 tablet_replica.cc:442] T 0a150057f68245dbbfe0b38cd0f1a0ff P 577685d95b5649c2ad338825eddf51d5: This TxnStatusTablet replica's current role is: LEADER
I20260811 08:03:29.136981 17330 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 08:03:29.137292 17330 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 08:03:29.137267 16727 catalog_manager.cc:5495] T 0a150057f68245dbbfe0b38cd0f1a0ff P 577685d95b5649c2ad338825eddf51d5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 577685d95b5649c2ad338825eddf51d5 (127.15.36.195). New cstate: current_term: 1 leader_uuid: "577685d95b5649c2ad338825eddf51d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bcca3cde237444080a71d1a7660b76a" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd902ddf2951402ca95d5433cb488703" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 36797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "577685d95b5649c2ad338825eddf51d5" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 37707 } health_report { overall_health: HEALTHY } } }
I20260811 08:03:29.159061 17278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:29.155256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51900 (local address 127.15.36.195:37707)
0811 08:03:29.155329 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:29.155331 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:29.155492 (+ 161us) server_negotiation.cc:407] Connection header received
0811 08:03:29.155526 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:29.155527 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:29.155538 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:29.155605 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:03:29.155843 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:29.156517 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:29.157669 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:29.157868 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:29.157962 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:29.158374 (+ 412us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:03:29.158663 (+ 289us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:03:29.158716 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:29.158852 (+ 136us) server_negotiation.cc:299] Negotiation successful
0811 08:03:29.158909 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 08:03:29.159083 17324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:29.155179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.195:37707 (local address 127.0.0.1:51900)
0811 08:03:29.155348 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:29.155362 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:29.155436 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:29.155631 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:29.155633 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:29.155634 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 08:03:29.155709 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:29.155712 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:29.156618 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:29.156619 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:29.157552 (+ 933us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:29.157555 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:29.157987 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:29.157988 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:29.158063 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:29.158090 (+ 27us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 08:03:29.158764 (+ 674us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 08:03:29.158780 (+ 16us) client_negotiation.cc:769] Sending connection context
0811 08:03:29.158848 (+ 68us) client_negotiation.cc:240] Negotiation successful
0811 08:03:29.158940 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115}
I20260811 08:03:29.160523 16897 raft_consensus.cc:1261] T 0a150057f68245dbbfe0b38cd0f1a0ff P 2bcca3cde237444080a71d1a7660b76a [term 1 FOLLOWER]: Refusing update from remote peer 577685d95b5649c2ad338825eddf51d5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:03:29.160567 17048 raft_consensus.cc:1261] T 0a150057f68245dbbfe0b38cd0f1a0ff P bd902ddf2951402ca95d5433cb488703 [term 1 FOLLOWER]: Refusing update from remote peer 577685d95b5649c2ad338825eddf51d5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:03:29.160815 17289 consensus_queue.cc:1035] T 0a150057f68245dbbfe0b38cd0f1a0ff P 577685d95b5649c2ad338825eddf51d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bcca3cde237444080a71d1a7660b76a" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:03:29.160960 17303 consensus_queue.cc:1035] T 0a150057f68245dbbfe0b38cd0f1a0ff P 577685d95b5649c2ad338825eddf51d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd902ddf2951402ca95d5433cb488703" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:03:29.161520 17290 tablet_replica.cc:439] T 0a150057f68245dbbfe0b38cd0f1a0ff P 2bcca3cde237444080a71d1a7660b76a: TxnStatusTablet state changed. Reason: New leader 577685d95b5649c2ad338825eddf51d5. Latest consensus state: current_term: 1 leader_uuid: "577685d95b5649c2ad338825eddf51d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bcca3cde237444080a71d1a7660b76a" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 39515 } } peers { permanent_uuid: "bd902ddf2951402ca95d5433cb488703" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 36797 } } peers { permanent_uuid: "577685d95b5649c2ad338825eddf51d5" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 37707 } } }
I20260811 08:03:29.161621 17290 tablet_replica.cc:442] T 0a150057f68245dbbfe0b38cd0f1a0ff P 2bcca3cde237444080a71d1a7660b76a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 08:03:29.161999 17291 tablet_replica.cc:439] T 0a150057f68245dbbfe0b38cd0f1a0ff P bd902ddf2951402ca95d5433cb488703: TxnStatusTablet state changed. Reason: New leader 577685d95b5649c2ad338825eddf51d5. Latest consensus state: current_term: 1 leader_uuid: "577685d95b5649c2ad338825eddf51d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bcca3cde237444080a71d1a7660b76a" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 39515 } } peers { permanent_uuid: "bd902ddf2951402ca95d5433cb488703" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 36797 } } peers { permanent_uuid: "577685d95b5649c2ad338825eddf51d5" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 37707 } } }
I20260811 08:03:29.162113 17291 tablet_replica.cc:442] T 0a150057f68245dbbfe0b38cd0f1a0ff P bd902ddf2951402ca95d5433cb488703: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 08:03:29.162554 17303 tablet_replica.cc:439] T 0a150057f68245dbbfe0b38cd0f1a0ff P 577685d95b5649c2ad338825eddf51d5: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "577685d95b5649c2ad338825eddf51d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bcca3cde237444080a71d1a7660b76a" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 39515 } } peers { permanent_uuid: "bd902ddf2951402ca95d5433cb488703" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 36797 } } peers { permanent_uuid: "577685d95b5649c2ad338825eddf51d5" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 37707 } } }
I20260811 08:03:29.162653 17303 tablet_replica.cc:442] T 0a150057f68245dbbfe0b38cd0f1a0ff P 577685d95b5649c2ad338825eddf51d5: This TxnStatusTablet replica's current role is: LEADER
I20260811 08:03:29.163249 17290 tablet_replica.cc:439] T 0a150057f68245dbbfe0b38cd0f1a0ff P 2bcca3cde237444080a71d1a7660b76a: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "577685d95b5649c2ad338825eddf51d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bcca3cde237444080a71d1a7660b76a" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 39515 } } peers { permanent_uuid: "bd902ddf2951402ca95d5433cb488703" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 36797 } } peers { permanent_uuid: "577685d95b5649c2ad338825eddf51d5" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 37707 } } }
I20260811 08:03:29.163367 17290 tablet_replica.cc:442] T 0a150057f68245dbbfe0b38cd0f1a0ff P 2bcca3cde237444080a71d1a7660b76a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 08:03:29.163583 17293 tablet_replica.cc:439] T 0a150057f68245dbbfe0b38cd0f1a0ff P 577685d95b5649c2ad338825eddf51d5: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "577685d95b5649c2ad338825eddf51d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bcca3cde237444080a71d1a7660b76a" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 39515 } } peers { permanent_uuid: "bd902ddf2951402ca95d5433cb488703" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 36797 } } peers { permanent_uuid: "577685d95b5649c2ad338825eddf51d5" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 37707 } } }
I20260811 08:03:29.163676 17293 tablet_replica.cc:442] T 0a150057f68245dbbfe0b38cd0f1a0ff P 577685d95b5649c2ad338825eddf51d5: This TxnStatusTablet replica's current role is: LEADER
I20260811 08:03:29.164700 17298 mvcc.cc:205] Tried to move back new op lower bound from 7317239435919638528 to 7317239435821178880. Current Snapshot: MvccSnapshot[applied={T|T < 7317239435919638528}]
I20260811 08:03:29.164868 17291 tablet_replica.cc:439] T 0a150057f68245dbbfe0b38cd0f1a0ff P bd902ddf2951402ca95d5433cb488703: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "577685d95b5649c2ad338825eddf51d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bcca3cde237444080a71d1a7660b76a" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 39515 } } peers { permanent_uuid: "bd902ddf2951402ca95d5433cb488703" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 36797 } } peers { permanent_uuid: "577685d95b5649c2ad338825eddf51d5" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 37707 } } }
I20260811 08:03:29.164975 17291 tablet_replica.cc:442] T 0a150057f68245dbbfe0b38cd0f1a0ff P bd902ddf2951402ca95d5433cb488703: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 08:03:29.169176 17279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:29.165672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37562 (local address 127.15.36.193:39515)
0811 08:03:29.165755 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:29.165757 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:29.165769 (+ 12us) server_negotiation.cc:407] Connection header received
0811 08:03:29.165816 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:29.165818 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:29.165844 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:29.165943 (+ 99us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:03:29.166085 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:29.167008 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:29.167884 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:29.168237 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:29.168328 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:29.168541 (+ 213us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:03:29.168708 (+ 167us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:03:29.168800 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:29.169019 (+ 219us) server_negotiation.cc:299] Negotiation successful
0811 08:03:29.169051 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 08:03:29.181268 17278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:29.177883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:35103 (local address 127.15.36.195:37707)
0811 08:03:29.177937 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:29.177939 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:29.178123 (+ 184us) server_negotiation.cc:407] Connection header received
0811 08:03:29.178200 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:29.178201 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:29.178213 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:29.178270 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:03:29.178462 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:29.178952 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:29.180454 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:29.180663 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:29.180742 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:29.180962 (+ 220us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:03:29.181006 (+ 44us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:03:29.181072 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:29.181136 (+ 64us) server_negotiation.cc:299] Negotiation successful
0811 08:03:29.181161 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 08:03:29.181509 17337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:29.177763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.195:37707 (local address 127.15.36.193:35103)
0811 08:03:29.178035 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:29.178045 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:29.178131 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:29.178306 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:29.178307 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:29.178309 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 08:03:29.178384 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:29.178386 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:29.179201 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:29.179203 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:29.180183 (+ 980us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:29.180192 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:29.180767 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:29.180768 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:29.180840 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:29.180866 (+ 26us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 08:03:29.181075 (+ 209us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 08:03:29.181077 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 08:03:29.181121 (+ 44us) client_negotiation.cc:240] Negotiation successful
0811 08:03:29.181171 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":149,"threads_started":1}
I20260811 08:03:29.184638 17048 raft_consensus.cc:1261] T 502c160238864f72a636272d39cb0e11 P bd902ddf2951402ca95d5433cb488703 [term 1 FOLLOWER]: Refusing update from remote peer 2bcca3cde237444080a71d1a7660b76a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:03:29.184813 17207 raft_consensus.cc:1261] T 502c160238864f72a636272d39cb0e11 P 577685d95b5649c2ad338825eddf51d5 [term 1 FOLLOWER]: Refusing update from remote peer 2bcca3cde237444080a71d1a7660b76a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:03:29.184960 17315 consensus_queue.cc:1035] T 502c160238864f72a636272d39cb0e11 P 2bcca3cde237444080a71d1a7660b76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd902ddf2951402ca95d5433cb488703" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:03:29.185088 17290 consensus_queue.cc:1035] T 502c160238864f72a636272d39cb0e11 P 2bcca3cde237444080a71d1a7660b76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "577685d95b5649c2ad338825eddf51d5" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 37707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:03:29.202767 17279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:29.200034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:58921 (local address 127.15.36.193:39515)
0811 08:03:29.200096 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:29.200109 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:29.200120 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:03:29.200194 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:29.200196 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:29.200209 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:29.200265 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:03:29.200492 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:29.201119 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:29.201979 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:29.202194 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:29.202278 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:29.202481 (+ 203us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:03:29.202516 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:03:29.202587 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:29.202650 (+ 63us) server_negotiation.cc:299] Negotiation successful
0811 08:03:29.202679 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 08:03:29.202778 17342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:29.199802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.193:39515 (local address 127.15.36.195:58921)
0811 08:03:29.200054 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:29.200069 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:29.200135 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:29.200269 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:29.200270 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:29.200272 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 08:03:29.200343 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:29.200345 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:29.201214 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:29.201215 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:29.201880 (+ 665us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:29.201884 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:29.202278 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:29.202279 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:29.202350 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:29.202381 (+ 31us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 08:03:29.202589 (+ 208us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 08:03:29.202591 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 08:03:29.202646 (+ 55us) client_negotiation.cc:240] Negotiation successful
0811 08:03:29.202700 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":183,"threads_started":1}
I20260811 08:03:29.219470 16726 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58916:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:03:29.219648 16726 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58916:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:03:29.220435 16726 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 017badd436654c6384c2ad11d1debf3f: Sending DeleteTablet for 3 replicas of tablet 502c160238864f72a636272d39cb0e11
I20260811 08:03:29.220925 17021 tablet_service.cc:1514] Processing DeleteTablet for tablet 502c160238864f72a636272d39cb0e11 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:03:29 UTC) from {username='kudu', principal='kudu/127.15.36.254@KRBTEST.COM'} at 127.0.0.1:43156
I20260811 08:03:29.221088 17309 tablet_replica.cc:330] T 502c160238864f72a636272d39cb0e11 P bd902ddf2951402ca95d5433cb488703: stopping tablet replica
I20260811 08:03:29.221088 16876 tablet_service.cc:1514] Processing DeleteTablet for tablet 502c160238864f72a636272d39cb0e11 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:03:29 UTC) from {username='kudu', principal='kudu/127.15.36.254@KRBTEST.COM'} at 127.0.0.1:37548
I20260811 08:03:29.221141 17309 raft_consensus.cc:2229] T 502c160238864f72a636272d39cb0e11 P bd902ddf2951402ca95d5433cb488703 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:03:29.221184 17309 raft_consensus.cc:2258] T 502c160238864f72a636272d39cb0e11 P bd902ddf2951402ca95d5433cb488703 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:03:29.221246 17307 tablet_replica.cc:330] T 502c160238864f72a636272d39cb0e11 P 2bcca3cde237444080a71d1a7660b76a: stopping tablet replica
I20260811 08:03:29.221300 17307 raft_consensus.cc:2229] T 502c160238864f72a636272d39cb0e11 P 2bcca3cde237444080a71d1a7660b76a [term 1 LEADER]: Raft consensus shutting down.
I20260811 08:03:29.221429 17307 raft_consensus.cc:2258] T 502c160238864f72a636272d39cb0e11 P 2bcca3cde237444080a71d1a7660b76a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:03:29.221769 17185 tablet_service.cc:1514] Processing DeleteTablet for tablet 502c160238864f72a636272d39cb0e11 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:03:29 UTC) from {username='kudu', principal='kudu/127.15.36.254@KRBTEST.COM'} at 127.0.0.1:51886
I20260811 08:03:29.221832 17307 ts_tablet_manager.cc:1905] T 502c160238864f72a636272d39cb0e11 P 2bcca3cde237444080a71d1a7660b76a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:03:29.221870 17308 tablet_replica.cc:330] T 502c160238864f72a636272d39cb0e11 P 577685d95b5649c2ad338825eddf51d5: stopping tablet replica
I20260811 08:03:29.221923 17308 raft_consensus.cc:2229] T 502c160238864f72a636272d39cb0e11 P 577685d95b5649c2ad338825eddf51d5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:03:29.221957 17308 raft_consensus.cc:2258] T 502c160238864f72a636272d39cb0e11 P 577685d95b5649c2ad338825eddf51d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:03:29.222384 17308 ts_tablet_manager.cc:1905] T 502c160238864f72a636272d39cb0e11 P 577685d95b5649c2ad338825eddf51d5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:03:29.223312 17309 ts_tablet_manager.cc:1905] T 502c160238864f72a636272d39cb0e11 P bd902ddf2951402ca95d5433cb488703: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:03:29.224098 17307 ts_tablet_manager.cc:1918] T 502c160238864f72a636272d39cb0e11 P 2bcca3cde237444080a71d1a7660b76a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 08:03:29.224164 17307 log.cc:1196] T 502c160238864f72a636272d39cb0e11 P 2bcca3cde237444080a71d1a7660b76a: Deleting WAL directory at /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/ts-0/wal/wals/502c160238864f72a636272d39cb0e11
I20260811 08:03:29.224418 17307 ts_tablet_manager.cc:1939] T 502c160238864f72a636272d39cb0e11 P 2bcca3cde237444080a71d1a7660b76a: Deleting consensus metadata
I20260811 08:03:29.224422 17308 ts_tablet_manager.cc:1918] T 502c160238864f72a636272d39cb0e11 P 577685d95b5649c2ad338825eddf51d5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 08:03:29.224488 17308 log.cc:1196] T 502c160238864f72a636272d39cb0e11 P 577685d95b5649c2ad338825eddf51d5: Deleting WAL directory at /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/ts-2/wal/wals/502c160238864f72a636272d39cb0e11
I20260811 08:03:29.224753 17308 ts_tablet_manager.cc:1939] T 502c160238864f72a636272d39cb0e11 P 577685d95b5649c2ad338825eddf51d5: Deleting consensus metadata
I20260811 08:03:29.224833 16711 catalog_manager.cc:4841] TS 2bcca3cde237444080a71d1a7660b76a (127.15.36.193:39515): tablet 502c160238864f72a636272d39cb0e11 (table test-table [id=18a17ed925ac489eb0af493ee938fa83]) successfully deleted
I20260811 08:03:29.225863 17309 ts_tablet_manager.cc:1918] T 502c160238864f72a636272d39cb0e11 P bd902ddf2951402ca95d5433cb488703: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 08:03:29.225975 17309 log.cc:1196] T 502c160238864f72a636272d39cb0e11 P bd902ddf2951402ca95d5433cb488703: Deleting WAL directory at /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786435400844580-15507-0/minicluster-data/ts-1/wal/wals/502c160238864f72a636272d39cb0e11
I20260811 08:03:29.226243 17309 ts_tablet_manager.cc:1939] T 502c160238864f72a636272d39cb0e11 P bd902ddf2951402ca95d5433cb488703: Deleting consensus metadata
I20260811 08:03:29.226657 16712 catalog_manager.cc:4841] TS bd902ddf2951402ca95d5433cb488703 (127.15.36.194:36797): tablet 502c160238864f72a636272d39cb0e11 (table test-table [id=18a17ed925ac489eb0af493ee938fa83]) successfully deleted
I20260811 08:03:29.227002 16712 catalog_manager.cc:4841] TS 577685d95b5649c2ad338825eddf51d5 (127.15.36.195:37707): tablet 502c160238864f72a636272d39cb0e11 (table test-table [id=18a17ed925ac489eb0af493ee938fa83]) successfully deleted
Aug 11 08:03:29 dist-test-slave-2w3w krb5kdc[16678](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435408, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.15.36.193@KRBTEST.COM
I20260811 08:03:29.238806 17279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:29.225510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37568 (local address 127.15.36.193:39515)
0811 08:03:29.225557 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:29.225560 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:29.225790 (+ 230us) server_negotiation.cc:407] Connection header received
0811 08:03:29.225933 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:29.225933 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:29.225946 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:29.225981 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:29.226856 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:29.227599 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:29.228445 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:29.228651 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:29.228732 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:29.234748 (+ 6016us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:29.234771 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:29.234771 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:29.234781 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:29.236949 (+ 2168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:29.237722 (+ 773us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:29.237732 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:29.237733 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:29.237828 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:29.238097 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:29.238099 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:29.238099 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:29.238280 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:29.238469 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:29.238572 (+ 103us) server_negotiation.cc:299] Negotiation successful
0811 08:03:29.238676 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
W20260811 08:03:29.239399 16941 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37568
I20260811 08:03:29.248432 17325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:29.240572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58920 (local address 127.15.36.254:34345)
0811 08:03:29.240624 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:29.240626 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:29.240863 (+ 237us) server_negotiation.cc:407] Connection header received
0811 08:03:29.240937 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:29.240938 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:29.240954 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:29.241004 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:29.241606 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:29.242167 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:29.242947 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:29.243270 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:29.243347 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:29.245226 (+ 1879us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:29.245228 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:29.245229 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:29.245239 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:29.247008 (+ 1769us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:29.247389 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:29.247390 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:29.247391 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:29.247462 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:29.247679 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:29.247680 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:29.247680 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:29.247891 (+ 211us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:29.248014 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:29.248118 (+ 104us) server_negotiation.cc:299] Negotiation successful
0811 08:03:29.248227 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
W20260811 08:03:29.248682 16726 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58920
I20260811 08:03:29.249748 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 16806
I20260811 08:03:29.260356 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 16958
I20260811 08:03:29.277422 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 17109
I20260811 08:03:29.295804 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 16692
2026-08-11T08:03:29Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (3185 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:03:29 dist-test-slave-2w3w krb5kdc[17353](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:03:29 dist-test-slave-2w3w krb5kdc[17353](info): set up 2 sockets
Aug 11 08:03:29 dist-test-slave-2w3w krb5kdc[17353](info): commencing operation
krb5kdc: starting...
W20260811 08:03:30.649232 15507 mini_kdc.cc:121] Time spent starting KDC: real 1.325s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Aug 11 08:03:30 dist-test-slave-2w3w krb5kdc[17353](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435410, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:03:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:03:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.36.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab.
Entry for principal kudu/127.15.36.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab.
I20260811 08:03:30.820703 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:42649
--webserver_interface=127.15.36.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=kudu/127.15.36.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:36171
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.36.254:42649
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:03:30.937971 17367 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:03:30.938292 17367 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:03:30.938336 17367 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:03:30.939716 17367 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:03:30.939845 17367 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 08:03:30.939877 17367 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:03:30.939971 17367 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:03:30.940033 17367 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:03:30.940068 17367 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:03:30.941956 17367 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:36171
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.36.254:42649
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=kudu/127.15.36.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:42649
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.36.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17367
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:03:30.942416 17367 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:03:30.942775 17367 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:03:30.948882 17373 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:30.948911 17375 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:30.948875 17372 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:03:30.949273 17367 server_base.cc:1034] running on GCE node
I20260811 08:03:30.949556 17367 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:03:30.949847 17367 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:03:30.951081 17367 hybrid_clock.cc:648] HybridClock initialized: now 1786435410951060 us; error 37 us; skew 500 ppm
Aug 11 08:03:30 dist-test-slave-2w3w krb5kdc[17353](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435410, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:03:30.955118 17367 init.cc:377] Logged in from keytab as kudu/127.15.36.254@KRBTEST.COM (short username kudu)
I20260811 08:03:30.956171 17367 webserver.cc:460] Webserver started at http://127.15.36.254:34991/ using document root <none> and password file <none>
I20260811 08:03:30.956477 17367 fs_manager.cc:359] Metadata directory not provided
I20260811 08:03:30.956533 17367 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:03:30.956698 17367 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:03:30.957919 17367 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/master-0/data/instance:
uuid: "864969326d2e44c48a2c4a83b6b2c36d"
format_stamp: "Formatted at 2026-08-11 08:03:30 on dist-test-slave-2w3w"
server_key: "6dd9255f40d71e2588f1eafdb46725c2"
server_key_iv: "e14a194a1eeb3505afba5dc836c82efa"
server_key_version: "encryptionkey@0"
I20260811 08:03:30.958317 17367 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/master-0/wal/instance:
uuid: "864969326d2e44c48a2c4a83b6b2c36d"
format_stamp: "Formatted at 2026-08-11 08:03:30 on dist-test-slave-2w3w"
server_key: "6dd9255f40d71e2588f1eafdb46725c2"
server_key_iv: "e14a194a1eeb3505afba5dc836c82efa"
server_key_version: "encryptionkey@0"
I20260811 08:03:30.960125 17367 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260811 08:03:30.961501 17382 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:30.961956 17367 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:03:30.962218 17367 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/master-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/master-0/wal
uuid: "864969326d2e44c48a2c4a83b6b2c36d"
format_stamp: "Formatted at 2026-08-11 08:03:30 on dist-test-slave-2w3w"
server_key: "6dd9255f40d71e2588f1eafdb46725c2"
server_key_iv: "e14a194a1eeb3505afba5dc836c82efa"
server_key_version: "encryptionkey@0"
I20260811 08:03:30.962332 17367 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:03:30.980777 17367 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:03:30.983982 17367 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:03:30.984221 17367 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:03:30.991192 17367 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.254:42649
I20260811 08:03:30.991277 17451 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.254:42649 every 8 connection(s)
I20260811 08:03:30.991712 17367 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
I20260811 08:03:30.992509 17452 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:03:30.995155 17452 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 864969326d2e44c48a2c4a83b6b2c36d: Bootstrap starting.
I20260811 08:03:30.995767 17452 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 864969326d2e44c48a2c4a83b6b2c36d: Neither blocks nor log segments found. Creating new log.
I20260811 08:03:30.996156 17452 log.cc:824] T 00000000000000000000000000000000 P 864969326d2e44c48a2c4a83b6b2c36d: Log is configured to *not* fsync() on all Append() calls
I20260811 08:03:30.997248 17452 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 864969326d2e44c48a2c4a83b6b2c36d: No bootstrap required, opened a new log
I20260811 08:03:30.998487 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 17367
I20260811 08:03:30.998585 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/master-0/wal/instance
I20260811 08:03:30.998745 15507 external_mini_cluster.cc:1428] Setting key 47f30f756afd340fa2dbc0d79e4d0fe8
I20260811 08:03:31.000270 17452 raft_consensus.cc:348] T 00000000000000000000000000000000 P 864969326d2e44c48a2c4a83b6b2c36d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "864969326d2e44c48a2c4a83b6b2c36d" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 42649 } }
I20260811 08:03:31.000427 17452 raft_consensus.cc:374] T 00000000000000000000000000000000 P 864969326d2e44c48a2c4a83b6b2c36d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:03:31.000450 17452 raft_consensus.cc:729] T 00000000000000000000000000000000 P 864969326d2e44c48a2c4a83b6b2c36d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 864969326d2e44c48a2c4a83b6b2c36d, State: Initialized, Role: FOLLOWER
I20260811 08:03:31.000602 17452 consensus_queue.cc:260] T 00000000000000000000000000000000 P 864969326d2e44c48a2c4a83b6b2c36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "864969326d2e44c48a2c4a83b6b2c36d" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 42649 } }
I20260811 08:03:31.000702 17452 raft_consensus.cc:388] T 00000000000000000000000000000000 P 864969326d2e44c48a2c4a83b6b2c36d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:03:31.000751 17452 raft_consensus.cc:482] T 00000000000000000000000000000000 P 864969326d2e44c48a2c4a83b6b2c36d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:03:31.000806 17452 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 864969326d2e44c48a2c4a83b6b2c36d [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:03:31.001684 17452 raft_consensus.cc:504] T 00000000000000000000000000000000 P 864969326d2e44c48a2c4a83b6b2c36d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "864969326d2e44c48a2c4a83b6b2c36d" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 42649 } }
I20260811 08:03:31.001839 17452 leader_election.cc:302] T 00000000000000000000000000000000 P 864969326d2e44c48a2c4a83b6b2c36d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 864969326d2e44c48a2c4a83b6b2c36d; no voters:
I20260811 08:03:31.002077 17452 leader_election.cc:288] T 00000000000000000000000000000000 P 864969326d2e44c48a2c4a83b6b2c36d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:03:31.002112 17458 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 864969326d2e44c48a2c4a83b6b2c36d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:03:31.002382 17458 raft_consensus.cc:686] T 00000000000000000000000000000000 P 864969326d2e44c48a2c4a83b6b2c36d [term 1 LEADER]: Becoming Leader. State: Replica: 864969326d2e44c48a2c4a83b6b2c36d, State: Running, Role: LEADER
I20260811 08:03:31.002496 17452 sys_catalog.cc:564] T 00000000000000000000000000000000 P 864969326d2e44c48a2c4a83b6b2c36d [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:03:31.002509 17458 consensus_queue.cc:237] T 00000000000000000000000000000000 P 864969326d2e44c48a2c4a83b6b2c36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "864969326d2e44c48a2c4a83b6b2c36d" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 42649 } }
I20260811 08:03:31.003194 17459 sys_catalog.cc:455] T 00000000000000000000000000000000 P 864969326d2e44c48a2c4a83b6b2c36d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "864969326d2e44c48a2c4a83b6b2c36d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "864969326d2e44c48a2c4a83b6b2c36d" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 42649 } } }
I20260811 08:03:31.003342 17459 sys_catalog.cc:458] T 00000000000000000000000000000000 P 864969326d2e44c48a2c4a83b6b2c36d [sys.catalog]: This master's current role is: LEADER
I20260811 08:03:31.003530 17460 sys_catalog.cc:455] T 00000000000000000000000000000000 P 864969326d2e44c48a2c4a83b6b2c36d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 864969326d2e44c48a2c4a83b6b2c36d. Latest consensus state: current_term: 1 leader_uuid: "864969326d2e44c48a2c4a83b6b2c36d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "864969326d2e44c48a2c4a83b6b2c36d" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 42649 } } }
I20260811 08:03:31.003619 17460 sys_catalog.cc:458] T 00000000000000000000000000000000 P 864969326d2e44c48a2c4a83b6b2c36d [sys.catalog]: This master's current role is: LEADER
I20260811 08:03:31.003911 17464 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:03:31.004542 17464 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:03:31.006819 17464 catalog_manager.cc:1347] Generated new cluster ID: 19ccb091ac37496583cc88700664b9df
I20260811 08:03:31.006933 17464 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 08:03:31 dist-test-slave-2w3w krb5kdc[17353](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435410, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:03:31.016332 17457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:30.999389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40502 (local address 127.15.36.254:42649)
0811 08:03:30.999586 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:30.999595 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:30.999625 (+ 30us) server_negotiation.cc:407] Connection header received
0811 08:03:31.000264 (+ 639us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:31.000273 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:31.000339 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:31.000557 (+ 218us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:31.001414 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:31.003167 (+ 1753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:31.004541 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:31.005359 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:31.005547 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:31.009705 (+ 4158us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:31.009711 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:31.009711 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:31.009728 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:31.013022 (+ 3294us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:31.014105 (+ 1083us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:31.014109 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:31.014110 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:31.014270 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:31.014599 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:31.014600 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:31.014601 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:31.015026 (+ 425us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:31.015200 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:31.015544 (+ 344us) server_negotiation.cc:299] Negotiation successful
0811 08:03:31.015723 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":106,"threads_started":1}
I20260811 08:03:31.016745 17464 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:03:31.017931 17464 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:03:31.024999 17464 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 864969326d2e44c48a2c4a83b6b2c36d: Generated new TSK 0
I20260811 08:03:31.025283 17464 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.36.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab.
Entry for principal kudu/127.15.36.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab.
I20260811 08:03:31.070605 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.193:0
--local_ip_for_outbound_sockets=127.15.36.193
--webserver_interface=127.15.36.193
--webserver_port=0
--tserver_master_addrs=127.15.36.254:42649
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab
--principal=kudu/127.15.36.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:36171
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:03:31.178839 17480 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:03:31.179119 17480 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:03:31.179153 17480 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:03:31.180532 17480 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:03:31.180600 17480 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:03:31.180624 17480 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 08:03:31.180637 17480 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 08:03:31.180656 17480 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.193
I20260811 08:03:31.182422 17480 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:36171
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab
--principal=kudu/127.15.36.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.36.193
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.15.36.254:42649
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17480
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.193
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:03:31.182809 17480 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:03:31.183125 17480 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:03:31.189509 17487 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:31.189524 17490 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:31.189509 17486 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:03:31.190302 17480 server_base.cc:1034] running on GCE node
I20260811 08:03:31.190682 17480 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:03:31.191079 17480 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:03:31.192281 17480 hybrid_clock.cc:648] HybridClock initialized: now 1786435411192256 us; error 60 us; skew 500 ppm
Aug 11 08:03:31 dist-test-slave-2w3w krb5kdc[17353](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435411, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:03:31.196051 17480 init.cc:377] Logged in from keytab as kudu/127.15.36.193@KRBTEST.COM (short username kudu)
I20260811 08:03:31.199506 17480 webserver.cc:460] Webserver started at http://127.15.36.193:43865/ using document root <none> and password file <none>
I20260811 08:03:31.199846 17480 fs_manager.cc:359] Metadata directory not provided
I20260811 08:03:31.199934 17480 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:03:31.200119 17480 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:03:31.201339 17480 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/ts-0/data/instance:
uuid: "6ef53eeb0b2b4676987701e7d3d273af"
format_stamp: "Formatted at 2026-08-11 08:03:31 on dist-test-slave-2w3w"
server_key: "3ec6c2616e2099b9d9fbe94feade85e8"
server_key_iv: "c62d2edefa07c09a631efe740797dc5a"
server_key_version: "encryptionkey@0"
I20260811 08:03:31.201746 17480 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/ts-0/wal/instance:
uuid: "6ef53eeb0b2b4676987701e7d3d273af"
format_stamp: "Formatted at 2026-08-11 08:03:31 on dist-test-slave-2w3w"
server_key: "3ec6c2616e2099b9d9fbe94feade85e8"
server_key_iv: "c62d2edefa07c09a631efe740797dc5a"
server_key_version: "encryptionkey@0"
I20260811 08:03:31.203692 17480 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.003s
I20260811 08:03:31.204946 17500 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:31.205353 17480 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:03:31.205574 17480 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/ts-0/wal
uuid: "6ef53eeb0b2b4676987701e7d3d273af"
format_stamp: "Formatted at 2026-08-11 08:03:31 on dist-test-slave-2w3w"
server_key: "3ec6c2616e2099b9d9fbe94feade85e8"
server_key_iv: "c62d2edefa07c09a631efe740797dc5a"
server_key_version: "encryptionkey@0"
I20260811 08:03:31.205709 17480 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:03:31.242882 17480 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:03:31.245791 17480 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:03:31.245927 17480 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:03:31.246587 17480 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:03:31.246634 17480 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:31.246658 17480 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:03:31.246671 17480 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 08:03:31 dist-test-slave-2w3w krb5kdc[17353](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435411, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.193@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:03:31.256803 17480 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.193:34467
I20260811 08:03:31.257143 17627 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.193:34467 every 8 connection(s)
I20260811 08:03:31.257510 17480 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
I20260811 08:03:31.260129 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 17480
I20260811 08:03:31.260500 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/ts-0/wal/instance
I20260811 08:03:31.260720 15507 external_mini_cluster.cc:1428] Setting key 14ece84b440ab393f3d1c365c0f4afc2
I20260811 08:03:31.261296 17511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:31.247362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:42649 (local address 127.15.36.193:44367)
0811 08:03:31.247574 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:31.247615 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:31.248236 (+ 621us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:31.248510 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:31.248514 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:31.248966 (+ 452us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:03:31.249275 (+ 309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:31.249282 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:31.250760 (+ 1478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:31.250761 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:31.251921 (+ 1160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:31.251924 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:31.252457 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:31.252459 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:31.252629 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:31.253541 (+ 912us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:03:31.253559 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:03:31.256287 (+ 2728us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:03:31.258744 (+ 2457us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:31.258751 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:31.258753 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:31.259241 (+ 488us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:31.259535 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:31.259536 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:31.259537 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:31.259664 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:31.260219 (+ 555us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:03:31.260227 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:03:31.260478 (+ 251us) client_negotiation.cc:769] Sending connection context
0811 08:03:31.260619 (+ 141us) client_negotiation.cc:240] Negotiation successful
0811 08:03:31.260900 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":111,"threads_started":1}
I20260811 08:03:31.261749 17457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:31.247359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:44367 (local address 127.15.36.254:42649)
0811 08:03:31.247414 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:31.247416 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:31.247711 (+ 295us) server_negotiation.cc:407] Connection header received
0811 08:03:31.248360 (+ 649us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:31.248362 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:31.248381 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:31.248435 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:31.249408 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:31.250611 (+ 1203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:31.252054 (+ 1443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:31.252309 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:31.252425 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:31.256450 (+ 4025us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:31.256452 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:31.256453 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:31.256463 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:31.258622 (+ 2159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:31.259360 (+ 738us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:31.259362 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:31.259362 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:31.259429 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:31.259917 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:31.259919 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:31.259919 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:31.260100 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:31.260175 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:31.261530 (+ 1355us) server_negotiation.cc:299] Negotiation successful
0811 08:03:31.261651 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 08:03:31.262413 17628 heartbeater.cc:347] Connected to a master server at 127.15.36.254:42649
I20260811 08:03:31.262524 17628 heartbeater.cc:464] Registering TS with master...
I20260811 08:03:31.262753 17628 heartbeater.cc:511] Master 127.15.36.254:42649 requested a full tablet report, sending...
I20260811 08:03:31.263437 17401 ts_manager.cc:194] Registered new tserver with Master: 6ef53eeb0b2b4676987701e7d3d273af (127.15.36.193:34467)
I20260811 08:03:31.264500 17401 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.36.193@KRBTEST.COM'} at 127.15.36.193:44367
WARNING: no policy specified for kudu/127.15.36.194@KRBTEST.COM; defaulting to no policy
I20260811 08:03:31.274235 17457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:31.264958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:59931 (local address 127.15.36.254:42649)
0811 08:03:31.265015 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:31.265017 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:31.265028 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:03:31.265073 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:31.265074 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:31.265085 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:31.265294 (+ 209us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:31.266518 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:31.267230 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:31.268865 (+ 1635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:31.269074 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:31.269155 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:31.270502 (+ 1347us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:31.270504 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:31.270504 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:31.270513 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:31.272436 (+ 1923us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:31.273017 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:31.273018 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:31.273019 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:31.273121 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:31.273606 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:31.273607 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:31.273607 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:31.273759 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:31.273858 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:31.274022 (+ 164us) server_negotiation.cc:299] Negotiation successful
0811 08:03:31.274130 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 08:03:31.274256 17637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:31.263776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:42649 (local address 127.15.36.193:59931)
0811 08:03:31.264014 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:31.264032 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:31.264087 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:31.265301 (+ 1214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:31.265302 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:31.265586 (+ 284us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:03:31.265686 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:31.265690 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:31.267359 (+ 1669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:31.267361 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:31.268350 (+ 989us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:31.268357 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:31.269184 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:31.269186 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:31.269292 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:31.269852 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:03:31.269858 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:03:31.270359 (+ 501us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:03:31.272564 (+ 2205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:31.272566 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:31.272566 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:31.272906 (+ 340us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:31.273243 (+ 337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:31.273244 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:31.273245 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:31.273500 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:31.273840 (+ 340us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:03:31.273841 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:03:31.273910 (+ 69us) client_negotiation.cc:769] Sending connection context
0811 08:03:31.273994 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 08:03:31.274129 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":170,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab.
Entry for principal kudu/127.15.36.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab.
I20260811 08:03:31.317739 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.194:0
--local_ip_for_outbound_sockets=127.15.36.194
--webserver_interface=127.15.36.194
--webserver_port=0
--tserver_master_addrs=127.15.36.254:42649
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab
--principal=kudu/127.15.36.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:36171
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:03:31.425189 17640 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:03:31.425499 17640 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:03:31.425547 17640 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:03:31.426894 17640 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:03:31.427016 17640 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:03:31.427058 17640 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 08:03:31.427089 17640 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 08:03:31.427129 17640 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.194
I20260811 08:03:31.428841 17640 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:36171
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab
--principal=kudu/127.15.36.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.36.194
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.15.36.254:42649
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17640
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.194
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:03:31.429185 17640 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:03:31.429458 17640 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:03:31.435627 17646 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:31.435726 17650 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:31.435830 17647 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:03:31.436237 17640 server_base.cc:1034] running on GCE node
I20260811 08:03:31.436712 17640 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:03:31.437139 17640 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:03:31.438437 17640 hybrid_clock.cc:648] HybridClock initialized: now 1786435411438369 us; error 79 us; skew 500 ppm
Aug 11 08:03:31 dist-test-slave-2w3w krb5kdc[17353](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435411, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:03:31.442217 17640 init.cc:377] Logged in from keytab as kudu/127.15.36.194@KRBTEST.COM (short username kudu)
I20260811 08:03:31.442785 17640 webserver.cc:460] Webserver started at http://127.15.36.194:44767/ using document root <none> and password file <none>
I20260811 08:03:31.443102 17640 fs_manager.cc:359] Metadata directory not provided
I20260811 08:03:31.443184 17640 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:03:31.443427 17640 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:03:31.445389 17640 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/ts-1/data/instance:
uuid: "47ba6728b7364e75abaa8cccf1382970"
format_stamp: "Formatted at 2026-08-11 08:03:31 on dist-test-slave-2w3w"
server_key: "d5dca2abb1ef9d3f99fc023a2260e08c"
server_key_iv: "288735b03d6846dd025d4b0e8ceb37bc"
server_key_version: "encryptionkey@0"
I20260811 08:03:31.445827 17640 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/ts-1/wal/instance:
uuid: "47ba6728b7364e75abaa8cccf1382970"
format_stamp: "Formatted at 2026-08-11 08:03:31 on dist-test-slave-2w3w"
server_key: "d5dca2abb1ef9d3f99fc023a2260e08c"
server_key_iv: "288735b03d6846dd025d4b0e8ceb37bc"
server_key_version: "encryptionkey@0"
I20260811 08:03:31.447708 17640 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260811 08:03:31.448655 17659 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:31.449041 17640 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:03:31.449144 17640 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/ts-1/wal
uuid: "47ba6728b7364e75abaa8cccf1382970"
format_stamp: "Formatted at 2026-08-11 08:03:31 on dist-test-slave-2w3w"
server_key: "d5dca2abb1ef9d3f99fc023a2260e08c"
server_key_iv: "288735b03d6846dd025d4b0e8ceb37bc"
server_key_version: "encryptionkey@0"
I20260811 08:03:31.449333 17640 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:03:31.464871 17640 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:03:31.468693 17640 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:03:31.468843 17640 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:03:31.469365 17640 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:03:31.469429 17640 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:31.469483 17640 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:03:31.469513 17640 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:31.479115 17640 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.194:45469
I20260811 08:03:31.479485 17778 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.194:45469 every 8 connection(s)
I20260811 08:03:31.479657 17640 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
Aug 11 08:03:31 dist-test-slave-2w3w krb5kdc[17353](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435411, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.194@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:03:31.485383 17457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:31.470048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:39877 (local address 127.15.36.254:42649)
0811 08:03:31.470130 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:31.470133 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:31.470392 (+ 259us) server_negotiation.cc:407] Connection header received
0811 08:03:31.471010 (+ 618us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:31.471011 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:31.471028 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:31.471120 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:31.472143 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:31.473051 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:31.475774 (+ 2723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:31.476538 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:31.476639 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:31.481012 (+ 4373us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:31.481014 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:31.481015 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:31.481025 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:31.482817 (+ 1792us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:31.483588 (+ 771us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:31.483590 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:31.483591 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:31.483663 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:31.484143 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:31.484145 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:31.484145 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:31.484302 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:31.484724 (+ 422us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:31.485206 (+ 482us) server_negotiation.cc:299] Negotiation successful
0811 08:03:31.485301 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 08:03:31.485586 17668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:31.470028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:42649 (local address 127.15.36.194:39877)
0811 08:03:31.470228 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:31.470272 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:31.470841 (+ 569us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:31.471207 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:31.471211 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:31.471633 (+ 422us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:03:31.471987 (+ 354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:31.471997 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:31.473209 (+ 1212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:31.473210 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:31.475606 (+ 2396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:31.475614 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:31.476791 (+ 1177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:31.476793 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:31.477046 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:31.478195 (+ 1149us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:03:31.478208 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:03:31.480681 (+ 2473us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:03:31.482989 (+ 2308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:31.483037 (+ 48us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:31.483041 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:31.483426 (+ 385us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:31.483789 (+ 363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:31.483790 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:31.483791 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:31.483953 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:31.484766 (+ 813us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:03:31.484774 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:03:31.484958 (+ 184us) client_negotiation.cc:769] Sending connection context
0811 08:03:31.485091 (+ 133us) client_negotiation.cc:240] Negotiation successful
0811 08:03:31.485271 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":128,"threads_started":1}
I20260811 08:03:31.486668 17779 heartbeater.cc:347] Connected to a master server at 127.15.36.254:42649
I20260811 08:03:31.486788 17779 heartbeater.cc:464] Registering TS with master...
I20260811 08:03:31.487064 17779 heartbeater.cc:511] Master 127.15.36.254:42649 requested a full tablet report, sending...
I20260811 08:03:31.487663 17402 ts_manager.cc:194] Registered new tserver with Master: 47ba6728b7364e75abaa8cccf1382970 (127.15.36.194:45469)
I20260811 08:03:31.488229 17402 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.36.194@KRBTEST.COM'} at 127.15.36.194:39877
I20260811 08:03:31.488443 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 17640
I20260811 08:03:31.488555 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/ts-1/wal/instance
I20260811 08:03:31.488763 15507 external_mini_cluster.cc:1428] Setting key fff688819bc5b715b3d62810084acaa6
I20260811 08:03:31.497308 17787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:31.488099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:42649 (local address 127.15.36.194:57875)
0811 08:03:31.488309 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:31.488325 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:31.488415 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:31.488593 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:31.488595 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:31.488836 (+ 241us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:03:31.488978 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:31.488982 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:31.489816 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:31.489817 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:31.491289 (+ 1472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:31.491296 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:31.491754 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:31.491755 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:31.491930 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:31.492698 (+ 768us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:03:31.492703 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:03:31.493394 (+ 691us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:03:31.495369 (+ 1975us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:31.495371 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:31.495371 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:31.495675 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:31.495943 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:31.495945 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:31.495945 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:31.496036 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:31.496759 (+ 723us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:03:31.496761 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:03:31.496846 (+ 85us) client_negotiation.cc:769] Sending connection context
0811 08:03:31.496981 (+ 135us) client_negotiation.cc:240] Negotiation successful
0811 08:03:31.497143 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"mutex_wait_us":6,"thread_start_us":84,"threads_started":1}
I20260811 08:03:31.497386 17457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:31.488388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:57875 (local address 127.15.36.254:42649)
0811 08:03:31.488434 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:31.488436 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:31.488446 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:03:31.488472 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:31.488473 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:31.488485 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:31.488540 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:31.489087 (+ 547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:31.489703 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:31.491429 (+ 1726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:31.491632 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:31.491704 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:31.493540 (+ 1836us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:31.493550 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:31.493550 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:31.493558 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:31.495261 (+ 1703us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:31.495794 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:31.495795 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:31.495796 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:31.495858 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:31.496219 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:31.496222 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:31.496223 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:31.496584 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:31.496815 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:31.497147 (+ 332us) server_negotiation.cc:299] Negotiation successful
0811 08:03:31.497265 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
WARNING: no policy specified for kudu/127.15.36.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab.
Entry for principal kudu/127.15.36.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab.
I20260811 08:03:31.534780 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.195:0
--local_ip_for_outbound_sockets=127.15.36.195
--webserver_interface=127.15.36.195
--webserver_port=0
--tserver_master_addrs=127.15.36.254:42649
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab
--principal=kudu/127.15.36.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:36171
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:03:31.652238 17790 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:03:31.652662 17790 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:03:31.652729 17790 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:03:31.656519 17790 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:03:31.656719 17790 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:03:31.656781 17790 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 08:03:31.656805 17790 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 08:03:31.657191 17790 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.195
I20260811 08:03:31.662289 17790 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:36171
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab
--principal=kudu/127.15.36.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.36.195
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.15.36.254:42649
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17790
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.195
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:03:31.662711 17790 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:03:31.663092 17790 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:03:31.671411 17799 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:31.671521 17797 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:31.671521 17802 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:03:31.675419 17790 server_base.cc:1034] running on GCE node
I20260811 08:03:31.675747 17790 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:03:31.676476 17790 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:03:31.677742 17790 hybrid_clock.cc:648] HybridClock initialized: now 1786435411677720 us; error 48 us; skew 500 ppm
Aug 11 08:03:31 dist-test-slave-2w3w krb5kdc[17353](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435411, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:03:31.681736 17790 init.cc:377] Logged in from keytab as kudu/127.15.36.195@KRBTEST.COM (short username kudu)
I20260811 08:03:31.682389 17790 webserver.cc:460] Webserver started at http://127.15.36.195:35775/ using document root <none> and password file <none>
I20260811 08:03:31.682767 17790 fs_manager.cc:359] Metadata directory not provided
I20260811 08:03:31.682826 17790 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:03:31.683070 17790 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:03:31.684360 17790 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/ts-2/data/instance:
uuid: "05672f65a17c42d7a7cba31d85700725"
format_stamp: "Formatted at 2026-08-11 08:03:31 on dist-test-slave-2w3w"
server_key: "0e8a308162f3572ca061ad03197c528a"
server_key_iv: "f069bb2350abd898a3422811780d7b8a"
server_key_version: "encryptionkey@0"
I20260811 08:03:31.684800 17790 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/ts-2/wal/instance:
uuid: "05672f65a17c42d7a7cba31d85700725"
format_stamp: "Formatted at 2026-08-11 08:03:31 on dist-test-slave-2w3w"
server_key: "0e8a308162f3572ca061ad03197c528a"
server_key_iv: "f069bb2350abd898a3422811780d7b8a"
server_key_version: "encryptionkey@0"
I20260811 08:03:31.686506 17790 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 08:03:31.687904 17809 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:31.688233 17790 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:03:31.688364 17790 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/ts-2/wal
uuid: "05672f65a17c42d7a7cba31d85700725"
format_stamp: "Formatted at 2026-08-11 08:03:31 on dist-test-slave-2w3w"
server_key: "0e8a308162f3572ca061ad03197c528a"
server_key_iv: "f069bb2350abd898a3422811780d7b8a"
server_key_version: "encryptionkey@0"
I20260811 08:03:31.688459 17790 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:03:31.727140 17790 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:03:31.729833 17790 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:03:31.730037 17790 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:03:31.730621 17790 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:03:31.730691 17790 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:31.730811 17790 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:03:31.730859 17790 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 08:03:31 dist-test-slave-2w3w krb5kdc[17353](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435411, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.195@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:03:31.740739 17790 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.195:38289
I20260811 08:03:31.740828 17930 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.195:38289 every 8 connection(s)
I20260811 08:03:31.741209 17790 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
I20260811 08:03:31.745756 17819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:31.731604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:42649 (local address 127.15.36.195:45671)
0811 08:03:31.731840 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:31.731886 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:31.732696 (+ 810us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:31.733031 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:31.733034 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:31.733324 (+ 290us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:03:31.733550 (+ 226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:31.733554 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:31.734506 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:31.734507 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:31.735591 (+ 1084us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:31.735594 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:31.736153 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:31.736154 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:31.736345 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:31.737172 (+ 827us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:03:31.737181 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:03:31.740666 (+ 3485us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:03:31.743291 (+ 2625us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:31.743301 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:31.743303 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:31.743600 (+ 297us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:31.744083 (+ 483us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:31.744084 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:31.744084 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:31.744213 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:31.744853 (+ 640us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:03:31.744869 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:03:31.745138 (+ 269us) client_negotiation.cc:769] Sending connection context
0811 08:03:31.745274 (+ 136us) client_negotiation.cc:240] Negotiation successful
0811 08:03:31.745503 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":152,"threads_started":1}
I20260811 08:03:31.746079 17457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:31.731641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:45671 (local address 127.15.36.254:42649)
0811 08:03:31.731722 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:31.731725 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:31.731992 (+ 267us) server_negotiation.cc:407] Connection header received
0811 08:03:31.732815 (+ 823us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:31.732817 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:31.732834 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:31.732931 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:31.733657 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:31.734370 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:31.735708 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:31.736044 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:31.736131 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:31.740858 (+ 4727us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:31.740860 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:31.740860 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:31.740872 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:31.743154 (+ 2282us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:31.743704 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:31.743705 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:31.743705 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:31.743769 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:31.744399 (+ 630us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:31.744401 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:31.744402 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:31.744647 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:31.744776 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:31.745645 (+ 869us) server_negotiation.cc:299] Negotiation successful
0811 08:03:31.745944 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 08:03:31.746682 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 17790
I20260811 08:03:31.746749 17931 heartbeater.cc:347] Connected to a master server at 127.15.36.254:42649
I20260811 08:03:31.746821 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/ts-2/wal/instance
I20260811 08:03:31.746871 17931 heartbeater.cc:464] Registering TS with master...
I20260811 08:03:31.747108 15507 external_mini_cluster.cc:1428] Setting key 24a01aab48d97d068a4b8729335678a0
I20260811 08:03:31.747370 17931 heartbeater.cc:511] Master 127.15.36.254:42649 requested a full tablet report, sending...
I20260811 08:03:31.747843 17402 ts_manager.cc:194] Registered new tserver with Master: 05672f65a17c42d7a7cba31d85700725 (127.15.36.195:38289)
I20260811 08:03:31.748306 15507 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 08:03:31.748518 17402 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.36.195@KRBTEST.COM'} at 127.15.36.195:45671
I20260811 08:03:31.758613 17938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:31.748305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:42649 (local address 127.15.36.195:47935)
0811 08:03:31.749213 (+ 908us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:31.749279 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:31.749382 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:31.749537 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:31.749538 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:31.749771 (+ 233us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:03:31.749835 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:31.749837 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:31.750592 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:31.750593 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:31.751365 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:31.751368 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:31.751822 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:31.751823 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:31.751912 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:31.752813 (+ 901us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:03:31.752821 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:03:31.753313 (+ 492us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:03:31.755554 (+ 2241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:31.755556 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:31.755556 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:31.756201 (+ 645us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:31.757490 (+ 1289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:31.757490 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:31.757491 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:31.757582 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:31.758257 (+ 675us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:03:31.758258 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:03:31.758316 (+ 58us) client_negotiation.cc:769] Sending connection context
0811 08:03:31.758384 (+ 68us) client_negotiation.cc:240] Negotiation successful
0811 08:03:31.758526 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":877,"thread_start_us":845,"threads_started":1}
I20260811 08:03:31.758857 17457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:31.748344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:47935 (local address 127.15.36.254:42649)
0811 08:03:31.749022 (+ 678us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:31.749025 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:31.749359 (+ 334us) server_negotiation.cc:407] Connection header received
0811 08:03:31.749455 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:31.749456 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:31.749468 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:31.749521 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:31.749927 (+ 406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:31.750477 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:31.751480 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:31.751710 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:31.751820 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:31.753440 (+ 1620us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:31.753442 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:31.753442 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:31.753450 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:31.755419 (+ 1969us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:31.756419 (+ 1000us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:31.756421 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:31.756421 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:31.756507 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:31.757902 (+ 1395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:31.757904 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:31.757904 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:31.758134 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:31.758243 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:31.758454 (+ 211us) server_negotiation.cc:299] Negotiation successful
0811 08:03:31.758572 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":639}
Aug 11 08:03:31 dist-test-slave-2w3w krb5kdc[17353](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435411, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 08:03:31 dist-test-slave-2w3w krb5kdc[17353](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435411, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:03:31.792886 17457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:31.781514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40508 (local address 127.15.36.254:42649)
0811 08:03:31.781609 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:31.781611 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:31.781621 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:03:31.781650 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:31.781651 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:31.781661 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:31.781772 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:31.782532 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:31.783224 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:31.784158 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:31.784382 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:31.784454 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:31.788136 (+ 3682us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:31.788138 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:31.788139 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:31.788157 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:31.790050 (+ 1893us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:31.790766 (+ 716us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:31.790767 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:31.790768 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:31.790908 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:31.791553 (+ 645us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:31.791554 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:31.791555 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:31.791699 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:31.791904 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:31.792108 (+ 204us) server_negotiation.cc:299] Negotiation successful
0811 08:03:31.792769 (+ 661us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 08:03:31.797832 17402 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40508:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:03:31.800357 17402 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:03:31.810760 17953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:31.804777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.193:34467 (local address 127.0.0.1:40060)
0811 08:03:31.805308 (+ 531us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:31.805324 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:31.805415 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:31.805823 (+ 408us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:31.805824 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:31.805827 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:03:31.805972 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:31.805975 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:31.807597 (+ 1622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:31.807598 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:31.809168 (+ 1570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:31.809170 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:31.810375 (+ 1205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:31.810376 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:31.810453 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:31.810469 (+ 16us) client_negotiation.cc:769] Sending connection context
0811 08:03:31.810553 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 08:03:31.810645 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":369,"mutex_wait_us":38,"thread_start_us":86,"threads_started":1}
I20260811 08:03:31.810765 17956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:31.805239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58786 (local address 127.15.36.195:38289)
0811 08:03:31.805526 (+ 287us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:31.805530 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:31.805539 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:03:31.805579 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:31.805581 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:31.805606 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:31.805706 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:03:31.806003 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:31.807429 (+ 1426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:31.809303 (+ 1874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:31.810119 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:31.810211 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:31.810278 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:31.810608 (+ 330us) server_negotiation.cc:299] Negotiation successful
0811 08:03:31.810657 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":254,"thread_start_us":90,"threads_started":1}
I20260811 08:03:31.811381 17955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:31.805072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40060 (local address 127.15.36.193:34467)
0811 08:03:31.805411 (+ 339us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:31.805417 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:31.805429 (+ 12us) server_negotiation.cc:407] Connection header received
0811 08:03:31.805650 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:31.805653 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:31.805672 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:31.805749 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:03:31.806050 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:31.807507 (+ 1457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:31.809347 (+ 1840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:31.810125 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:31.810210 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:31.810278 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:31.811266 (+ 988us) server_negotiation.cc:299] Negotiation successful
0811 08:03:31.811316 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":304,"thread_start_us":63,"threads_started":1}
I20260811 08:03:31.811488 17957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:31.805362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52822 (local address 127.15.36.194:45469)
0811 08:03:31.805704 (+ 342us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:31.805709 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:31.805718 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:03:31.805758 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:31.805760 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:31.805774 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:31.805848 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:03:31.805994 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:31.807164 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:31.808825 (+ 1661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:31.810390 (+ 1565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:31.810520 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:31.810619 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:31.810918 (+ 299us) server_negotiation.cc:299] Negotiation successful
0811 08:03:31.811035 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":304,"thread_start_us":125,"threads_started":1}
I20260811 08:03:31.811530 17954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:31.805019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.195:38289 (local address 127.0.0.1:58786)
0811 08:03:31.805415 (+ 396us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:31.805439 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:31.805494 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:31.805796 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:31.805799 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:31.805801 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:03:31.805904 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:31.805906 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:31.807545 (+ 1639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:31.807546 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:31.809165 (+ 1619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:31.809170 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:31.810332 (+ 1162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:31.810333 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:31.810453 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:31.810469 (+ 16us) client_negotiation.cc:769] Sending connection context
0811 08:03:31.810553 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 08:03:31.811027 (+ 474us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":374,"mutex_wait_us":483,"thread_start_us":79,"threads_started":1}
I20260811 08:03:31.811398 17952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:31.804777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.194:45469 (local address 127.0.0.1:52822)
0811 08:03:31.804956 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:31.805026 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:31.805557 (+ 531us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:31.805861 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:31.805862 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:31.805864 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:03:31.805904 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:31.805906 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:31.807283 (+ 1377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:31.807285 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:31.808667 (+ 1382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:31.808671 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:31.810675 (+ 2004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:31.810677 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:31.810791 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:31.810796 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 08:03:31.810890 (+ 94us) client_negotiation.cc:240] Negotiation successful
0811 08:03:31.811035 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":92,"threads_started":1}
I20260811 08:03:31.812623 17862 tablet_service.cc:1467] Processing CreateTablet for tablet 368fa49bff8f408e8cec06b9df3356ac (DEFAULT_TABLE table=test-table [id=92cb84e0271a47a68c1f659cefaf90ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:03:31.812992 17862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 368fa49bff8f408e8cec06b9df3356ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:03:31.813001 17710 tablet_service.cc:1467] Processing CreateTablet for tablet 368fa49bff8f408e8cec06b9df3356ac (DEFAULT_TABLE table=test-table [id=92cb84e0271a47a68c1f659cefaf90ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:03:31.813694 17710 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 368fa49bff8f408e8cec06b9df3356ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:03:31.815598 17556 tablet_service.cc:1467] Processing CreateTablet for tablet 368fa49bff8f408e8cec06b9df3356ac (DEFAULT_TABLE table=test-table [id=92cb84e0271a47a68c1f659cefaf90ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:03:31.816035 17556 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 368fa49bff8f408e8cec06b9df3356ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:03:31.816401 17958 tablet_bootstrap.cc:492] T 368fa49bff8f408e8cec06b9df3356ac P 05672f65a17c42d7a7cba31d85700725: Bootstrap starting.
I20260811 08:03:31.817648 17958 tablet_bootstrap.cc:654] T 368fa49bff8f408e8cec06b9df3356ac P 05672f65a17c42d7a7cba31d85700725: Neither blocks nor log segments found. Creating new log.
I20260811 08:03:31.817984 17958 log.cc:824] T 368fa49bff8f408e8cec06b9df3356ac P 05672f65a17c42d7a7cba31d85700725: Log is configured to *not* fsync() on all Append() calls
I20260811 08:03:31.818782 17960 tablet_bootstrap.cc:492] T 368fa49bff8f408e8cec06b9df3356ac P 47ba6728b7364e75abaa8cccf1382970: Bootstrap starting.
I20260811 08:03:31.819026 17958 tablet_bootstrap.cc:492] T 368fa49bff8f408e8cec06b9df3356ac P 05672f65a17c42d7a7cba31d85700725: No bootstrap required, opened a new log
I20260811 08:03:31.819106 17958 ts_tablet_manager.cc:1397] T 368fa49bff8f408e8cec06b9df3356ac P 05672f65a17c42d7a7cba31d85700725: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 08:03:31.819555 17961 tablet_bootstrap.cc:492] T 368fa49bff8f408e8cec06b9df3356ac P 6ef53eeb0b2b4676987701e7d3d273af: Bootstrap starting.
I20260811 08:03:31.819710 17960 tablet_bootstrap.cc:654] T 368fa49bff8f408e8cec06b9df3356ac P 47ba6728b7364e75abaa8cccf1382970: Neither blocks nor log segments found. Creating new log.
I20260811 08:03:31.820108 17960 log.cc:824] T 368fa49bff8f408e8cec06b9df3356ac P 47ba6728b7364e75abaa8cccf1382970: Log is configured to *not* fsync() on all Append() calls
I20260811 08:03:31.820218 17961 tablet_bootstrap.cc:654] T 368fa49bff8f408e8cec06b9df3356ac P 6ef53eeb0b2b4676987701e7d3d273af: Neither blocks nor log segments found. Creating new log.
I20260811 08:03:31.820729 17961 log.cc:824] T 368fa49bff8f408e8cec06b9df3356ac P 6ef53eeb0b2b4676987701e7d3d273af: Log is configured to *not* fsync() on all Append() calls
I20260811 08:03:31.821604 17961 tablet_bootstrap.cc:492] T 368fa49bff8f408e8cec06b9df3356ac P 6ef53eeb0b2b4676987701e7d3d273af: No bootstrap required, opened a new log
I20260811 08:03:31.821693 17961 ts_tablet_manager.cc:1397] T 368fa49bff8f408e8cec06b9df3356ac P 6ef53eeb0b2b4676987701e7d3d273af: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 08:03:31.822203 17958 raft_consensus.cc:348] T 368fa49bff8f408e8cec06b9df3356ac P 05672f65a17c42d7a7cba31d85700725 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef53eeb0b2b4676987701e7d3d273af" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 34467 } } peers { permanent_uuid: "47ba6728b7364e75abaa8cccf1382970" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45469 } } peers { permanent_uuid: "05672f65a17c42d7a7cba31d85700725" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 38289 } }
I20260811 08:03:31.822369 17958 raft_consensus.cc:374] T 368fa49bff8f408e8cec06b9df3356ac P 05672f65a17c42d7a7cba31d85700725 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:03:31.822393 17958 raft_consensus.cc:729] T 368fa49bff8f408e8cec06b9df3356ac P 05672f65a17c42d7a7cba31d85700725 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05672f65a17c42d7a7cba31d85700725, State: Initialized, Role: FOLLOWER
I20260811 08:03:31.822518 17958 consensus_queue.cc:260] T 368fa49bff8f408e8cec06b9df3356ac P 05672f65a17c42d7a7cba31d85700725 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef53eeb0b2b4676987701e7d3d273af" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 34467 } } peers { permanent_uuid: "47ba6728b7364e75abaa8cccf1382970" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45469 } } peers { permanent_uuid: "05672f65a17c42d7a7cba31d85700725" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 38289 } }
I20260811 08:03:31.823045 17958 ts_tablet_manager.cc:1428] T 368fa49bff8f408e8cec06b9df3356ac P 05672f65a17c42d7a7cba31d85700725: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260811 08:03:31.823060 17931 heartbeater.cc:503] Master 127.15.36.254:42649 was elected leader, sending a full tablet report...
I20260811 08:03:31.824210 17960 tablet_bootstrap.cc:492] T 368fa49bff8f408e8cec06b9df3356ac P 47ba6728b7364e75abaa8cccf1382970: No bootstrap required, opened a new log
I20260811 08:03:31.824329 17960 ts_tablet_manager.cc:1397] T 368fa49bff8f408e8cec06b9df3356ac P 47ba6728b7364e75abaa8cccf1382970: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260811 08:03:31.824659 17961 raft_consensus.cc:348] T 368fa49bff8f408e8cec06b9df3356ac P 6ef53eeb0b2b4676987701e7d3d273af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef53eeb0b2b4676987701e7d3d273af" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 34467 } } peers { permanent_uuid: "47ba6728b7364e75abaa8cccf1382970" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45469 } } peers { permanent_uuid: "05672f65a17c42d7a7cba31d85700725" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 38289 } }
I20260811 08:03:31.824848 17961 raft_consensus.cc:374] T 368fa49bff8f408e8cec06b9df3356ac P 6ef53eeb0b2b4676987701e7d3d273af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:03:31.824895 17961 raft_consensus.cc:729] T 368fa49bff8f408e8cec06b9df3356ac P 6ef53eeb0b2b4676987701e7d3d273af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ef53eeb0b2b4676987701e7d3d273af, State: Initialized, Role: FOLLOWER
I20260811 08:03:31.825039 17961 consensus_queue.cc:260] T 368fa49bff8f408e8cec06b9df3356ac P 6ef53eeb0b2b4676987701e7d3d273af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef53eeb0b2b4676987701e7d3d273af" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 34467 } } peers { permanent_uuid: "47ba6728b7364e75abaa8cccf1382970" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45469 } } peers { permanent_uuid: "05672f65a17c42d7a7cba31d85700725" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 38289 } }
I20260811 08:03:31.825380 17961 ts_tablet_manager.cc:1428] T 368fa49bff8f408e8cec06b9df3356ac P 6ef53eeb0b2b4676987701e7d3d273af: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260811 08:03:31.825433 17628 heartbeater.cc:503] Master 127.15.36.254:42649 was elected leader, sending a full tablet report...
I20260811 08:03:31.827118 17960 raft_consensus.cc:348] T 368fa49bff8f408e8cec06b9df3356ac P 47ba6728b7364e75abaa8cccf1382970 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef53eeb0b2b4676987701e7d3d273af" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 34467 } } peers { permanent_uuid: "47ba6728b7364e75abaa8cccf1382970" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45469 } } peers { permanent_uuid: "05672f65a17c42d7a7cba31d85700725" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 38289 } }
I20260811 08:03:31.827334 17960 raft_consensus.cc:374] T 368fa49bff8f408e8cec06b9df3356ac P 47ba6728b7364e75abaa8cccf1382970 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:03:31.827405 17960 raft_consensus.cc:729] T 368fa49bff8f408e8cec06b9df3356ac P 47ba6728b7364e75abaa8cccf1382970 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47ba6728b7364e75abaa8cccf1382970, State: Initialized, Role: FOLLOWER
I20260811 08:03:31.827554 17960 consensus_queue.cc:260] T 368fa49bff8f408e8cec06b9df3356ac P 47ba6728b7364e75abaa8cccf1382970 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef53eeb0b2b4676987701e7d3d273af" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 34467 } } peers { permanent_uuid: "47ba6728b7364e75abaa8cccf1382970" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45469 } } peers { permanent_uuid: "05672f65a17c42d7a7cba31d85700725" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 38289 } }
I20260811 08:03:31.827849 17960 ts_tablet_manager.cc:1428] T 368fa49bff8f408e8cec06b9df3356ac P 47ba6728b7364e75abaa8cccf1382970: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260811 08:03:31.827979 17779 heartbeater.cc:503] Master 127.15.36.254:42649 was elected leader, sending a full tablet report...
I20260811 08:03:31.876657 17964 raft_consensus.cc:482] T 368fa49bff8f408e8cec06b9df3356ac P 05672f65a17c42d7a7cba31d85700725 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:03:31.876821 17964 raft_consensus.cc:504] T 368fa49bff8f408e8cec06b9df3356ac P 05672f65a17c42d7a7cba31d85700725 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef53eeb0b2b4676987701e7d3d273af" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 34467 } } peers { permanent_uuid: "47ba6728b7364e75abaa8cccf1382970" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45469 } } peers { permanent_uuid: "05672f65a17c42d7a7cba31d85700725" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 38289 } }
I20260811 08:03:31.877188 17964 leader_election.cc:288] T 368fa49bff8f408e8cec06b9df3356ac P 05672f65a17c42d7a7cba31d85700725 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ef53eeb0b2b4676987701e7d3d273af (127.15.36.193:34467), 47ba6728b7364e75abaa8cccf1382970 (127.15.36.194:45469)
I20260811 08:03:31.881453 17819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:31.877448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.193:34467 (local address 127.15.36.195:60303)
0811 08:03:31.877688 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:31.877703 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:31.877765 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:31.877969 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:31.877970 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:31.877972 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:03:31.878054 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:31.878057 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:31.879095 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:31.879096 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:31.880242 (+ 1146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:31.880245 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:31.881071 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:31.881072 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:31.881207 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:31.881211 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:03:31.881277 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 08:03:31.881336 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":213}
I20260811 08:03:31.881544 17955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:31.877677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:60303 (local address 127.15.36.193:34467)
0811 08:03:31.877732 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:31.877735 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:31.877758 (+ 23us) server_negotiation.cc:407] Connection header received
0811 08:03:31.877841 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:31.877842 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:31.877853 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:31.877927 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:03:31.878347 (+ 420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:31.878902 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:31.880353 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:31.880958 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:31.881073 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:31.881084 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:31.881399 (+ 315us) server_negotiation.cc:299] Negotiation successful
0811 08:03:31.881457 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 08:03:31.881817 17957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:31.877759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:57133 (local address 127.15.36.194:45469)
0811 08:03:31.877804 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:31.877806 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:31.878011 (+ 205us) server_negotiation.cc:407] Connection header received
0811 08:03:31.878046 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:31.878047 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:31.878058 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:31.878128 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:03:31.878554 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:31.879257 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:31.880715 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:31.881355 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:31.881448 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:31.881458 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:31.881704 (+ 246us) server_negotiation.cc:299] Negotiation successful
0811 08:03:31.881751 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 08:03:31.881825 17967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:31.877683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.194:45469 (local address 127.15.36.195:57133)
0811 08:03:31.877886 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:31.877897 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:31.877960 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:31.878346 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:31.878346 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:31.878349 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:03:31.878426 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:31.878428 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:31.879367 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:31.879368 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:31.880587 (+ 1219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:31.880591 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:31.881519 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:31.881521 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:31.881603 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:31.881607 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:03:31.881691 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 08:03:31.881735 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":128,"threads_started":1}
I20260811 08:03:31.881944 17579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "368fa49bff8f408e8cec06b9df3356ac" candidate_uuid: "05672f65a17c42d7a7cba31d85700725" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ef53eeb0b2b4676987701e7d3d273af" is_pre_election: true
I20260811 08:03:31.882129 17732 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "368fa49bff8f408e8cec06b9df3356ac" candidate_uuid: "05672f65a17c42d7a7cba31d85700725" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47ba6728b7364e75abaa8cccf1382970" is_pre_election: true
I20260811 08:03:31.882172 17579 raft_consensus.cc:2454] T 368fa49bff8f408e8cec06b9df3356ac P 6ef53eeb0b2b4676987701e7d3d273af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05672f65a17c42d7a7cba31d85700725 in term 0.
I20260811 08:03:31.882292 17732 raft_consensus.cc:2454] T 368fa49bff8f408e8cec06b9df3356ac P 47ba6728b7364e75abaa8cccf1382970 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05672f65a17c42d7a7cba31d85700725 in term 0.
I20260811 08:03:31.882531 17810 leader_election.cc:302] T 368fa49bff8f408e8cec06b9df3356ac P 05672f65a17c42d7a7cba31d85700725 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05672f65a17c42d7a7cba31d85700725, 6ef53eeb0b2b4676987701e7d3d273af; no voters:
I20260811 08:03:31.882721 17964 raft_consensus.cc:2781] T 368fa49bff8f408e8cec06b9df3356ac P 05672f65a17c42d7a7cba31d85700725 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:03:31.882794 17964 raft_consensus.cc:482] T 368fa49bff8f408e8cec06b9df3356ac P 05672f65a17c42d7a7cba31d85700725 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:03:31.882814 17964 raft_consensus.cc:3037] T 368fa49bff8f408e8cec06b9df3356ac P 05672f65a17c42d7a7cba31d85700725 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:03:31.883714 17964 raft_consensus.cc:504] T 368fa49bff8f408e8cec06b9df3356ac P 05672f65a17c42d7a7cba31d85700725 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef53eeb0b2b4676987701e7d3d273af" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 34467 } } peers { permanent_uuid: "47ba6728b7364e75abaa8cccf1382970" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45469 } } peers { permanent_uuid: "05672f65a17c42d7a7cba31d85700725" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 38289 } }
I20260811 08:03:31.883988 17964 leader_election.cc:288] T 368fa49bff8f408e8cec06b9df3356ac P 05672f65a17c42d7a7cba31d85700725 [CANDIDATE]: Term 1 election: Requested vote from peers 6ef53eeb0b2b4676987701e7d3d273af (127.15.36.193:34467), 47ba6728b7364e75abaa8cccf1382970 (127.15.36.194:45469)
I20260811 08:03:31.884150 17579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "368fa49bff8f408e8cec06b9df3356ac" candidate_uuid: "05672f65a17c42d7a7cba31d85700725" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ef53eeb0b2b4676987701e7d3d273af"
I20260811 08:03:31.884225 17732 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "368fa49bff8f408e8cec06b9df3356ac" candidate_uuid: "05672f65a17c42d7a7cba31d85700725" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47ba6728b7364e75abaa8cccf1382970"
I20260811 08:03:31.884266 17579 raft_consensus.cc:3037] T 368fa49bff8f408e8cec06b9df3356ac P 6ef53eeb0b2b4676987701e7d3d273af [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:03:31.884312 17732 raft_consensus.cc:3037] T 368fa49bff8f408e8cec06b9df3356ac P 47ba6728b7364e75abaa8cccf1382970 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:03:31.885363 17579 raft_consensus.cc:2454] T 368fa49bff8f408e8cec06b9df3356ac P 6ef53eeb0b2b4676987701e7d3d273af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05672f65a17c42d7a7cba31d85700725 in term 1.
I20260811 08:03:31.885381 17732 raft_consensus.cc:2454] T 368fa49bff8f408e8cec06b9df3356ac P 47ba6728b7364e75abaa8cccf1382970 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05672f65a17c42d7a7cba31d85700725 in term 1.
I20260811 08:03:31.885896 17810 leader_election.cc:302] T 368fa49bff8f408e8cec06b9df3356ac P 05672f65a17c42d7a7cba31d85700725 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05672f65a17c42d7a7cba31d85700725, 6ef53eeb0b2b4676987701e7d3d273af; no voters:
I20260811 08:03:31.886085 17964 raft_consensus.cc:2781] T 368fa49bff8f408e8cec06b9df3356ac P 05672f65a17c42d7a7cba31d85700725 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:03:31.886299 17964 raft_consensus.cc:686] T 368fa49bff8f408e8cec06b9df3356ac P 05672f65a17c42d7a7cba31d85700725 [term 1 LEADER]: Becoming Leader. State: Replica: 05672f65a17c42d7a7cba31d85700725, State: Running, Role: LEADER
I20260811 08:03:31.886402 17964 consensus_queue.cc:237] T 368fa49bff8f408e8cec06b9df3356ac P 05672f65a17c42d7a7cba31d85700725 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef53eeb0b2b4676987701e7d3d273af" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 34467 } } peers { permanent_uuid: "47ba6728b7364e75abaa8cccf1382970" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45469 } } peers { permanent_uuid: "05672f65a17c42d7a7cba31d85700725" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 38289 } }
I20260811 08:03:31.888621 17402 catalog_manager.cc:5495] T 368fa49bff8f408e8cec06b9df3356ac P 05672f65a17c42d7a7cba31d85700725 reported cstate change: term changed from 0 to 1, leader changed from <none> to 05672f65a17c42d7a7cba31d85700725 (127.15.36.195). New cstate: current_term: 1 leader_uuid: "05672f65a17c42d7a7cba31d85700725" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef53eeb0b2b4676987701e7d3d273af" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 34467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47ba6728b7364e75abaa8cccf1382970" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05672f65a17c42d7a7cba31d85700725" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 38289 } health_report { overall_health: HEALTHY } } }
Aug 11 08:03:31 dist-test-slave-2w3w krb5kdc[17353](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435410, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.254@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:03:31.933522 17976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:31.924218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:42649 (local address 127.0.0.1:40522)
0811 08:03:31.924515 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:31.924527 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:31.924630 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:31.925190 (+ 560us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:31.925191 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:31.925606 (+ 415us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:03:31.925659 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:31.925662 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:31.926378 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:31.926379 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:31.927158 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:31.927162 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:31.927558 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:31.927559 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:31.927609 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:31.928227 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:03:31.928232 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:03:31.929874 (+ 1642us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:03:31.932157 (+ 2283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:31.932173 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:31.932176 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:31.932424 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:31.932680 (+ 256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:31.932680 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:31.932681 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:31.932755 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:31.933059 (+ 304us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:03:31.933070 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:03:31.933120 (+ 50us) client_negotiation.cc:769] Sending connection context
0811 08:03:31.933211 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 08:03:31.933431 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"mutex_wait_us":93,"thread_start_us":158,"threads_started":1}
I20260811 08:03:31.933504 17457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:31.924354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40522 (local address 127.15.36.254:42649)
0811 08:03:31.924497 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:31.924499 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:31.924606 (+ 107us) server_negotiation.cc:407] Connection header received
0811 08:03:31.924705 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:31.924705 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:31.924718 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:31.924969 (+ 251us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:31.925766 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:31.926274 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:31.927246 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:31.927437 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:31.927530 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:31.929990 (+ 2460us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:31.929992 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:31.929992 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:31.930082 (+ 90us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:31.931817 (+ 1735us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:31.932539 (+ 722us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:31.932540 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:31.932541 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:31.932602 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:31.932819 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:31.932820 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:31.932820 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:31.932951 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:31.933059 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:31.933236 (+ 177us) server_negotiation.cc:299] Negotiation successful
0811 08:03:31.933364 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
I20260811 08:03:31.936823 17402 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.15.36.254@KRBTEST.COM'} at 127.0.0.1:40522:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 08:03:31.937387 17402 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:03:31.939721 17710 tablet_service.cc:1467] Processing CreateTablet for tablet 475ebd589a1543ad884bd84163c03195 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=978802ee300e46ffbd68398e866be02f]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 08:03:31.939740 17556 tablet_service.cc:1467] Processing CreateTablet for tablet 475ebd589a1543ad884bd84163c03195 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=978802ee300e46ffbd68398e866be02f]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 08:03:31.939953 17710 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 475ebd589a1543ad884bd84163c03195. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:03:31.939962 17862 tablet_service.cc:1467] Processing CreateTablet for tablet 475ebd589a1543ad884bd84163c03195 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=978802ee300e46ffbd68398e866be02f]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 08:03:31.940023 17556 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 475ebd589a1543ad884bd84163c03195. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:03:31.940124 17862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 475ebd589a1543ad884bd84163c03195. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:03:31.941709 17960 tablet_bootstrap.cc:492] T 475ebd589a1543ad884bd84163c03195 P 47ba6728b7364e75abaa8cccf1382970: Bootstrap starting.
I20260811 08:03:31.942006 17958 tablet_bootstrap.cc:492] T 475ebd589a1543ad884bd84163c03195 P 05672f65a17c42d7a7cba31d85700725: Bootstrap starting.
I20260811 08:03:31.942713 17958 tablet_bootstrap.cc:654] T 475ebd589a1543ad884bd84163c03195 P 05672f65a17c42d7a7cba31d85700725: Neither blocks nor log segments found. Creating new log.
I20260811 08:03:31.942811 17960 tablet_bootstrap.cc:654] T 475ebd589a1543ad884bd84163c03195 P 47ba6728b7364e75abaa8cccf1382970: Neither blocks nor log segments found. Creating new log.
I20260811 08:03:31.943058 17961 tablet_bootstrap.cc:492] T 475ebd589a1543ad884bd84163c03195 P 6ef53eeb0b2b4676987701e7d3d273af: Bootstrap starting.
I20260811 08:03:31.943470 17961 tablet_bootstrap.cc:654] T 475ebd589a1543ad884bd84163c03195 P 6ef53eeb0b2b4676987701e7d3d273af: Neither blocks nor log segments found. Creating new log.
I20260811 08:03:31.943892 17960 tablet_bootstrap.cc:492] T 475ebd589a1543ad884bd84163c03195 P 47ba6728b7364e75abaa8cccf1382970: No bootstrap required, opened a new log
I20260811 08:03:31.943945 17960 ts_tablet_manager.cc:1397] T 475ebd589a1543ad884bd84163c03195 P 47ba6728b7364e75abaa8cccf1382970: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 08:03:31.944128 17960 raft_consensus.cc:348] T 475ebd589a1543ad884bd84163c03195 P 47ba6728b7364e75abaa8cccf1382970 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef53eeb0b2b4676987701e7d3d273af" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 34467 } } peers { permanent_uuid: "47ba6728b7364e75abaa8cccf1382970" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45469 } } peers { permanent_uuid: "05672f65a17c42d7a7cba31d85700725" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 38289 } }
I20260811 08:03:31.944212 17960 raft_consensus.cc:374] T 475ebd589a1543ad884bd84163c03195 P 47ba6728b7364e75abaa8cccf1382970 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:03:31.944238 17960 raft_consensus.cc:729] T 475ebd589a1543ad884bd84163c03195 P 47ba6728b7364e75abaa8cccf1382970 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47ba6728b7364e75abaa8cccf1382970, State: Initialized, Role: FOLLOWER
I20260811 08:03:31.944298 17960 consensus_queue.cc:260] T 475ebd589a1543ad884bd84163c03195 P 47ba6728b7364e75abaa8cccf1382970 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef53eeb0b2b4676987701e7d3d273af" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 34467 } } peers { permanent_uuid: "47ba6728b7364e75abaa8cccf1382970" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45469 } } peers { permanent_uuid: "05672f65a17c42d7a7cba31d85700725" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 38289 } }
I20260811 08:03:31.944363 17961 tablet_bootstrap.cc:492] T 475ebd589a1543ad884bd84163c03195 P 6ef53eeb0b2b4676987701e7d3d273af: No bootstrap required, opened a new log
I20260811 08:03:31.944407 17960 ts_tablet_manager.cc:1428] T 475ebd589a1543ad884bd84163c03195 P 47ba6728b7364e75abaa8cccf1382970: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:31.944408 17961 ts_tablet_manager.cc:1397] T 475ebd589a1543ad884bd84163c03195 P 6ef53eeb0b2b4676987701e7d3d273af: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 08:03:31.944572 17961 raft_consensus.cc:348] T 475ebd589a1543ad884bd84163c03195 P 6ef53eeb0b2b4676987701e7d3d273af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef53eeb0b2b4676987701e7d3d273af" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 34467 } } peers { permanent_uuid: "47ba6728b7364e75abaa8cccf1382970" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45469 } } peers { permanent_uuid: "05672f65a17c42d7a7cba31d85700725" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 38289 } }
I20260811 08:03:31.944655 17961 raft_consensus.cc:374] T 475ebd589a1543ad884bd84163c03195 P 6ef53eeb0b2b4676987701e7d3d273af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:03:31.944670 17961 raft_consensus.cc:729] T 475ebd589a1543ad884bd84163c03195 P 6ef53eeb0b2b4676987701e7d3d273af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ef53eeb0b2b4676987701e7d3d273af, State: Initialized, Role: FOLLOWER
I20260811 08:03:31.944490 17966 tablet_replica.cc:439] T 475ebd589a1543ad884bd84163c03195 P 47ba6728b7364e75abaa8cccf1382970: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef53eeb0b2b4676987701e7d3d273af" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 34467 } } peers { permanent_uuid: "47ba6728b7364e75abaa8cccf1382970" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45469 } } peers { permanent_uuid: "05672f65a17c42d7a7cba31d85700725" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 38289 } } }
I20260811 08:03:31.944746 17961 consensus_queue.cc:260] T 475ebd589a1543ad884bd84163c03195 P 6ef53eeb0b2b4676987701e7d3d273af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef53eeb0b2b4676987701e7d3d273af" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 34467 } } peers { permanent_uuid: "47ba6728b7364e75abaa8cccf1382970" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45469 } } peers { permanent_uuid: "05672f65a17c42d7a7cba31d85700725" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 38289 } }
I20260811 08:03:31.944851 17961 ts_tablet_manager.cc:1428] T 475ebd589a1543ad884bd84163c03195 P 6ef53eeb0b2b4676987701e7d3d273af: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:31.944876 17966 tablet_replica.cc:442] T 475ebd589a1543ad884bd84163c03195 P 47ba6728b7364e75abaa8cccf1382970: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 08:03:31.945183 17965 tablet_replica.cc:439] T 475ebd589a1543ad884bd84163c03195 P 6ef53eeb0b2b4676987701e7d3d273af: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef53eeb0b2b4676987701e7d3d273af" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 34467 } } peers { permanent_uuid: "47ba6728b7364e75abaa8cccf1382970" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45469 } } peers { permanent_uuid: "05672f65a17c42d7a7cba31d85700725" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 38289 } } }
I20260811 08:03:31.945278 17965 tablet_replica.cc:442] T 475ebd589a1543ad884bd84163c03195 P 6ef53eeb0b2b4676987701e7d3d273af: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 08:03:31.945642 17958 tablet_bootstrap.cc:492] T 475ebd589a1543ad884bd84163c03195 P 05672f65a17c42d7a7cba31d85700725: No bootstrap required, opened a new log
I20260811 08:03:31.945727 17958 ts_tablet_manager.cc:1397] T 475ebd589a1543ad884bd84163c03195 P 05672f65a17c42d7a7cba31d85700725: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260811 08:03:31.945916 17958 raft_consensus.cc:348] T 475ebd589a1543ad884bd84163c03195 P 05672f65a17c42d7a7cba31d85700725 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef53eeb0b2b4676987701e7d3d273af" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 34467 } } peers { permanent_uuid: "47ba6728b7364e75abaa8cccf1382970" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45469 } } peers { permanent_uuid: "05672f65a17c42d7a7cba31d85700725" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 38289 } }
I20260811 08:03:31.946009 17958 raft_consensus.cc:374] T 475ebd589a1543ad884bd84163c03195 P 05672f65a17c42d7a7cba31d85700725 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:03:31.946051 17958 raft_consensus.cc:729] T 475ebd589a1543ad884bd84163c03195 P 05672f65a17c42d7a7cba31d85700725 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05672f65a17c42d7a7cba31d85700725, State: Initialized, Role: FOLLOWER
I20260811 08:03:31.946102 17958 consensus_queue.cc:260] T 475ebd589a1543ad884bd84163c03195 P 05672f65a17c42d7a7cba31d85700725 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef53eeb0b2b4676987701e7d3d273af" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 34467 } } peers { permanent_uuid: "47ba6728b7364e75abaa8cccf1382970" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45469 } } peers { permanent_uuid: "05672f65a17c42d7a7cba31d85700725" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 38289 } }
I20260811 08:03:31.946233 17958 ts_tablet_manager.cc:1428] T 475ebd589a1543ad884bd84163c03195 P 05672f65a17c42d7a7cba31d85700725: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:31.946326 17964 tablet_replica.cc:439] T 475ebd589a1543ad884bd84163c03195 P 05672f65a17c42d7a7cba31d85700725: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef53eeb0b2b4676987701e7d3d273af" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 34467 } } peers { permanent_uuid: "47ba6728b7364e75abaa8cccf1382970" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45469 } } peers { permanent_uuid: "05672f65a17c42d7a7cba31d85700725" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 38289 } } }
I20260811 08:03:31.946449 17964 tablet_replica.cc:442] T 475ebd589a1543ad884bd84163c03195 P 05672f65a17c42d7a7cba31d85700725: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 08:03:31.970294 17965 raft_consensus.cc:482] T 475ebd589a1543ad884bd84163c03195 P 6ef53eeb0b2b4676987701e7d3d273af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:03:31.970429 17965 raft_consensus.cc:504] T 475ebd589a1543ad884bd84163c03195 P 6ef53eeb0b2b4676987701e7d3d273af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef53eeb0b2b4676987701e7d3d273af" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 34467 } } peers { permanent_uuid: "47ba6728b7364e75abaa8cccf1382970" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45469 } } peers { permanent_uuid: "05672f65a17c42d7a7cba31d85700725" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 38289 } }
I20260811 08:03:31.970911 17965 leader_election.cc:288] T 475ebd589a1543ad884bd84163c03195 P 6ef53eeb0b2b4676987701e7d3d273af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47ba6728b7364e75abaa8cccf1382970 (127.15.36.194:45469), 05672f65a17c42d7a7cba31d85700725 (127.15.36.195:38289)
I20260811 08:03:31.976370 17957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:31.971257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:37257 (local address 127.15.36.194:45469)
0811 08:03:31.971340 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:31.971342 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:31.971564 (+ 222us) server_negotiation.cc:407] Connection header received
0811 08:03:31.971688 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:31.971700 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:31.971712 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:31.971784 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:03:31.972408 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:31.973669 (+ 1261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:31.975015 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:31.975626 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:31.975705 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:31.975713 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:31.976207 (+ 494us) server_negotiation.cc:299] Negotiation successful
0811 08:03:31.976287 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 08:03:31.976763 17980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:31.971175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.194:45469 (local address 127.15.36.193:37257)
0811 08:03:31.971459 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:31.971475 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:31.971607 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:31.971804 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:31.971805 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:31.971807 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:03:31.972186 (+ 379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:31.972198 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:31.973794 (+ 1596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:31.973796 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:31.974857 (+ 1061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:31.974874 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:31.975799 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:31.975800 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:31.975890 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:31.975895 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 08:03:31.976119 (+ 224us) client_negotiation.cc:240] Negotiation successful
0811 08:03:31.976195 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":238,"mutex_wait_us":19,"thread_start_us":148,"threads_started":1}
I20260811 08:03:31.977074 17956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:31.971593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:42125 (local address 127.15.36.195:38289)
0811 08:03:31.971670 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:31.971672 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:31.971680 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:03:31.971708 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:31.971709 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:31.971718 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:31.971784 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:03:31.972409 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:31.973679 (+ 1270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:31.975295 (+ 1616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:31.976065 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:31.976149 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:31.976159 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:31.976941 (+ 782us) server_negotiation.cc:299] Negotiation successful
0811 08:03:31.977003 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 08:03:31.977072 17732 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "475ebd589a1543ad884bd84163c03195" candidate_uuid: "6ef53eeb0b2b4676987701e7d3d273af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47ba6728b7364e75abaa8cccf1382970" is_pre_election: true
I20260811 08:03:31.977041 17981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:31.971452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.195:38289 (local address 127.15.36.193:42125)
0811 08:03:31.971587 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:31.971599 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:31.971650 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:31.971806 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:31.971806 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:31.971808 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:03:31.972186 (+ 378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:31.972198 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:31.973805 (+ 1607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:31.973807 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:31.975090 (+ 1283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:31.975095 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:31.976216 (+ 1121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:31.976218 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:31.976391 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:31.976396 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 08:03:31.976467 (+ 71us) client_negotiation.cc:240] Negotiation successful
0811 08:03:31.976578 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"mutex_wait_us":43,"thread_start_us":85,"threads_started":1}
I20260811 08:03:31.977183 17732 raft_consensus.cc:2454] T 475ebd589a1543ad884bd84163c03195 P 47ba6728b7364e75abaa8cccf1382970 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ef53eeb0b2b4676987701e7d3d273af in term 0.
I20260811 08:03:31.977443 17504 leader_election.cc:302] T 475ebd589a1543ad884bd84163c03195 P 6ef53eeb0b2b4676987701e7d3d273af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47ba6728b7364e75abaa8cccf1382970, 6ef53eeb0b2b4676987701e7d3d273af; no voters:
I20260811 08:03:31.977639 17965 raft_consensus.cc:2781] T 475ebd589a1543ad884bd84163c03195 P 6ef53eeb0b2b4676987701e7d3d273af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:03:31.977568 17883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "475ebd589a1543ad884bd84163c03195" candidate_uuid: "6ef53eeb0b2b4676987701e7d3d273af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05672f65a17c42d7a7cba31d85700725" is_pre_election: true
I20260811 08:03:31.977720 17965 raft_consensus.cc:482] T 475ebd589a1543ad884bd84163c03195 P 6ef53eeb0b2b4676987701e7d3d273af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:03:31.977748 17965 raft_consensus.cc:3037] T 475ebd589a1543ad884bd84163c03195 P 6ef53eeb0b2b4676987701e7d3d273af [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:03:31.977769 17883 raft_consensus.cc:2454] T 475ebd589a1543ad884bd84163c03195 P 05672f65a17c42d7a7cba31d85700725 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ef53eeb0b2b4676987701e7d3d273af in term 0.
I20260811 08:03:31.978613 17965 raft_consensus.cc:504] T 475ebd589a1543ad884bd84163c03195 P 6ef53eeb0b2b4676987701e7d3d273af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef53eeb0b2b4676987701e7d3d273af" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 34467 } } peers { permanent_uuid: "47ba6728b7364e75abaa8cccf1382970" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45469 } } peers { permanent_uuid: "05672f65a17c42d7a7cba31d85700725" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 38289 } }
I20260811 08:03:31.978793 17965 leader_election.cc:288] T 475ebd589a1543ad884bd84163c03195 P 6ef53eeb0b2b4676987701e7d3d273af [CANDIDATE]: Term 1 election: Requested vote from peers 47ba6728b7364e75abaa8cccf1382970 (127.15.36.194:45469), 05672f65a17c42d7a7cba31d85700725 (127.15.36.195:38289)
I20260811 08:03:31.979254 17883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "475ebd589a1543ad884bd84163c03195" candidate_uuid: "6ef53eeb0b2b4676987701e7d3d273af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05672f65a17c42d7a7cba31d85700725"
I20260811 08:03:31.979079 17732 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "475ebd589a1543ad884bd84163c03195" candidate_uuid: "6ef53eeb0b2b4676987701e7d3d273af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47ba6728b7364e75abaa8cccf1382970"
I20260811 08:03:31.979416 17883 raft_consensus.cc:3037] T 475ebd589a1543ad884bd84163c03195 P 05672f65a17c42d7a7cba31d85700725 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:03:31.979425 17732 raft_consensus.cc:3037] T 475ebd589a1543ad884bd84163c03195 P 47ba6728b7364e75abaa8cccf1382970 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:03:31.980661 17732 raft_consensus.cc:2454] T 475ebd589a1543ad884bd84163c03195 P 47ba6728b7364e75abaa8cccf1382970 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ef53eeb0b2b4676987701e7d3d273af in term 1.
I20260811 08:03:31.980688 17883 raft_consensus.cc:2454] T 475ebd589a1543ad884bd84163c03195 P 05672f65a17c42d7a7cba31d85700725 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ef53eeb0b2b4676987701e7d3d273af in term 1.
W20260811 08:03:31.980825 17781 tablet.cc:2369] T 368fa49bff8f408e8cec06b9df3356ac P 47ba6728b7364e75abaa8cccf1382970: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:03:31.980985 17504 leader_election.cc:302] T 475ebd589a1543ad884bd84163c03195 P 6ef53eeb0b2b4676987701e7d3d273af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47ba6728b7364e75abaa8cccf1382970, 6ef53eeb0b2b4676987701e7d3d273af; no voters:
I20260811 08:03:31.981128 17965 raft_consensus.cc:2781] T 475ebd589a1543ad884bd84163c03195 P 6ef53eeb0b2b4676987701e7d3d273af [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:03:31.981343 17965 raft_consensus.cc:686] T 475ebd589a1543ad884bd84163c03195 P 6ef53eeb0b2b4676987701e7d3d273af [term 1 LEADER]: Becoming Leader. State: Replica: 6ef53eeb0b2b4676987701e7d3d273af, State: Running, Role: LEADER
I20260811 08:03:31.981477 17965 consensus_queue.cc:237] T 475ebd589a1543ad884bd84163c03195 P 6ef53eeb0b2b4676987701e7d3d273af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef53eeb0b2b4676987701e7d3d273af" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 34467 } } peers { permanent_uuid: "47ba6728b7364e75abaa8cccf1382970" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45469 } } peers { permanent_uuid: "05672f65a17c42d7a7cba31d85700725" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 38289 } }
I20260811 08:03:31.982300 17982 tablet_replica.cc:439] T 475ebd589a1543ad884bd84163c03195 P 6ef53eeb0b2b4676987701e7d3d273af: TxnStatusTablet state changed. Reason: New leader 6ef53eeb0b2b4676987701e7d3d273af. Latest consensus state: current_term: 1 leader_uuid: "6ef53eeb0b2b4676987701e7d3d273af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef53eeb0b2b4676987701e7d3d273af" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 34467 } } peers { permanent_uuid: "47ba6728b7364e75abaa8cccf1382970" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45469 } } peers { permanent_uuid: "05672f65a17c42d7a7cba31d85700725" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 38289 } } }
I20260811 08:03:31.982419 17982 tablet_replica.cc:442] T 475ebd589a1543ad884bd84163c03195 P 6ef53eeb0b2b4676987701e7d3d273af: This TxnStatusTablet replica's current role is: LEADER
I20260811 08:03:31.982643 17984 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 08:03:31.982637 17401 catalog_manager.cc:5495] T 475ebd589a1543ad884bd84163c03195 P 6ef53eeb0b2b4676987701e7d3d273af reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ef53eeb0b2b4676987701e7d3d273af (127.15.36.193). New cstate: current_term: 1 leader_uuid: "6ef53eeb0b2b4676987701e7d3d273af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef53eeb0b2b4676987701e7d3d273af" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 34467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47ba6728b7364e75abaa8cccf1382970" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05672f65a17c42d7a7cba31d85700725" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 38289 } health_report { overall_health: UNKNOWN } } }
I20260811 08:03:31.982870 17984 txn_status_manager.cc:929] Loading transaction status metadata into memory...
W20260811 08:03:31.992460 17933 tablet.cc:2369] T 368fa49bff8f408e8cec06b9df3356ac P 05672f65a17c42d7a7cba31d85700725: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:03:31.998185 17976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:31.995219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.193:34467 (local address 127.0.0.1:40072)
0811 08:03:31.995394 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:31.995405 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:31.995462 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:31.995707 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:31.995708 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:31.995710 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 08:03:31.995772 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:31.995775 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:31.996514 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:31.996516 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:31.997163 (+ 647us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:31.997165 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:31.997582 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:31.997583 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:31.997652 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:31.997672 (+ 20us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 08:03:31.997994 (+ 322us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 08:03:31.998005 (+ 11us) client_negotiation.cc:769] Sending connection context
0811 08:03:31.998057 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 08:03:31.998115 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130}
I20260811 08:03:31.998178 17955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:31.995306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40072 (local address 127.15.36.193:34467)
0811 08:03:31.995369 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:31.995371 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:31.995440 (+ 69us) server_negotiation.cc:407] Connection header received
0811 08:03:31.995552 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:31.995553 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:31.995621 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:31.995711 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:03:31.995844 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:31.996398 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:31.997265 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:31.997493 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:31.997570 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:31.997795 (+ 225us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:03:31.997912 (+ 117us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:03:31.998019 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:31.998065 (+ 46us) server_negotiation.cc:299] Negotiation successful
0811 08:03:31.998091 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 08:03:32.001163 17883 raft_consensus.cc:1261] T 475ebd589a1543ad884bd84163c03195 P 05672f65a17c42d7a7cba31d85700725 [term 1 FOLLOWER]: Refusing update from remote peer 6ef53eeb0b2b4676987701e7d3d273af: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:03:32.001163 17732 raft_consensus.cc:1261] T 475ebd589a1543ad884bd84163c03195 P 47ba6728b7364e75abaa8cccf1382970 [term 1 FOLLOWER]: Refusing update from remote peer 6ef53eeb0b2b4676987701e7d3d273af: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:03:32.001611 17965 consensus_queue.cc:1035] T 475ebd589a1543ad884bd84163c03195 P 6ef53eeb0b2b4676987701e7d3d273af [LEADER]: Connected to new peer: Peer: permanent_uuid: "05672f65a17c42d7a7cba31d85700725" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 38289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:03:32.001849 17965 consensus_queue.cc:1035] T 475ebd589a1543ad884bd84163c03195 P 6ef53eeb0b2b4676987701e7d3d273af [LEADER]: Connected to new peer: Peer: permanent_uuid: "47ba6728b7364e75abaa8cccf1382970" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:03:32.003265 17966 tablet_replica.cc:439] T 475ebd589a1543ad884bd84163c03195 P 47ba6728b7364e75abaa8cccf1382970: TxnStatusTablet state changed. Reason: New leader 6ef53eeb0b2b4676987701e7d3d273af. Latest consensus state: current_term: 1 leader_uuid: "6ef53eeb0b2b4676987701e7d3d273af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef53eeb0b2b4676987701e7d3d273af" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 34467 } } peers { permanent_uuid: "47ba6728b7364e75abaa8cccf1382970" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45469 } } peers { permanent_uuid: "05672f65a17c42d7a7cba31d85700725" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 38289 } } }
I20260811 08:03:32.003502 17966 tablet_replica.cc:442] T 475ebd589a1543ad884bd84163c03195 P 47ba6728b7364e75abaa8cccf1382970: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 08:03:32.003547 17964 tablet_replica.cc:439] T 475ebd589a1543ad884bd84163c03195 P 05672f65a17c42d7a7cba31d85700725: TxnStatusTablet state changed. Reason: New leader 6ef53eeb0b2b4676987701e7d3d273af. Latest consensus state: current_term: 1 leader_uuid: "6ef53eeb0b2b4676987701e7d3d273af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef53eeb0b2b4676987701e7d3d273af" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 34467 } } peers { permanent_uuid: "47ba6728b7364e75abaa8cccf1382970" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45469 } } peers { permanent_uuid: "05672f65a17c42d7a7cba31d85700725" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 38289 } } }
I20260811 08:03:32.003945 17964 tablet_replica.cc:442] T 475ebd589a1543ad884bd84163c03195 P 05672f65a17c42d7a7cba31d85700725: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 08:03:32.005429 17982 tablet_replica.cc:439] T 475ebd589a1543ad884bd84163c03195 P 6ef53eeb0b2b4676987701e7d3d273af: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6ef53eeb0b2b4676987701e7d3d273af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef53eeb0b2b4676987701e7d3d273af" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 34467 } } peers { permanent_uuid: "47ba6728b7364e75abaa8cccf1382970" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45469 } } peers { permanent_uuid: "05672f65a17c42d7a7cba31d85700725" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 38289 } } }
I20260811 08:03:32.005553 17982 tablet_replica.cc:442] T 475ebd589a1543ad884bd84163c03195 P 6ef53eeb0b2b4676987701e7d3d273af: This TxnStatusTablet replica's current role is: LEADER
I20260811 08:03:32.005605 17982 tablet_replica.cc:439] T 475ebd589a1543ad884bd84163c03195 P 6ef53eeb0b2b4676987701e7d3d273af: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6ef53eeb0b2b4676987701e7d3d273af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef53eeb0b2b4676987701e7d3d273af" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 34467 } } peers { permanent_uuid: "47ba6728b7364e75abaa8cccf1382970" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45469 } } peers { permanent_uuid: "05672f65a17c42d7a7cba31d85700725" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 38289 } } }
I20260811 08:03:32.005648 17982 tablet_replica.cc:442] T 475ebd589a1543ad884bd84163c03195 P 6ef53eeb0b2b4676987701e7d3d273af: This TxnStatusTablet replica's current role is: LEADER
I20260811 08:03:32.005661 17964 tablet_replica.cc:439] T 475ebd589a1543ad884bd84163c03195 P 05672f65a17c42d7a7cba31d85700725: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6ef53eeb0b2b4676987701e7d3d273af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef53eeb0b2b4676987701e7d3d273af" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 34467 } } peers { permanent_uuid: "47ba6728b7364e75abaa8cccf1382970" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45469 } } peers { permanent_uuid: "05672f65a17c42d7a7cba31d85700725" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 38289 } } }
I20260811 08:03:32.005658 17966 tablet_replica.cc:439] T 475ebd589a1543ad884bd84163c03195 P 47ba6728b7364e75abaa8cccf1382970: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6ef53eeb0b2b4676987701e7d3d273af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef53eeb0b2b4676987701e7d3d273af" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 34467 } } peers { permanent_uuid: "47ba6728b7364e75abaa8cccf1382970" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45469 } } peers { permanent_uuid: "05672f65a17c42d7a7cba31d85700725" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 38289 } } }
I20260811 08:03:32.005752 17964 tablet_replica.cc:442] T 475ebd589a1543ad884bd84163c03195 P 05672f65a17c42d7a7cba31d85700725: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 08:03:32.005752 17966 tablet_replica.cc:442] T 475ebd589a1543ad884bd84163c03195 P 47ba6728b7364e75abaa8cccf1382970: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 08:03:32.005888 17988 mvcc.cc:205] Tried to move back new op lower bound from 7317239447550734336 to 7317239447476891648. Current Snapshot: MvccSnapshot[applied={T|T < 7317239447550734336}]
I20260811 08:03:32.006403 17987 mvcc.cc:205] Tried to move back new op lower bound from 7317239447550734336 to 7317239447476891648. Current Snapshot: MvccSnapshot[applied={T|T < 7317239447550734336}]
I20260811 08:03:32.007076 17989 mvcc.cc:205] Tried to move back new op lower bound from 7317239447550734336 to 7317239447476891648. Current Snapshot: MvccSnapshot[applied={T|T < 7317239447550734336}]
W20260811 08:03:32.009127 17629 tablet.cc:2369] T 368fa49bff8f408e8cec06b9df3356ac P 6ef53eeb0b2b4676987701e7d3d273af: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:03:32.015540 17956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:32.011769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58796 (local address 127.15.36.195:38289)
0811 08:03:32.011830 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:32.011832 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:32.011840 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:03:32.011891 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:32.011891 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:32.011910 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:32.011972 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:03:32.012403 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:32.013399 (+ 996us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:32.014623 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:32.014829 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:32.014896 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:32.015134 (+ 238us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:03:32.015261 (+ 127us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:03:32.015327 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:32.015400 (+ 73us) server_negotiation.cc:299] Negotiation successful
0811 08:03:32.015424 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 08:03:32.023623 17938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:32.018350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.193:34467 (local address 127.15.36.195:51111)
0811 08:03:32.018573 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:32.018590 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:32.018648 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:32.019519 (+ 871us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:32.019521 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:32.019522 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 08:03:32.019606 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:32.019608 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:32.020746 (+ 1138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:32.020748 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:32.021725 (+ 977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:32.021728 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:32.022596 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:32.022597 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:32.022679 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:32.022714 (+ 35us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 08:03:32.023388 (+ 674us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 08:03:32.023390 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 08:03:32.023456 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 08:03:32.023521 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169}
I20260811 08:03:32.023675 17955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:32.019006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:51111 (local address 127.15.36.193:34467)
0811 08:03:32.019277 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:32.019280 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:32.019372 (+ 92us) server_negotiation.cc:407] Connection header received
0811 08:03:32.019404 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:32.019405 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:32.019417 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:32.019481 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:03:32.019756 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:32.020631 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:32.021915 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:32.022489 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:32.022566 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:32.022915 (+ 349us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:03:32.022950 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:03:32.023375 (+ 425us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:32.023566 (+ 191us) server_negotiation.cc:299] Negotiation successful
0811 08:03:32.023599 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":242}
I20260811 08:03:32.030360 17732 raft_consensus.cc:1261] T 368fa49bff8f408e8cec06b9df3356ac P 47ba6728b7364e75abaa8cccf1382970 [term 1 FOLLOWER]: Refusing update from remote peer 05672f65a17c42d7a7cba31d85700725: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:03:32.030604 17579 raft_consensus.cc:1261] T 368fa49bff8f408e8cec06b9df3356ac P 6ef53eeb0b2b4676987701e7d3d273af [term 1 FOLLOWER]: Refusing update from remote peer 05672f65a17c42d7a7cba31d85700725: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:03:32.030740 17968 consensus_queue.cc:1035] T 368fa49bff8f408e8cec06b9df3356ac P 05672f65a17c42d7a7cba31d85700725 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47ba6728b7364e75abaa8cccf1382970" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:03:32.030907 17964 consensus_queue.cc:1035] T 368fa49bff8f408e8cec06b9df3356ac P 05672f65a17c42d7a7cba31d85700725 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ef53eeb0b2b4676987701e7d3d273af" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 34467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:03:32.049399 17956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:32.046215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:42201 (local address 127.15.36.195:38289)
0811 08:03:32.046278 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:32.046281 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:32.046464 (+ 183us) server_negotiation.cc:407] Connection header received
0811 08:03:32.046505 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:32.046506 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:32.046518 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:32.046577 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:03:32.046815 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:32.047448 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:32.048588 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:32.048800 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:32.048881 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:32.049070 (+ 189us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:03:32.049110 (+ 40us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:03:32.049161 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:32.049272 (+ 111us) server_negotiation.cc:299] Negotiation successful
0811 08:03:32.049309 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 08:03:32.049413 18005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:32.046123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.195:38289 (local address 127.15.36.193:42201)
0811 08:03:32.046373 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:32.046386 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:32.046456 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:32.046640 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:32.046640 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:32.046672 (+ 32us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 08:03:32.046747 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:32.046749 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:32.047542 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:32.047543 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:32.048488 (+ 945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:32.048492 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:32.048881 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:32.048882 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:32.048956 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:32.048984 (+ 28us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 08:03:32.049185 (+ 201us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 08:03:32.049187 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 08:03:32.049258 (+ 71us) client_negotiation.cc:240] Negotiation successful
0811 08:03:32.049312 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":110,"threads_started":1}
I20260811 08:03:32.060830 17400 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40508:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:03:32.060987 17400 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40508:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:03:32.062188 17400 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 864969326d2e44c48a2c4a83b6b2c36d: Sending DeleteTablet for 3 replicas of tablet 368fa49bff8f408e8cec06b9df3356ac
I20260811 08:03:32.062666 17710 tablet_service.cc:1514] Processing DeleteTablet for tablet 368fa49bff8f408e8cec06b9df3356ac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:03:32 UTC) from {username='kudu', principal='kudu/127.15.36.254@KRBTEST.COM'} at 127.0.0.1:52822
I20260811 08:03:32.062873 17862 tablet_service.cc:1514] Processing DeleteTablet for tablet 368fa49bff8f408e8cec06b9df3356ac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:03:32 UTC) from {username='kudu', principal='kudu/127.15.36.254@KRBTEST.COM'} at 127.0.0.1:58786
I20260811 08:03:32.062997 18008 tablet_replica.cc:330] T 368fa49bff8f408e8cec06b9df3356ac P 47ba6728b7364e75abaa8cccf1382970: stopping tablet replica
I20260811 08:03:32.063124 18008 raft_consensus.cc:2229] T 368fa49bff8f408e8cec06b9df3356ac P 47ba6728b7364e75abaa8cccf1382970 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:03:32.063196 18008 raft_consensus.cc:2258] T 368fa49bff8f408e8cec06b9df3356ac P 47ba6728b7364e75abaa8cccf1382970 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:03:32.064765 17556 tablet_service.cc:1514] Processing DeleteTablet for tablet 368fa49bff8f408e8cec06b9df3356ac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:03:32 UTC) from {username='kudu', principal='kudu/127.15.36.254@KRBTEST.COM'} at 127.0.0.1:40060
I20260811 08:03:32.065137 17400 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40508:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:03:32.065346 17400 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:03:32.065277 18009 tablet_replica.cc:330] T 368fa49bff8f408e8cec06b9df3356ac P 05672f65a17c42d7a7cba31d85700725: stopping tablet replica
I20260811 08:03:32.065699 18009 raft_consensus.cc:2229] T 368fa49bff8f408e8cec06b9df3356ac P 05672f65a17c42d7a7cba31d85700725 [term 1 LEADER]: Raft consensus shutting down.
I20260811 08:03:32.066063 18009 raft_consensus.cc:2258] T 368fa49bff8f408e8cec06b9df3356ac P 05672f65a17c42d7a7cba31d85700725 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:03:32.067070 18009 ts_tablet_manager.cc:1905] T 368fa49bff8f408e8cec06b9df3356ac P 05672f65a17c42d7a7cba31d85700725: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:03:32.067817 17556 tablet_service.cc:1467] Processing CreateTablet for tablet c2afd840808a41d49ab51db76ea61191 (DEFAULT_TABLE table=test-table [id=2283e33593ce4ab08834b8a234b69ba4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:03:32.068409 17556 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2afd840808a41d49ab51db76ea61191. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:03:32.068428 17710 tablet_service.cc:1467] Processing CreateTablet for tablet c2afd840808a41d49ab51db76ea61191 (DEFAULT_TABLE table=test-table [id=2283e33593ce4ab08834b8a234b69ba4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:03:32.068756 17710 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2afd840808a41d49ab51db76ea61191. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:03:32.070549 17862 tablet_service.cc:1467] Processing CreateTablet for tablet c2afd840808a41d49ab51db76ea61191 (DEFAULT_TABLE table=test-table [id=2283e33593ce4ab08834b8a234b69ba4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:03:32.070734 17862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2afd840808a41d49ab51db76ea61191. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:03:32.072417 18008 ts_tablet_manager.cc:1905] T 368fa49bff8f408e8cec06b9df3356ac P 47ba6728b7364e75abaa8cccf1382970: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:03:32.073607 17960 tablet_bootstrap.cc:492] T c2afd840808a41d49ab51db76ea61191 P 47ba6728b7364e75abaa8cccf1382970: Bootstrap starting.
I20260811 08:03:32.074119 17960 tablet_bootstrap.cc:654] T c2afd840808a41d49ab51db76ea61191 P 47ba6728b7364e75abaa8cccf1382970: Neither blocks nor log segments found. Creating new log.
I20260811 08:03:32.074520 17961 tablet_bootstrap.cc:492] T c2afd840808a41d49ab51db76ea61191 P 6ef53eeb0b2b4676987701e7d3d273af: Bootstrap starting.
I20260811 08:03:32.075033 17961 tablet_bootstrap.cc:654] T c2afd840808a41d49ab51db76ea61191 P 6ef53eeb0b2b4676987701e7d3d273af: Neither blocks nor log segments found. Creating new log.
I20260811 08:03:32.075410 18010 tablet_replica.cc:330] T 368fa49bff8f408e8cec06b9df3356ac P 6ef53eeb0b2b4676987701e7d3d273af: stopping tablet replica
I20260811 08:03:32.075562 18010 raft_consensus.cc:2229] T 368fa49bff8f408e8cec06b9df3356ac P 6ef53eeb0b2b4676987701e7d3d273af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:03:32.075663 17958 tablet_bootstrap.cc:492] T c2afd840808a41d49ab51db76ea61191 P 05672f65a17c42d7a7cba31d85700725: Bootstrap starting.
I20260811 08:03:32.076114 18010 raft_consensus.cc:2258] T 368fa49bff8f408e8cec06b9df3356ac P 6ef53eeb0b2b4676987701e7d3d273af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:03:32.076206 17958 tablet_bootstrap.cc:654] T c2afd840808a41d49ab51db76ea61191 P 05672f65a17c42d7a7cba31d85700725: Neither blocks nor log segments found. Creating new log.
I20260811 08:03:32.076399 18008 ts_tablet_manager.cc:1918] T 368fa49bff8f408e8cec06b9df3356ac P 47ba6728b7364e75abaa8cccf1382970: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 08:03:32.076493 18008 log.cc:1196] T 368fa49bff8f408e8cec06b9df3356ac P 47ba6728b7364e75abaa8cccf1382970: Deleting WAL directory at /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/ts-1/wal/wals/368fa49bff8f408e8cec06b9df3356ac
I20260811 08:03:32.076804 18008 ts_tablet_manager.cc:1939] T 368fa49bff8f408e8cec06b9df3356ac P 47ba6728b7364e75abaa8cccf1382970: Deleting consensus metadata
I20260811 08:03:32.077288 17386 catalog_manager.cc:4841] TS 47ba6728b7364e75abaa8cccf1382970 (127.15.36.194:45469): tablet 368fa49bff8f408e8cec06b9df3356ac (table test-table [id=92cb84e0271a47a68c1f659cefaf90ba]) successfully deleted
I20260811 08:03:32.079319 17960 tablet_bootstrap.cc:492] T c2afd840808a41d49ab51db76ea61191 P 47ba6728b7364e75abaa8cccf1382970: No bootstrap required, opened a new log
I20260811 08:03:32.079388 17960 ts_tablet_manager.cc:1397] T c2afd840808a41d49ab51db76ea61191 P 47ba6728b7364e75abaa8cccf1382970: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20260811 08:03:32.079555 17960 raft_consensus.cc:348] T c2afd840808a41d49ab51db76ea61191 P 47ba6728b7364e75abaa8cccf1382970 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef53eeb0b2b4676987701e7d3d273af" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 34467 } } peers { permanent_uuid: "47ba6728b7364e75abaa8cccf1382970" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45469 } } peers { permanent_uuid: "05672f65a17c42d7a7cba31d85700725" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 38289 } }
I20260811 08:03:32.079643 17960 raft_consensus.cc:374] T c2afd840808a41d49ab51db76ea61191 P 47ba6728b7364e75abaa8cccf1382970 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:03:32.079665 17960 raft_consensus.cc:729] T c2afd840808a41d49ab51db76ea61191 P 47ba6728b7364e75abaa8cccf1382970 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47ba6728b7364e75abaa8cccf1382970, State: Initialized, Role: FOLLOWER
I20260811 08:03:32.079685 17958 tablet_bootstrap.cc:492] T c2afd840808a41d49ab51db76ea61191 P 05672f65a17c42d7a7cba31d85700725: No bootstrap required, opened a new log
I20260811 08:03:32.079736 17958 ts_tablet_manager.cc:1397] T c2afd840808a41d49ab51db76ea61191 P 05672f65a17c42d7a7cba31d85700725: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260811 08:03:32.079725 17960 consensus_queue.cc:260] T c2afd840808a41d49ab51db76ea61191 P 47ba6728b7364e75abaa8cccf1382970 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef53eeb0b2b4676987701e7d3d273af" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 34467 } } peers { permanent_uuid: "47ba6728b7364e75abaa8cccf1382970" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45469 } } peers { permanent_uuid: "05672f65a17c42d7a7cba31d85700725" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 38289 } }
I20260811 08:03:32.079998 17960 ts_tablet_manager.cc:1428] T c2afd840808a41d49ab51db76ea61191 P 47ba6728b7364e75abaa8cccf1382970: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260811 08:03:32.080061 17958 raft_consensus.cc:348] T c2afd840808a41d49ab51db76ea61191 P 05672f65a17c42d7a7cba31d85700725 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef53eeb0b2b4676987701e7d3d273af" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 34467 } } peers { permanent_uuid: "47ba6728b7364e75abaa8cccf1382970" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45469 } } peers { permanent_uuid: "05672f65a17c42d7a7cba31d85700725" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 38289 } }
I20260811 08:03:32.080144 17958 raft_consensus.cc:374] T c2afd840808a41d49ab51db76ea61191 P 05672f65a17c42d7a7cba31d85700725 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:03:32.080176 17958 raft_consensus.cc:729] T c2afd840808a41d49ab51db76ea61191 P 05672f65a17c42d7a7cba31d85700725 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05672f65a17c42d7a7cba31d85700725, State: Initialized, Role: FOLLOWER
I20260811 08:03:32.080231 17958 consensus_queue.cc:260] T c2afd840808a41d49ab51db76ea61191 P 05672f65a17c42d7a7cba31d85700725 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef53eeb0b2b4676987701e7d3d273af" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 34467 } } peers { permanent_uuid: "47ba6728b7364e75abaa8cccf1382970" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45469 } } peers { permanent_uuid: "05672f65a17c42d7a7cba31d85700725" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 38289 } }
I20260811 08:03:32.080348 17958 ts_tablet_manager.cc:1428] T c2afd840808a41d49ab51db76ea61191 P 05672f65a17c42d7a7cba31d85700725: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 08:03:32.080858 18009 ts_tablet_manager.cc:1918] T 368fa49bff8f408e8cec06b9df3356ac P 05672f65a17c42d7a7cba31d85700725: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 08:03:32.081012 18009 log.cc:1196] T 368fa49bff8f408e8cec06b9df3356ac P 05672f65a17c42d7a7cba31d85700725: Deleting WAL directory at /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/ts-2/wal/wals/368fa49bff8f408e8cec06b9df3356ac
I20260811 08:03:32.081519 18009 ts_tablet_manager.cc:1939] T 368fa49bff8f408e8cec06b9df3356ac P 05672f65a17c42d7a7cba31d85700725: Deleting consensus metadata
I20260811 08:03:32.081877 17961 tablet_bootstrap.cc:492] T c2afd840808a41d49ab51db76ea61191 P 6ef53eeb0b2b4676987701e7d3d273af: No bootstrap required, opened a new log
I20260811 08:03:32.081955 17961 ts_tablet_manager.cc:1397] T c2afd840808a41d49ab51db76ea61191 P 6ef53eeb0b2b4676987701e7d3d273af: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.001s
I20260811 08:03:32.082149 17961 raft_consensus.cc:348] T c2afd840808a41d49ab51db76ea61191 P 6ef53eeb0b2b4676987701e7d3d273af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef53eeb0b2b4676987701e7d3d273af" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 34467 } } peers { permanent_uuid: "47ba6728b7364e75abaa8cccf1382970" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45469 } } peers { permanent_uuid: "05672f65a17c42d7a7cba31d85700725" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 38289 } }
I20260811 08:03:32.082216 17386 catalog_manager.cc:4841] TS 05672f65a17c42d7a7cba31d85700725 (127.15.36.195:38289): tablet 368fa49bff8f408e8cec06b9df3356ac (table test-table [id=92cb84e0271a47a68c1f659cefaf90ba]) successfully deleted
I20260811 08:03:32.082242 17961 raft_consensus.cc:374] T c2afd840808a41d49ab51db76ea61191 P 6ef53eeb0b2b4676987701e7d3d273af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:03:32.082265 17961 raft_consensus.cc:729] T c2afd840808a41d49ab51db76ea61191 P 6ef53eeb0b2b4676987701e7d3d273af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ef53eeb0b2b4676987701e7d3d273af, State: Initialized, Role: FOLLOWER
I20260811 08:03:32.082310 17961 consensus_queue.cc:260] T c2afd840808a41d49ab51db76ea61191 P 6ef53eeb0b2b4676987701e7d3d273af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef53eeb0b2b4676987701e7d3d273af" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 34467 } } peers { permanent_uuid: "47ba6728b7364e75abaa8cccf1382970" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45469 } } peers { permanent_uuid: "05672f65a17c42d7a7cba31d85700725" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 38289 } }
I20260811 08:03:32.082443 17961 ts_tablet_manager.cc:1428] T c2afd840808a41d49ab51db76ea61191 P 6ef53eeb0b2b4676987701e7d3d273af: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 08:03:32.087554 18010 ts_tablet_manager.cc:1905] T 368fa49bff8f408e8cec06b9df3356ac P 6ef53eeb0b2b4676987701e7d3d273af: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:03:32.089710 18010 ts_tablet_manager.cc:1918] T 368fa49bff8f408e8cec06b9df3356ac P 6ef53eeb0b2b4676987701e7d3d273af: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 08:03:32.089941 18010 log.cc:1196] T 368fa49bff8f408e8cec06b9df3356ac P 6ef53eeb0b2b4676987701e7d3d273af: Deleting WAL directory at /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/ts-0/wal/wals/368fa49bff8f408e8cec06b9df3356ac
I20260811 08:03:32.090423 18010 ts_tablet_manager.cc:1939] T 368fa49bff8f408e8cec06b9df3356ac P 6ef53eeb0b2b4676987701e7d3d273af: Deleting consensus metadata
I20260811 08:03:32.091364 17383 catalog_manager.cc:4841] TS 6ef53eeb0b2b4676987701e7d3d273af (127.15.36.193:34467): tablet 368fa49bff8f408e8cec06b9df3356ac (table test-table [id=92cb84e0271a47a68c1f659cefaf90ba]) successfully deleted
I20260811 08:03:32.146569 17966 raft_consensus.cc:482] T c2afd840808a41d49ab51db76ea61191 P 47ba6728b7364e75abaa8cccf1382970 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:03:32.146716 17966 raft_consensus.cc:504] T c2afd840808a41d49ab51db76ea61191 P 47ba6728b7364e75abaa8cccf1382970 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef53eeb0b2b4676987701e7d3d273af" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 34467 } } peers { permanent_uuid: "47ba6728b7364e75abaa8cccf1382970" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45469 } } peers { permanent_uuid: "05672f65a17c42d7a7cba31d85700725" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 38289 } }
I20260811 08:03:32.147277 17966 leader_election.cc:288] T c2afd840808a41d49ab51db76ea61191 P 47ba6728b7364e75abaa8cccf1382970 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ef53eeb0b2b4676987701e7d3d273af (127.15.36.193:34467), 05672f65a17c42d7a7cba31d85700725 (127.15.36.195:38289)
I20260811 08:03:32.152480 17956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:32.147846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:52953 (local address 127.15.36.195:38289)
0811 08:03:32.147893 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:32.147895 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:32.148048 (+ 153us) server_negotiation.cc:407] Connection header received
0811 08:03:32.148164 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:32.148165 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:32.148177 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:32.148217 (+ 40us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:03:32.148497 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:32.149296 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:32.151430 (+ 2134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:32.152009 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:32.152075 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:32.152085 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:32.152340 (+ 255us) server_negotiation.cc:299] Negotiation successful
0811 08:03:32.152384 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 08:03:32.152544 17955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:32.147650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:48377 (local address 127.15.36.193:34467)
0811 08:03:32.147782 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:32.147784 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:32.147852 (+ 68us) server_negotiation.cc:407] Connection header received
0811 08:03:32.148050 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:32.148051 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:32.148065 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:32.148096 (+ 31us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:03:32.148336 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:32.149104 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:32.151516 (+ 2412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:32.152113 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:32.152166 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:32.152175 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:32.152430 (+ 255us) server_negotiation.cc:299] Negotiation successful
0811 08:03:32.152468 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100}
I20260811 08:03:32.152846 18015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:32.147565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.195:38289 (local address 127.15.36.194:52953)
0811 08:03:32.147971 (+ 406us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:32.147983 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:32.148077 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:32.148305 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:32.148306 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:32.148308 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:03:32.148391 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:32.148393 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:32.149874 (+ 1481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:32.149875 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:32.151280 (+ 1405us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:32.151285 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:32.152160 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:32.152161 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:32.152243 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:32.152248 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 08:03:32.152648 (+ 400us) client_negotiation.cc:240] Negotiation successful
0811 08:03:32.152713 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":386,"thread_start_us":96,"threads_started":1}
I20260811 08:03:32.153121 17883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2afd840808a41d49ab51db76ea61191" candidate_uuid: "47ba6728b7364e75abaa8cccf1382970" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05672f65a17c42d7a7cba31d85700725" is_pre_election: true
I20260811 08:03:32.153235 17883 raft_consensus.cc:2454] T c2afd840808a41d49ab51db76ea61191 P 05672f65a17c42d7a7cba31d85700725 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47ba6728b7364e75abaa8cccf1382970 in term 0.
I20260811 08:03:32.153436 17662 leader_election.cc:302] T c2afd840808a41d49ab51db76ea61191 P 47ba6728b7364e75abaa8cccf1382970 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05672f65a17c42d7a7cba31d85700725, 47ba6728b7364e75abaa8cccf1382970; no voters:
I20260811 08:03:32.153604 17966 raft_consensus.cc:2781] T c2afd840808a41d49ab51db76ea61191 P 47ba6728b7364e75abaa8cccf1382970 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:03:32.153638 17966 raft_consensus.cc:482] T c2afd840808a41d49ab51db76ea61191 P 47ba6728b7364e75abaa8cccf1382970 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:03:32.153659 17966 raft_consensus.cc:3037] T c2afd840808a41d49ab51db76ea61191 P 47ba6728b7364e75abaa8cccf1382970 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:03:32.154649 17966 raft_consensus.cc:504] T c2afd840808a41d49ab51db76ea61191 P 47ba6728b7364e75abaa8cccf1382970 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef53eeb0b2b4676987701e7d3d273af" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 34467 } } peers { permanent_uuid: "47ba6728b7364e75abaa8cccf1382970" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45469 } } peers { permanent_uuid: "05672f65a17c42d7a7cba31d85700725" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 38289 } }
I20260811 08:03:32.154842 17966 leader_election.cc:288] T c2afd840808a41d49ab51db76ea61191 P 47ba6728b7364e75abaa8cccf1382970 [CANDIDATE]: Term 1 election: Requested vote from peers 6ef53eeb0b2b4676987701e7d3d273af (127.15.36.193:34467), 05672f65a17c42d7a7cba31d85700725 (127.15.36.195:38289)
I20260811 08:03:32.155121 17883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2afd840808a41d49ab51db76ea61191" candidate_uuid: "47ba6728b7364e75abaa8cccf1382970" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05672f65a17c42d7a7cba31d85700725"
I20260811 08:03:32.155216 17883 raft_consensus.cc:3037] T c2afd840808a41d49ab51db76ea61191 P 05672f65a17c42d7a7cba31d85700725 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:03:32.155364 18014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:32.147464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.193:34467 (local address 127.15.36.194:48377)
0811 08:03:32.147774 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:32.147787 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:32.147950 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:32.148172 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:32.148173 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:32.148175 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:03:32.148257 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:32.148259 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:32.149228 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:32.149228 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:32.150796 (+ 1568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:32.150801 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:32.152243 (+ 1442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:32.152244 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:32.152342 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:32.152346 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:03:32.154692 (+ 2346us) client_negotiation.cc:240] Negotiation successful
0811 08:03:32.154831 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292,"thread_start_us":73,"threads_started":1}
I20260811 08:03:32.155827 17579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2afd840808a41d49ab51db76ea61191" candidate_uuid: "47ba6728b7364e75abaa8cccf1382970" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ef53eeb0b2b4676987701e7d3d273af" is_pre_election: true
I20260811 08:03:32.155974 17579 raft_consensus.cc:2454] T c2afd840808a41d49ab51db76ea61191 P 6ef53eeb0b2b4676987701e7d3d273af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47ba6728b7364e75abaa8cccf1382970 in term 0.
I20260811 08:03:32.156144 17883 raft_consensus.cc:2454] T c2afd840808a41d49ab51db76ea61191 P 05672f65a17c42d7a7cba31d85700725 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47ba6728b7364e75abaa8cccf1382970 in term 1.
I20260811 08:03:32.156327 17662 leader_election.cc:302] T c2afd840808a41d49ab51db76ea61191 P 47ba6728b7364e75abaa8cccf1382970 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05672f65a17c42d7a7cba31d85700725, 47ba6728b7364e75abaa8cccf1382970; no voters:
I20260811 08:03:32.156409 17966 raft_consensus.cc:2781] T c2afd840808a41d49ab51db76ea61191 P 47ba6728b7364e75abaa8cccf1382970 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:03:32.156369 17578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2afd840808a41d49ab51db76ea61191" candidate_uuid: "47ba6728b7364e75abaa8cccf1382970" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ef53eeb0b2b4676987701e7d3d273af"
I20260811 08:03:32.156546 17578 raft_consensus.cc:3037] T c2afd840808a41d49ab51db76ea61191 P 6ef53eeb0b2b4676987701e7d3d273af [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:03:32.156605 17966 raft_consensus.cc:686] T c2afd840808a41d49ab51db76ea61191 P 47ba6728b7364e75abaa8cccf1382970 [term 1 LEADER]: Becoming Leader. State: Replica: 47ba6728b7364e75abaa8cccf1382970, State: Running, Role: LEADER
I20260811 08:03:32.156684 17966 consensus_queue.cc:237] T c2afd840808a41d49ab51db76ea61191 P 47ba6728b7364e75abaa8cccf1382970 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef53eeb0b2b4676987701e7d3d273af" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 34467 } } peers { permanent_uuid: "47ba6728b7364e75abaa8cccf1382970" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45469 } } peers { permanent_uuid: "05672f65a17c42d7a7cba31d85700725" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 38289 } }
I20260811 08:03:32.157553 17401 catalog_manager.cc:5495] T c2afd840808a41d49ab51db76ea61191 P 47ba6728b7364e75abaa8cccf1382970 reported cstate change: term changed from 0 to 1, leader changed from <none> to 47ba6728b7364e75abaa8cccf1382970 (127.15.36.194). New cstate: current_term: 1 leader_uuid: "47ba6728b7364e75abaa8cccf1382970" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef53eeb0b2b4676987701e7d3d273af" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 34467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47ba6728b7364e75abaa8cccf1382970" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05672f65a17c42d7a7cba31d85700725" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 38289 } health_report { overall_health: UNKNOWN } } }
I20260811 08:03:32.158214 17578 raft_consensus.cc:2454] T c2afd840808a41d49ab51db76ea61191 P 6ef53eeb0b2b4676987701e7d3d273af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47ba6728b7364e75abaa8cccf1382970 in term 1.
I20260811 08:03:32.180549 17957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:32.173905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52836 (local address 127.15.36.194:45469)
0811 08:03:32.175607 (+ 1702us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:32.175609 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:32.175624 (+ 15us) server_negotiation.cc:407] Connection header received
0811 08:03:32.175675 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:32.175676 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:32.176375 (+ 699us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:32.176497 (+ 122us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:03:32.176831 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:32.177873 (+ 1042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:32.179336 (+ 1463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:32.179658 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:32.179834 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:32.180102 (+ 268us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:03:32.180247 (+ 145us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:03:32.180341 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:32.180423 (+ 82us) server_negotiation.cc:299] Negotiation successful
0811 08:03:32.180456 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 08:03:32.191406 17955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:32.186342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:39353 (local address 127.15.36.193:34467)
0811 08:03:32.186409 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:32.186412 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:32.186423 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:03:32.186454 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:32.186455 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:32.186468 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:32.186534 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:03:32.186816 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:32.187755 (+ 939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:32.189011 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:32.189301 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:32.189570 (+ 269us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:32.190651 (+ 1081us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:03:32.190698 (+ 47us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:03:32.190769 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:32.191277 (+ 508us) server_negotiation.cc:299] Negotiation successful
0811 08:03:32.191315 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 08:03:32.191738 18020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:32.186043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.193:34467 (local address 127.15.36.194:39353)
0811 08:03:32.186248 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:32.186262 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:32.186324 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:32.186549 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:32.186550 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:32.186552 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 08:03:32.186652 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:32.186654 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:32.187878 (+ 1224us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:32.187879 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:32.188768 (+ 889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:32.188772 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:32.190403 (+ 1631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:32.190405 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:32.190490 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:32.190519 (+ 29us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 08:03:32.190811 (+ 292us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 08:03:32.190814 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:03:32.191246 (+ 432us) client_negotiation.cc:240] Negotiation successful
0811 08:03:32.191321 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":109,"threads_started":1}
I20260811 08:03:32.197299 17883 raft_consensus.cc:1261] T c2afd840808a41d49ab51db76ea61191 P 05672f65a17c42d7a7cba31d85700725 [term 1 FOLLOWER]: Refusing update from remote peer 47ba6728b7364e75abaa8cccf1382970: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:03:32.197908 18016 consensus_queue.cc:1035] T c2afd840808a41d49ab51db76ea61191 P 47ba6728b7364e75abaa8cccf1382970 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05672f65a17c42d7a7cba31d85700725" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 38289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:03:32.198367 17578 raft_consensus.cc:1261] T c2afd840808a41d49ab51db76ea61191 P 6ef53eeb0b2b4676987701e7d3d273af [term 1 FOLLOWER]: Refusing update from remote peer 47ba6728b7364e75abaa8cccf1382970: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:03:32.199045 18016 consensus_queue.cc:1035] T c2afd840808a41d49ab51db76ea61191 P 47ba6728b7364e75abaa8cccf1382970 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ef53eeb0b2b4676987701e7d3d273af" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 34467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:03:32.216239 18005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:32.211760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.194:45469 (local address 127.15.36.193:36161)
0811 08:03:32.211820 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:32.211833 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:32.211874 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:32.212032 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:32.212032 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:32.212034 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 08:03:32.212090 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:32.212091 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:32.213412 (+ 1321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:32.213413 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:32.214482 (+ 1069us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:32.214487 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:32.215165 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:32.215166 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:32.215232 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:32.215391 (+ 159us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 08:03:32.215756 (+ 365us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 08:03:32.215759 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:03:32.215787 (+ 28us) client_negotiation.cc:240] Negotiation successful
0811 08:03:32.215850 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260811 08:03:32.216799 17957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:32.211826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:36161 (local address 127.15.36.194:45469)
0811 08:03:32.211878 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:32.211881 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:32.211918 (+ 37us) server_negotiation.cc:407] Connection header received
0811 08:03:32.211943 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:32.211944 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:32.211955 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:32.212019 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:03:32.212248 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:32.213119 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:32.214624 (+ 1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:32.215044 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:32.215599 (+ 555us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:32.215631 (+ 32us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:03:32.215674 (+ 43us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:03:32.216665 (+ 991us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:32.216687 (+ 22us) server_negotiation.cc:299] Negotiation successful
0811 08:03:32.216721 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
W20260811 08:03:32.218163 17988 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260811 08:03:33.760594 17401 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40508:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:03:33.760722 17401 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40508:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:03:33.761991 17401 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 864969326d2e44c48a2c4a83b6b2c36d: Sending DeleteTablet for 3 replicas of tablet c2afd840808a41d49ab51db76ea61191
I20260811 08:03:33.762390 17710 tablet_service.cc:1514] Processing DeleteTablet for tablet c2afd840808a41d49ab51db76ea61191 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:03:33 UTC) from {username='kudu', principal='kudu/127.15.36.254@KRBTEST.COM'} at 127.0.0.1:52822
I20260811 08:03:33.762426 17555 tablet_service.cc:1514] Processing DeleteTablet for tablet c2afd840808a41d49ab51db76ea61191 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:03:33 UTC) from {username='kudu', principal='kudu/127.15.36.254@KRBTEST.COM'} at 127.0.0.1:40060
I20260811 08:03:33.762442 17862 tablet_service.cc:1514] Processing DeleteTablet for tablet c2afd840808a41d49ab51db76ea61191 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:03:33 UTC) from {username='kudu', principal='kudu/127.15.36.254@KRBTEST.COM'} at 127.0.0.1:58786
I20260811 08:03:33.764724 18051 tablet_replica.cc:330] T c2afd840808a41d49ab51db76ea61191 P 05672f65a17c42d7a7cba31d85700725: stopping tablet replica
I20260811 08:03:33.764833 18051 raft_consensus.cc:2229] T c2afd840808a41d49ab51db76ea61191 P 05672f65a17c42d7a7cba31d85700725 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:03:33.764977 18051 raft_consensus.cc:2258] T c2afd840808a41d49ab51db76ea61191 P 05672f65a17c42d7a7cba31d85700725 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:03:33.765275 18050 tablet_replica.cc:330] T c2afd840808a41d49ab51db76ea61191 P 6ef53eeb0b2b4676987701e7d3d273af: stopping tablet replica
I20260811 08:03:33.765434 18051 ts_tablet_manager.cc:1905] T c2afd840808a41d49ab51db76ea61191 P 05672f65a17c42d7a7cba31d85700725: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:03:33.765455 18049 tablet_replica.cc:330] T c2afd840808a41d49ab51db76ea61191 P 47ba6728b7364e75abaa8cccf1382970: stopping tablet replica
I20260811 08:03:33.765530 18049 raft_consensus.cc:2229] T c2afd840808a41d49ab51db76ea61191 P 47ba6728b7364e75abaa8cccf1382970 [term 1 LEADER]: Raft consensus shutting down.
I20260811 08:03:33.765712 18049 raft_consensus.cc:2258] T c2afd840808a41d49ab51db76ea61191 P 47ba6728b7364e75abaa8cccf1382970 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:03:33.765969 18050 raft_consensus.cc:2229] T c2afd840808a41d49ab51db76ea61191 P 6ef53eeb0b2b4676987701e7d3d273af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:03:33.766054 18050 raft_consensus.cc:2258] T c2afd840808a41d49ab51db76ea61191 P 6ef53eeb0b2b4676987701e7d3d273af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:03:33.766709 18049 ts_tablet_manager.cc:1905] T c2afd840808a41d49ab51db76ea61191 P 47ba6728b7364e75abaa8cccf1382970: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:03:33.766369 18050 ts_tablet_manager.cc:1905] T c2afd840808a41d49ab51db76ea61191 P 6ef53eeb0b2b4676987701e7d3d273af: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:03:33.768110 18051 ts_tablet_manager.cc:1918] T c2afd840808a41d49ab51db76ea61191 P 05672f65a17c42d7a7cba31d85700725: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 08:03:33.768206 18051 log.cc:1196] T c2afd840808a41d49ab51db76ea61191 P 05672f65a17c42d7a7cba31d85700725: Deleting WAL directory at /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/ts-2/wal/wals/c2afd840808a41d49ab51db76ea61191
I20260811 08:03:33.768512 18051 ts_tablet_manager.cc:1939] T c2afd840808a41d49ab51db76ea61191 P 05672f65a17c42d7a7cba31d85700725: Deleting consensus metadata
I20260811 08:03:33.769124 18049 ts_tablet_manager.cc:1918] T c2afd840808a41d49ab51db76ea61191 P 47ba6728b7364e75abaa8cccf1382970: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 08:03:33.769500 18049 log.cc:1196] T c2afd840808a41d49ab51db76ea61191 P 47ba6728b7364e75abaa8cccf1382970: Deleting WAL directory at /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/ts-1/wal/wals/c2afd840808a41d49ab51db76ea61191
I20260811 08:03:33.770028 18049 ts_tablet_manager.cc:1939] T c2afd840808a41d49ab51db76ea61191 P 47ba6728b7364e75abaa8cccf1382970: Deleting consensus metadata
I20260811 08:03:33.769842 18050 ts_tablet_manager.cc:1918] T c2afd840808a41d49ab51db76ea61191 P 6ef53eeb0b2b4676987701e7d3d273af: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 08:03:33.770130 18050 log.cc:1196] T c2afd840808a41d49ab51db76ea61191 P 6ef53eeb0b2b4676987701e7d3d273af: Deleting WAL directory at /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/ts-0/wal/wals/c2afd840808a41d49ab51db76ea61191
I20260811 08:03:33.770243 17386 catalog_manager.cc:4841] TS 05672f65a17c42d7a7cba31d85700725 (127.15.36.195:38289): tablet c2afd840808a41d49ab51db76ea61191 (table test-table [id=2283e33593ce4ab08834b8a234b69ba4]) successfully deleted
I20260811 08:03:33.770455 18050 ts_tablet_manager.cc:1939] T c2afd840808a41d49ab51db76ea61191 P 6ef53eeb0b2b4676987701e7d3d273af: Deleting consensus metadata
I20260811 08:03:33.770675 17386 catalog_manager.cc:4841] TS 47ba6728b7364e75abaa8cccf1382970 (127.15.36.194:45469): tablet c2afd840808a41d49ab51db76ea61191 (table test-table [id=2283e33593ce4ab08834b8a234b69ba4]) successfully deleted
I20260811 08:03:33.772780 17383 catalog_manager.cc:4841] TS 6ef53eeb0b2b4676987701e7d3d273af (127.15.36.193:34467): tablet c2afd840808a41d49ab51db76ea61191 (table test-table [id=2283e33593ce4ab08834b8a234b69ba4]) successfully deleted
Aug 11 08:03:33 dist-test-slave-2w3w krb5kdc[17353](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435413, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 08:03:33 dist-test-slave-2w3w krb5kdc[17353](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435413, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:03:33.807176 18060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:33.790199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40530 (local address 127.15.36.254:42649)
0811 08:03:33.791667 (+ 1468us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:33.791670 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:33.792153 (+ 483us) server_negotiation.cc:407] Connection header received
0811 08:03:33.792853 (+ 700us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:33.792855 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:33.792964 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:33.794304 (+ 1340us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:33.796697 (+ 2393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:33.797745 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:33.799612 (+ 1867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:33.799833 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:33.799919 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:33.802947 (+ 3028us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:33.802949 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:33.802949 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:33.803012 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:33.805480 (+ 2468us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:33.806225 (+ 745us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:33.806228 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:33.806229 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:33.806296 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:33.806520 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:33.806521 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:33.806521 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:33.806655 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:33.806768 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:33.806925 (+ 157us) server_negotiation.cc:299] Negotiation successful
0811 08:03:33.807055 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1059,"thread_start_us":585,"threads_started":1}
I20260811 08:03:33.810096 17401 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40530:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:03:33.810446 17401 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:03:33.819602 17710 tablet_service.cc:1467] Processing CreateTablet for tablet 71d06786cd934d00b253bc60eb2f0740 (DEFAULT_TABLE table=test-table [id=01a7864d2dbc4660b66774b29716a5c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:03:33.819602 17862 tablet_service.cc:1467] Processing CreateTablet for tablet 71d06786cd934d00b253bc60eb2f0740 (DEFAULT_TABLE table=test-table [id=01a7864d2dbc4660b66774b29716a5c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:03:33.819829 17710 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71d06786cd934d00b253bc60eb2f0740. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:03:33.819869 17862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71d06786cd934d00b253bc60eb2f0740. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:03:33.819741 17555 tablet_service.cc:1467] Processing CreateTablet for tablet 71d06786cd934d00b253bc60eb2f0740 (DEFAULT_TABLE table=test-table [id=01a7864d2dbc4660b66774b29716a5c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:03:33.820071 17555 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71d06786cd934d00b253bc60eb2f0740. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:03:33.821835 18061 tablet_bootstrap.cc:492] T 71d06786cd934d00b253bc60eb2f0740 P 05672f65a17c42d7a7cba31d85700725: Bootstrap starting.
I20260811 08:03:33.822383 18061 tablet_bootstrap.cc:654] T 71d06786cd934d00b253bc60eb2f0740 P 05672f65a17c42d7a7cba31d85700725: Neither blocks nor log segments found. Creating new log.
I20260811 08:03:33.822747 18062 tablet_bootstrap.cc:492] T 71d06786cd934d00b253bc60eb2f0740 P 47ba6728b7364e75abaa8cccf1382970: Bootstrap starting.
I20260811 08:03:33.823159 18064 tablet_bootstrap.cc:492] T 71d06786cd934d00b253bc60eb2f0740 P 6ef53eeb0b2b4676987701e7d3d273af: Bootstrap starting.
I20260811 08:03:33.823338 18062 tablet_bootstrap.cc:654] T 71d06786cd934d00b253bc60eb2f0740 P 47ba6728b7364e75abaa8cccf1382970: Neither blocks nor log segments found. Creating new log.
I20260811 08:03:33.823204 18061 tablet_bootstrap.cc:492] T 71d06786cd934d00b253bc60eb2f0740 P 05672f65a17c42d7a7cba31d85700725: No bootstrap required, opened a new log
I20260811 08:03:33.823405 18061 ts_tablet_manager.cc:1397] T 71d06786cd934d00b253bc60eb2f0740 P 05672f65a17c42d7a7cba31d85700725: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 08:03:33.823562 18064 tablet_bootstrap.cc:654] T 71d06786cd934d00b253bc60eb2f0740 P 6ef53eeb0b2b4676987701e7d3d273af: Neither blocks nor log segments found. Creating new log.
I20260811 08:03:33.823546 18061 raft_consensus.cc:348] T 71d06786cd934d00b253bc60eb2f0740 P 05672f65a17c42d7a7cba31d85700725 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef53eeb0b2b4676987701e7d3d273af" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 34467 } } peers { permanent_uuid: "47ba6728b7364e75abaa8cccf1382970" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45469 } } peers { permanent_uuid: "05672f65a17c42d7a7cba31d85700725" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 38289 } }
I20260811 08:03:33.823627 18061 raft_consensus.cc:374] T 71d06786cd934d00b253bc60eb2f0740 P 05672f65a17c42d7a7cba31d85700725 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:03:33.823652 18061 raft_consensus.cc:729] T 71d06786cd934d00b253bc60eb2f0740 P 05672f65a17c42d7a7cba31d85700725 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05672f65a17c42d7a7cba31d85700725, State: Initialized, Role: FOLLOWER
I20260811 08:03:33.823710 18061 consensus_queue.cc:260] T 71d06786cd934d00b253bc60eb2f0740 P 05672f65a17c42d7a7cba31d85700725 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef53eeb0b2b4676987701e7d3d273af" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 34467 } } peers { permanent_uuid: "47ba6728b7364e75abaa8cccf1382970" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45469 } } peers { permanent_uuid: "05672f65a17c42d7a7cba31d85700725" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 38289 } }
I20260811 08:03:33.823908 18061 ts_tablet_manager.cc:1428] T 71d06786cd934d00b253bc60eb2f0740 P 05672f65a17c42d7a7cba31d85700725: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 08:03:33.824338 18064 tablet_bootstrap.cc:492] T 71d06786cd934d00b253bc60eb2f0740 P 6ef53eeb0b2b4676987701e7d3d273af: No bootstrap required, opened a new log
I20260811 08:03:33.824405 18064 ts_tablet_manager.cc:1397] T 71d06786cd934d00b253bc60eb2f0740 P 6ef53eeb0b2b4676987701e7d3d273af: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 08:03:33.824573 18064 raft_consensus.cc:348] T 71d06786cd934d00b253bc60eb2f0740 P 6ef53eeb0b2b4676987701e7d3d273af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef53eeb0b2b4676987701e7d3d273af" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 34467 } } peers { permanent_uuid: "47ba6728b7364e75abaa8cccf1382970" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45469 } } peers { permanent_uuid: "05672f65a17c42d7a7cba31d85700725" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 38289 } }
I20260811 08:03:33.824692 18064 raft_consensus.cc:374] T 71d06786cd934d00b253bc60eb2f0740 P 6ef53eeb0b2b4676987701e7d3d273af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:03:33.824730 18064 raft_consensus.cc:729] T 71d06786cd934d00b253bc60eb2f0740 P 6ef53eeb0b2b4676987701e7d3d273af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ef53eeb0b2b4676987701e7d3d273af, State: Initialized, Role: FOLLOWER
I20260811 08:03:33.824791 18064 consensus_queue.cc:260] T 71d06786cd934d00b253bc60eb2f0740 P 6ef53eeb0b2b4676987701e7d3d273af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef53eeb0b2b4676987701e7d3d273af" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 34467 } } peers { permanent_uuid: "47ba6728b7364e75abaa8cccf1382970" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45469 } } peers { permanent_uuid: "05672f65a17c42d7a7cba31d85700725" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 38289 } }
I20260811 08:03:33.824944 18064 ts_tablet_manager.cc:1428] T 71d06786cd934d00b253bc60eb2f0740 P 6ef53eeb0b2b4676987701e7d3d273af: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 08:03:33.825299 18062 tablet_bootstrap.cc:492] T 71d06786cd934d00b253bc60eb2f0740 P 47ba6728b7364e75abaa8cccf1382970: No bootstrap required, opened a new log
I20260811 08:03:33.825368 18062 ts_tablet_manager.cc:1397] T 71d06786cd934d00b253bc60eb2f0740 P 47ba6728b7364e75abaa8cccf1382970: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260811 08:03:33.825491 18062 raft_consensus.cc:348] T 71d06786cd934d00b253bc60eb2f0740 P 47ba6728b7364e75abaa8cccf1382970 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef53eeb0b2b4676987701e7d3d273af" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 34467 } } peers { permanent_uuid: "47ba6728b7364e75abaa8cccf1382970" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45469 } } peers { permanent_uuid: "05672f65a17c42d7a7cba31d85700725" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 38289 } }
I20260811 08:03:33.825582 18062 raft_consensus.cc:374] T 71d06786cd934d00b253bc60eb2f0740 P 47ba6728b7364e75abaa8cccf1382970 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:03:33.825604 18062 raft_consensus.cc:729] T 71d06786cd934d00b253bc60eb2f0740 P 47ba6728b7364e75abaa8cccf1382970 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47ba6728b7364e75abaa8cccf1382970, State: Initialized, Role: FOLLOWER
I20260811 08:03:33.825671 18062 consensus_queue.cc:260] T 71d06786cd934d00b253bc60eb2f0740 P 47ba6728b7364e75abaa8cccf1382970 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef53eeb0b2b4676987701e7d3d273af" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 34467 } } peers { permanent_uuid: "47ba6728b7364e75abaa8cccf1382970" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45469 } } peers { permanent_uuid: "05672f65a17c42d7a7cba31d85700725" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 38289 } }
I20260811 08:03:33.825805 18062 ts_tablet_manager.cc:1428] T 71d06786cd934d00b253bc60eb2f0740 P 47ba6728b7364e75abaa8cccf1382970: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 08:03:33.944868 17965 raft_consensus.cc:482] T 71d06786cd934d00b253bc60eb2f0740 P 6ef53eeb0b2b4676987701e7d3d273af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:03:33.945113 17965 raft_consensus.cc:504] T 71d06786cd934d00b253bc60eb2f0740 P 6ef53eeb0b2b4676987701e7d3d273af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef53eeb0b2b4676987701e7d3d273af" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 34467 } } peers { permanent_uuid: "47ba6728b7364e75abaa8cccf1382970" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45469 } } peers { permanent_uuid: "05672f65a17c42d7a7cba31d85700725" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 38289 } }
I20260811 08:03:33.945250 17965 leader_election.cc:288] T 71d06786cd934d00b253bc60eb2f0740 P 6ef53eeb0b2b4676987701e7d3d273af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47ba6728b7364e75abaa8cccf1382970 (127.15.36.194:45469), 05672f65a17c42d7a7cba31d85700725 (127.15.36.195:38289)
I20260811 08:03:33.945539 17732 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71d06786cd934d00b253bc60eb2f0740" candidate_uuid: "6ef53eeb0b2b4676987701e7d3d273af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47ba6728b7364e75abaa8cccf1382970" is_pre_election: true
I20260811 08:03:33.945565 17883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71d06786cd934d00b253bc60eb2f0740" candidate_uuid: "6ef53eeb0b2b4676987701e7d3d273af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05672f65a17c42d7a7cba31d85700725" is_pre_election: true
I20260811 08:03:33.945670 17883 raft_consensus.cc:2454] T 71d06786cd934d00b253bc60eb2f0740 P 05672f65a17c42d7a7cba31d85700725 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ef53eeb0b2b4676987701e7d3d273af in term 0.
I20260811 08:03:33.945674 17732 raft_consensus.cc:2454] T 71d06786cd934d00b253bc60eb2f0740 P 47ba6728b7364e75abaa8cccf1382970 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ef53eeb0b2b4676987701e7d3d273af in term 0.
I20260811 08:03:33.945883 17504 leader_election.cc:302] T 71d06786cd934d00b253bc60eb2f0740 P 6ef53eeb0b2b4676987701e7d3d273af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47ba6728b7364e75abaa8cccf1382970, 6ef53eeb0b2b4676987701e7d3d273af; no voters:
I20260811 08:03:33.946058 17965 raft_consensus.cc:2781] T 71d06786cd934d00b253bc60eb2f0740 P 6ef53eeb0b2b4676987701e7d3d273af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:03:33.946111 17965 raft_consensus.cc:482] T 71d06786cd934d00b253bc60eb2f0740 P 6ef53eeb0b2b4676987701e7d3d273af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:03:33.946141 17965 raft_consensus.cc:3037] T 71d06786cd934d00b253bc60eb2f0740 P 6ef53eeb0b2b4676987701e7d3d273af [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:03:33.947103 17965 raft_consensus.cc:504] T 71d06786cd934d00b253bc60eb2f0740 P 6ef53eeb0b2b4676987701e7d3d273af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef53eeb0b2b4676987701e7d3d273af" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 34467 } } peers { permanent_uuid: "47ba6728b7364e75abaa8cccf1382970" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45469 } } peers { permanent_uuid: "05672f65a17c42d7a7cba31d85700725" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 38289 } }
I20260811 08:03:33.947290 17965 leader_election.cc:288] T 71d06786cd934d00b253bc60eb2f0740 P 6ef53eeb0b2b4676987701e7d3d273af [CANDIDATE]: Term 1 election: Requested vote from peers 47ba6728b7364e75abaa8cccf1382970 (127.15.36.194:45469), 05672f65a17c42d7a7cba31d85700725 (127.15.36.195:38289)
I20260811 08:03:33.947614 17883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71d06786cd934d00b253bc60eb2f0740" candidate_uuid: "6ef53eeb0b2b4676987701e7d3d273af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05672f65a17c42d7a7cba31d85700725"
I20260811 08:03:33.947697 17732 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71d06786cd934d00b253bc60eb2f0740" candidate_uuid: "6ef53eeb0b2b4676987701e7d3d273af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47ba6728b7364e75abaa8cccf1382970"
I20260811 08:03:33.947764 17883 raft_consensus.cc:3037] T 71d06786cd934d00b253bc60eb2f0740 P 05672f65a17c42d7a7cba31d85700725 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:03:33.947795 17732 raft_consensus.cc:3037] T 71d06786cd934d00b253bc60eb2f0740 P 47ba6728b7364e75abaa8cccf1382970 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:03:33.948504 17732 raft_consensus.cc:2454] T 71d06786cd934d00b253bc60eb2f0740 P 47ba6728b7364e75abaa8cccf1382970 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ef53eeb0b2b4676987701e7d3d273af in term 1.
I20260811 08:03:33.948699 17883 raft_consensus.cc:2454] T 71d06786cd934d00b253bc60eb2f0740 P 05672f65a17c42d7a7cba31d85700725 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ef53eeb0b2b4676987701e7d3d273af in term 1.
I20260811 08:03:33.948737 17504 leader_election.cc:302] T 71d06786cd934d00b253bc60eb2f0740 P 6ef53eeb0b2b4676987701e7d3d273af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47ba6728b7364e75abaa8cccf1382970, 6ef53eeb0b2b4676987701e7d3d273af; no voters:
I20260811 08:03:33.948856 17965 raft_consensus.cc:2781] T 71d06786cd934d00b253bc60eb2f0740 P 6ef53eeb0b2b4676987701e7d3d273af [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:03:33.948930 17965 raft_consensus.cc:686] T 71d06786cd934d00b253bc60eb2f0740 P 6ef53eeb0b2b4676987701e7d3d273af [term 1 LEADER]: Becoming Leader. State: Replica: 6ef53eeb0b2b4676987701e7d3d273af, State: Running, Role: LEADER
I20260811 08:03:33.948994 17965 consensus_queue.cc:237] T 71d06786cd934d00b253bc60eb2f0740 P 6ef53eeb0b2b4676987701e7d3d273af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef53eeb0b2b4676987701e7d3d273af" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 34467 } } peers { permanent_uuid: "47ba6728b7364e75abaa8cccf1382970" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45469 } } peers { permanent_uuid: "05672f65a17c42d7a7cba31d85700725" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 38289 } }
I20260811 08:03:33.950187 17401 catalog_manager.cc:5495] T 71d06786cd934d00b253bc60eb2f0740 P 6ef53eeb0b2b4676987701e7d3d273af reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ef53eeb0b2b4676987701e7d3d273af (127.15.36.193). New cstate: current_term: 1 leader_uuid: "6ef53eeb0b2b4676987701e7d3d273af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef53eeb0b2b4676987701e7d3d273af" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 34467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47ba6728b7364e75abaa8cccf1382970" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05672f65a17c42d7a7cba31d85700725" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 38289 } health_report { overall_health: UNKNOWN } } }
I20260811 08:03:33.982242 18071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:33.979452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40078 (local address 127.15.36.193:34467)
0811 08:03:33.979774 (+ 322us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:33.979776 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:33.979826 (+ 50us) server_negotiation.cc:407] Connection header received
0811 08:03:33.979854 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:33.979854 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:33.979866 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:33.979993 (+ 127us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:03:33.980162 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:33.980687 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:33.981485 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:33.981696 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:33.981777 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:33.981933 (+ 156us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:03:33.981974 (+ 41us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:03:33.982040 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:33.982101 (+ 61us) server_negotiation.cc:299] Negotiation successful
0811 08:03:33.982128 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":277,"thread_start_us":191,"threads_started":1}
I20260811 08:03:33.989391 18071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:33.986176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:50991 (local address 127.15.36.193:34467)
0811 08:03:33.986297 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:33.986299 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:33.986308 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:03:33.986334 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:33.986335 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:33.986346 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:33.986561 (+ 215us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:03:33.987028 (+ 467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:33.987691 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:33.988703 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:33.988926 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:33.988959 (+ 33us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:33.989139 (+ 180us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:03:33.989173 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:03:33.989229 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:33.989283 (+ 54us) server_negotiation.cc:299] Negotiation successful
0811 08:03:33.989309 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":96}
I20260811 08:03:33.989473 18075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:33.985990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.193:34467 (local address 127.15.36.193:50991)
0811 08:03:33.986204 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:33.986217 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:33.986285 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:33.986652 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:33.986653 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:33.986655 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 08:03:33.986702 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:33.986704 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:33.987808 (+ 1104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:33.987809 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:33.988564 (+ 755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:33.988567 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:33.989000 (+ 433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:33.989001 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:33.989031 (+ 30us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:33.989035 (+ 4us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 08:03:33.989241 (+ 206us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 08:03:33.989243 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 08:03:33.989279 (+ 36us) client_negotiation.cc:240] Negotiation successful
0811 08:03:33.989323 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":108,"threads_started":1}
I20260811 08:03:33.992272 17883 raft_consensus.cc:1261] T 71d06786cd934d00b253bc60eb2f0740 P 05672f65a17c42d7a7cba31d85700725 [term 1 FOLLOWER]: Refusing update from remote peer 6ef53eeb0b2b4676987701e7d3d273af: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:03:33.992331 17732 raft_consensus.cc:1261] T 71d06786cd934d00b253bc60eb2f0740 P 47ba6728b7364e75abaa8cccf1382970 [term 1 FOLLOWER]: Refusing update from remote peer 6ef53eeb0b2b4676987701e7d3d273af: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:03:33.992578 18029 consensus_queue.cc:1035] T 71d06786cd934d00b253bc60eb2f0740 P 6ef53eeb0b2b4676987701e7d3d273af [LEADER]: Connected to new peer: Peer: permanent_uuid: "05672f65a17c42d7a7cba31d85700725" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 38289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:03:33.992861 17965 consensus_queue.cc:1035] T 71d06786cd934d00b253bc60eb2f0740 P 6ef53eeb0b2b4676987701e7d3d273af [LEADER]: Connected to new peer: Peer: permanent_uuid: "47ba6728b7364e75abaa8cccf1382970" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:03:34.018321 17401 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40530:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:03:34.018478 17401 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40530:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:03:34.020088 17401 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 864969326d2e44c48a2c4a83b6b2c36d: Sending DeleteTablet for 3 replicas of tablet 71d06786cd934d00b253bc60eb2f0740
I20260811 08:03:34.020587 17710 tablet_service.cc:1514] Processing DeleteTablet for tablet 71d06786cd934d00b253bc60eb2f0740 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:03:34 UTC) from {username='kudu', principal='kudu/127.15.36.254@KRBTEST.COM'} at 127.0.0.1:52822
I20260811 08:03:34.020725 17862 tablet_service.cc:1514] Processing DeleteTablet for tablet 71d06786cd934d00b253bc60eb2f0740 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:03:34 UTC) from {username='kudu', principal='kudu/127.15.36.254@KRBTEST.COM'} at 127.0.0.1:58786
I20260811 08:03:34.020642 17556 tablet_service.cc:1514] Processing DeleteTablet for tablet 71d06786cd934d00b253bc60eb2f0740 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:03:34 UTC) from {username='kudu', principal='kudu/127.15.36.254@KRBTEST.COM'} at 127.0.0.1:40060
I20260811 08:03:34.020747 17401 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40530:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 08:03:34.020844 18049 tablet_replica.cc:330] T 71d06786cd934d00b253bc60eb2f0740 P 47ba6728b7364e75abaa8cccf1382970: stopping tablet replica
I20260811 08:03:34.020867 18050 tablet_replica.cc:330] T 71d06786cd934d00b253bc60eb2f0740 P 6ef53eeb0b2b4676987701e7d3d273af: stopping tablet replica
W20260811 08:03:34.020916 17401 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:03:34.020917 18049 raft_consensus.cc:2229] T 71d06786cd934d00b253bc60eb2f0740 P 47ba6728b7364e75abaa8cccf1382970 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:03:34.020929 18050 raft_consensus.cc:2229] T 71d06786cd934d00b253bc60eb2f0740 P 6ef53eeb0b2b4676987701e7d3d273af [term 1 LEADER]: Raft consensus shutting down.
I20260811 08:03:34.020965 18049 raft_consensus.cc:2258] T 71d06786cd934d00b253bc60eb2f0740 P 47ba6728b7364e75abaa8cccf1382970 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:03:34.021044 18050 raft_consensus.cc:2258] T 71d06786cd934d00b253bc60eb2f0740 P 6ef53eeb0b2b4676987701e7d3d273af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:03:34.021047 18051 tablet_replica.cc:330] T 71d06786cd934d00b253bc60eb2f0740 P 05672f65a17c42d7a7cba31d85700725: stopping tablet replica
I20260811 08:03:34.021123 18051 raft_consensus.cc:2229] T 71d06786cd934d00b253bc60eb2f0740 P 05672f65a17c42d7a7cba31d85700725 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:03:34.021174 18051 raft_consensus.cc:2258] T 71d06786cd934d00b253bc60eb2f0740 P 05672f65a17c42d7a7cba31d85700725 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:03:34.021462 18050 ts_tablet_manager.cc:1905] T 71d06786cd934d00b253bc60eb2f0740 P 6ef53eeb0b2b4676987701e7d3d273af: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:03:34.021679 18049 ts_tablet_manager.cc:1905] T 71d06786cd934d00b253bc60eb2f0740 P 47ba6728b7364e75abaa8cccf1382970: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:03:34.023514 18049 ts_tablet_manager.cc:1918] T 71d06786cd934d00b253bc60eb2f0740 P 47ba6728b7364e75abaa8cccf1382970: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 08:03:34.023592 18049 log.cc:1196] T 71d06786cd934d00b253bc60eb2f0740 P 47ba6728b7364e75abaa8cccf1382970: Deleting WAL directory at /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/ts-1/wal/wals/71d06786cd934d00b253bc60eb2f0740
I20260811 08:03:34.023733 18051 ts_tablet_manager.cc:1905] T 71d06786cd934d00b253bc60eb2f0740 P 05672f65a17c42d7a7cba31d85700725: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:03:34.023854 18049 ts_tablet_manager.cc:1939] T 71d06786cd934d00b253bc60eb2f0740 P 47ba6728b7364e75abaa8cccf1382970: Deleting consensus metadata
I20260811 08:03:34.024772 17556 tablet_service.cc:1467] Processing CreateTablet for tablet 4178a64c48ea4065beb060ef9f131573 (DEFAULT_TABLE table=test-table [id=94d3b43396ba4d10938befab72258d10]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:03:34.024899 17862 tablet_service.cc:1467] Processing CreateTablet for tablet 4178a64c48ea4065beb060ef9f131573 (DEFAULT_TABLE table=test-table [id=94d3b43396ba4d10938befab72258d10]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:03:34.025013 17862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4178a64c48ea4065beb060ef9f131573. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:03:34.025669 17710 tablet_service.cc:1467] Processing CreateTablet for tablet 4178a64c48ea4065beb060ef9f131573 (DEFAULT_TABLE table=test-table [id=94d3b43396ba4d10938befab72258d10]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:03:34.025705 18050 ts_tablet_manager.cc:1918] T 71d06786cd934d00b253bc60eb2f0740 P 6ef53eeb0b2b4676987701e7d3d273af: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 08:03:34.025722 17556 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4178a64c48ea4065beb060ef9f131573. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:03:34.025785 17710 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4178a64c48ea4065beb060ef9f131573. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:03:34.025764 18050 log.cc:1196] T 71d06786cd934d00b253bc60eb2f0740 P 6ef53eeb0b2b4676987701e7d3d273af: Deleting WAL directory at /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/ts-0/wal/wals/71d06786cd934d00b253bc60eb2f0740
I20260811 08:03:34.026060 18050 ts_tablet_manager.cc:1939] T 71d06786cd934d00b253bc60eb2f0740 P 6ef53eeb0b2b4676987701e7d3d273af: Deleting consensus metadata
I20260811 08:03:34.026687 18051 ts_tablet_manager.cc:1918] T 71d06786cd934d00b253bc60eb2f0740 P 05672f65a17c42d7a7cba31d85700725: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 08:03:34.026751 18051 log.cc:1196] T 71d06786cd934d00b253bc60eb2f0740 P 05672f65a17c42d7a7cba31d85700725: Deleting WAL directory at /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/ts-2/wal/wals/71d06786cd934d00b253bc60eb2f0740
I20260811 08:03:34.027035 18051 ts_tablet_manager.cc:1939] T 71d06786cd934d00b253bc60eb2f0740 P 05672f65a17c42d7a7cba31d85700725: Deleting consensus metadata
I20260811 08:03:34.027417 18062 tablet_bootstrap.cc:492] T 4178a64c48ea4065beb060ef9f131573 P 47ba6728b7364e75abaa8cccf1382970: Bootstrap starting.
I20260811 08:03:34.027612 18064 tablet_bootstrap.cc:492] T 4178a64c48ea4065beb060ef9f131573 P 6ef53eeb0b2b4676987701e7d3d273af: Bootstrap starting.
I20260811 08:03:34.027627 17383 catalog_manager.cc:4841] TS 6ef53eeb0b2b4676987701e7d3d273af (127.15.36.193:34467): tablet 71d06786cd934d00b253bc60eb2f0740 (table test-table [id=01a7864d2dbc4660b66774b29716a5c1]) successfully deleted
I20260811 08:03:34.027786 18062 tablet_bootstrap.cc:654] T 4178a64c48ea4065beb060ef9f131573 P 47ba6728b7364e75abaa8cccf1382970: Neither blocks nor log segments found. Creating new log.
I20260811 08:03:34.027967 18064 tablet_bootstrap.cc:654] T 4178a64c48ea4065beb060ef9f131573 P 6ef53eeb0b2b4676987701e7d3d273af: Neither blocks nor log segments found. Creating new log.
I20260811 08:03:34.028498 18062 tablet_bootstrap.cc:492] T 4178a64c48ea4065beb060ef9f131573 P 47ba6728b7364e75abaa8cccf1382970: No bootstrap required, opened a new log
I20260811 08:03:34.028564 18062 ts_tablet_manager.cc:1397] T 4178a64c48ea4065beb060ef9f131573 P 47ba6728b7364e75abaa8cccf1382970: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 08:03:34.028700 18062 raft_consensus.cc:348] T 4178a64c48ea4065beb060ef9f131573 P 47ba6728b7364e75abaa8cccf1382970 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef53eeb0b2b4676987701e7d3d273af" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 34467 } } peers { permanent_uuid: "47ba6728b7364e75abaa8cccf1382970" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45469 } } peers { permanent_uuid: "05672f65a17c42d7a7cba31d85700725" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 38289 } }
I20260811 08:03:34.028784 18062 raft_consensus.cc:374] T 4178a64c48ea4065beb060ef9f131573 P 47ba6728b7364e75abaa8cccf1382970 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:03:34.028806 18062 raft_consensus.cc:729] T 4178a64c48ea4065beb060ef9f131573 P 47ba6728b7364e75abaa8cccf1382970 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47ba6728b7364e75abaa8cccf1382970, State: Initialized, Role: FOLLOWER
I20260811 08:03:34.028872 18062 consensus_queue.cc:260] T 4178a64c48ea4065beb060ef9f131573 P 47ba6728b7364e75abaa8cccf1382970 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef53eeb0b2b4676987701e7d3d273af" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 34467 } } peers { permanent_uuid: "47ba6728b7364e75abaa8cccf1382970" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45469 } } peers { permanent_uuid: "05672f65a17c42d7a7cba31d85700725" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 38289 } }
I20260811 08:03:34.028980 18062 ts_tablet_manager.cc:1428] T 4178a64c48ea4065beb060ef9f131573 P 47ba6728b7364e75abaa8cccf1382970: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 08:03:34.029284 18061 tablet_bootstrap.cc:492] T 4178a64c48ea4065beb060ef9f131573 P 05672f65a17c42d7a7cba31d85700725: Bootstrap starting.
I20260811 08:03:34.029428 17386 catalog_manager.cc:4841] TS 47ba6728b7364e75abaa8cccf1382970 (127.15.36.194:45469): tablet 71d06786cd934d00b253bc60eb2f0740 (table test-table [id=01a7864d2dbc4660b66774b29716a5c1]) successfully deleted
I20260811 08:03:34.029546 17386 catalog_manager.cc:4841] TS 05672f65a17c42d7a7cba31d85700725 (127.15.36.195:38289): tablet 71d06786cd934d00b253bc60eb2f0740 (table test-table [id=01a7864d2dbc4660b66774b29716a5c1]) successfully deleted
I20260811 08:03:34.029809 18061 tablet_bootstrap.cc:654] T 4178a64c48ea4065beb060ef9f131573 P 05672f65a17c42d7a7cba31d85700725: Neither blocks nor log segments found. Creating new log.
I20260811 08:03:34.030762 18064 tablet_bootstrap.cc:492] T 4178a64c48ea4065beb060ef9f131573 P 6ef53eeb0b2b4676987701e7d3d273af: No bootstrap required, opened a new log
I20260811 08:03:34.030887 18064 ts_tablet_manager.cc:1397] T 4178a64c48ea4065beb060ef9f131573 P 6ef53eeb0b2b4676987701e7d3d273af: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260811 08:03:34.031067 18064 raft_consensus.cc:348] T 4178a64c48ea4065beb060ef9f131573 P 6ef53eeb0b2b4676987701e7d3d273af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef53eeb0b2b4676987701e7d3d273af" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 34467 } } peers { permanent_uuid: "47ba6728b7364e75abaa8cccf1382970" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45469 } } peers { permanent_uuid: "05672f65a17c42d7a7cba31d85700725" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 38289 } }
I20260811 08:03:34.031165 18064 raft_consensus.cc:374] T 4178a64c48ea4065beb060ef9f131573 P 6ef53eeb0b2b4676987701e7d3d273af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:03:34.031188 18064 raft_consensus.cc:729] T 4178a64c48ea4065beb060ef9f131573 P 6ef53eeb0b2b4676987701e7d3d273af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ef53eeb0b2b4676987701e7d3d273af, State: Initialized, Role: FOLLOWER
I20260811 08:03:34.031234 18064 consensus_queue.cc:260] T 4178a64c48ea4065beb060ef9f131573 P 6ef53eeb0b2b4676987701e7d3d273af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef53eeb0b2b4676987701e7d3d273af" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 34467 } } peers { permanent_uuid: "47ba6728b7364e75abaa8cccf1382970" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45469 } } peers { permanent_uuid: "05672f65a17c42d7a7cba31d85700725" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 38289 } }
I20260811 08:03:34.031329 18064 ts_tablet_manager.cc:1428] T 4178a64c48ea4065beb060ef9f131573 P 6ef53eeb0b2b4676987701e7d3d273af: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 08:03:34.031714 18061 tablet_bootstrap.cc:492] T 4178a64c48ea4065beb060ef9f131573 P 05672f65a17c42d7a7cba31d85700725: No bootstrap required, opened a new log
I20260811 08:03:34.031775 18061 ts_tablet_manager.cc:1397] T 4178a64c48ea4065beb060ef9f131573 P 05672f65a17c42d7a7cba31d85700725: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260811 08:03:34.031900 18061 raft_consensus.cc:348] T 4178a64c48ea4065beb060ef9f131573 P 05672f65a17c42d7a7cba31d85700725 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef53eeb0b2b4676987701e7d3d273af" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 34467 } } peers { permanent_uuid: "47ba6728b7364e75abaa8cccf1382970" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45469 } } peers { permanent_uuid: "05672f65a17c42d7a7cba31d85700725" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 38289 } }
I20260811 08:03:34.031966 18061 raft_consensus.cc:374] T 4178a64c48ea4065beb060ef9f131573 P 05672f65a17c42d7a7cba31d85700725 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:03:34.031985 18061 raft_consensus.cc:729] T 4178a64c48ea4065beb060ef9f131573 P 05672f65a17c42d7a7cba31d85700725 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05672f65a17c42d7a7cba31d85700725, State: Initialized, Role: FOLLOWER
I20260811 08:03:34.032033 18061 consensus_queue.cc:260] T 4178a64c48ea4065beb060ef9f131573 P 05672f65a17c42d7a7cba31d85700725 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef53eeb0b2b4676987701e7d3d273af" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 34467 } } peers { permanent_uuid: "47ba6728b7364e75abaa8cccf1382970" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45469 } } peers { permanent_uuid: "05672f65a17c42d7a7cba31d85700725" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 38289 } }
I20260811 08:03:34.032120 18061 ts_tablet_manager.cc:1428] T 4178a64c48ea4065beb060ef9f131573 P 05672f65a17c42d7a7cba31d85700725: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 08:03:34.180137 18025 raft_consensus.cc:482] T 4178a64c48ea4065beb060ef9f131573 P 47ba6728b7364e75abaa8cccf1382970 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:03:34.180266 18025 raft_consensus.cc:504] T 4178a64c48ea4065beb060ef9f131573 P 47ba6728b7364e75abaa8cccf1382970 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef53eeb0b2b4676987701e7d3d273af" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 34467 } } peers { permanent_uuid: "47ba6728b7364e75abaa8cccf1382970" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45469 } } peers { permanent_uuid: "05672f65a17c42d7a7cba31d85700725" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 38289 } }
I20260811 08:03:34.180483 18025 leader_election.cc:288] T 4178a64c48ea4065beb060ef9f131573 P 47ba6728b7364e75abaa8cccf1382970 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ef53eeb0b2b4676987701e7d3d273af (127.15.36.193:34467), 05672f65a17c42d7a7cba31d85700725 (127.15.36.195:38289)
I20260811 08:03:34.180838 17882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4178a64c48ea4065beb060ef9f131573" candidate_uuid: "47ba6728b7364e75abaa8cccf1382970" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05672f65a17c42d7a7cba31d85700725" is_pre_election: true
I20260811 08:03:34.180855 17578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4178a64c48ea4065beb060ef9f131573" candidate_uuid: "47ba6728b7364e75abaa8cccf1382970" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ef53eeb0b2b4676987701e7d3d273af" is_pre_election: true
I20260811 08:03:34.180943 17882 raft_consensus.cc:2454] T 4178a64c48ea4065beb060ef9f131573 P 05672f65a17c42d7a7cba31d85700725 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47ba6728b7364e75abaa8cccf1382970 in term 0.
I20260811 08:03:34.180970 17578 raft_consensus.cc:2454] T 4178a64c48ea4065beb060ef9f131573 P 6ef53eeb0b2b4676987701e7d3d273af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47ba6728b7364e75abaa8cccf1382970 in term 0.
I20260811 08:03:34.181133 17662 leader_election.cc:302] T 4178a64c48ea4065beb060ef9f131573 P 47ba6728b7364e75abaa8cccf1382970 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05672f65a17c42d7a7cba31d85700725, 47ba6728b7364e75abaa8cccf1382970; no voters:
I20260811 08:03:34.181239 18025 raft_consensus.cc:2781] T 4178a64c48ea4065beb060ef9f131573 P 47ba6728b7364e75abaa8cccf1382970 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:03:34.181332 18025 raft_consensus.cc:482] T 4178a64c48ea4065beb060ef9f131573 P 47ba6728b7364e75abaa8cccf1382970 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:03:34.181386 18025 raft_consensus.cc:3037] T 4178a64c48ea4065beb060ef9f131573 P 47ba6728b7364e75abaa8cccf1382970 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:03:34.182154 18025 raft_consensus.cc:504] T 4178a64c48ea4065beb060ef9f131573 P 47ba6728b7364e75abaa8cccf1382970 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef53eeb0b2b4676987701e7d3d273af" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 34467 } } peers { permanent_uuid: "47ba6728b7364e75abaa8cccf1382970" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45469 } } peers { permanent_uuid: "05672f65a17c42d7a7cba31d85700725" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 38289 } }
I20260811 08:03:34.182583 18025 leader_election.cc:288] T 4178a64c48ea4065beb060ef9f131573 P 47ba6728b7364e75abaa8cccf1382970 [CANDIDATE]: Term 1 election: Requested vote from peers 6ef53eeb0b2b4676987701e7d3d273af (127.15.36.193:34467), 05672f65a17c42d7a7cba31d85700725 (127.15.36.195:38289)
I20260811 08:03:34.182870 17882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4178a64c48ea4065beb060ef9f131573" candidate_uuid: "47ba6728b7364e75abaa8cccf1382970" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05672f65a17c42d7a7cba31d85700725"
I20260811 08:03:34.183015 17882 raft_consensus.cc:3037] T 4178a64c48ea4065beb060ef9f131573 P 05672f65a17c42d7a7cba31d85700725 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:03:34.182996 17578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4178a64c48ea4065beb060ef9f131573" candidate_uuid: "47ba6728b7364e75abaa8cccf1382970" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ef53eeb0b2b4676987701e7d3d273af"
I20260811 08:03:34.183116 17578 raft_consensus.cc:3037] T 4178a64c48ea4065beb060ef9f131573 P 6ef53eeb0b2b4676987701e7d3d273af [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:03:34.184051 17882 raft_consensus.cc:2454] T 4178a64c48ea4065beb060ef9f131573 P 05672f65a17c42d7a7cba31d85700725 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47ba6728b7364e75abaa8cccf1382970 in term 1.
I20260811 08:03:34.184051 17578 raft_consensus.cc:2454] T 4178a64c48ea4065beb060ef9f131573 P 6ef53eeb0b2b4676987701e7d3d273af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47ba6728b7364e75abaa8cccf1382970 in term 1.
I20260811 08:03:34.184254 17662 leader_election.cc:302] T 4178a64c48ea4065beb060ef9f131573 P 47ba6728b7364e75abaa8cccf1382970 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05672f65a17c42d7a7cba31d85700725, 47ba6728b7364e75abaa8cccf1382970; no voters:
I20260811 08:03:34.184384 18025 raft_consensus.cc:2781] T 4178a64c48ea4065beb060ef9f131573 P 47ba6728b7364e75abaa8cccf1382970 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:03:34.184478 18025 raft_consensus.cc:686] T 4178a64c48ea4065beb060ef9f131573 P 47ba6728b7364e75abaa8cccf1382970 [term 1 LEADER]: Becoming Leader. State: Replica: 47ba6728b7364e75abaa8cccf1382970, State: Running, Role: LEADER
I20260811 08:03:34.184548 18025 consensus_queue.cc:237] T 4178a64c48ea4065beb060ef9f131573 P 47ba6728b7364e75abaa8cccf1382970 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef53eeb0b2b4676987701e7d3d273af" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 34467 } } peers { permanent_uuid: "47ba6728b7364e75abaa8cccf1382970" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45469 } } peers { permanent_uuid: "05672f65a17c42d7a7cba31d85700725" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 38289 } }
I20260811 08:03:34.185458 17401 catalog_manager.cc:5495] T 4178a64c48ea4065beb060ef9f131573 P 47ba6728b7364e75abaa8cccf1382970 reported cstate change: term changed from 0 to 1, leader changed from <none> to 47ba6728b7364e75abaa8cccf1382970 (127.15.36.194). New cstate: current_term: 1 leader_uuid: "47ba6728b7364e75abaa8cccf1382970" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef53eeb0b2b4676987701e7d3d273af" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 34467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47ba6728b7364e75abaa8cccf1382970" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05672f65a17c42d7a7cba31d85700725" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 38289 } health_report { overall_health: UNKNOWN } } }
I20260811 08:03:34.231566 18084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:34.227784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52844 (local address 127.15.36.194:45469)
0811 08:03:34.228032 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:34.228034 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:34.228043 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:03:34.228065 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:34.228066 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:34.228077 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:34.228156 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:03:34.228383 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:34.228987 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:34.230138 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:34.230371 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:34.230449 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:34.230653 (+ 204us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:03:34.230691 (+ 38us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:03:34.230757 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:34.231253 (+ 496us) server_negotiation.cc:299] Negotiation successful
0811 08:03:34.231444 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":216,"thread_start_us":154,"threads_started":1}
I20260811 08:03:34.236708 17578 raft_consensus.cc:1261] T 4178a64c48ea4065beb060ef9f131573 P 6ef53eeb0b2b4676987701e7d3d273af [term 1 FOLLOWER]: Refusing update from remote peer 47ba6728b7364e75abaa8cccf1382970: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:03:34.236752 17882 raft_consensus.cc:1261] T 4178a64c48ea4065beb060ef9f131573 P 05672f65a17c42d7a7cba31d85700725 [term 1 FOLLOWER]: Refusing update from remote peer 47ba6728b7364e75abaa8cccf1382970: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:03:34.237010 18025 consensus_queue.cc:1035] T 4178a64c48ea4065beb060ef9f131573 P 47ba6728b7364e75abaa8cccf1382970 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ef53eeb0b2b4676987701e7d3d273af" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 34467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:03:34.237210 18025 consensus_queue.cc:1035] T 4178a64c48ea4065beb060ef9f131573 P 47ba6728b7364e75abaa8cccf1382970 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05672f65a17c42d7a7cba31d85700725" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 38289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 08:03:34.243829 18032 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260811 08:03:35.774704 17400 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40530:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:03:35.774843 17400 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40530:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:03:35.776592 17400 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 864969326d2e44c48a2c4a83b6b2c36d: Sending DeleteTablet for 3 replicas of tablet 4178a64c48ea4065beb060ef9f131573
I20260811 08:03:35.777012 17555 tablet_service.cc:1514] Processing DeleteTablet for tablet 4178a64c48ea4065beb060ef9f131573 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:03:35 UTC) from {username='kudu', principal='kudu/127.15.36.254@KRBTEST.COM'} at 127.0.0.1:40060
I20260811 08:03:35.777043 17710 tablet_service.cc:1514] Processing DeleteTablet for tablet 4178a64c48ea4065beb060ef9f131573 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:03:35 UTC) from {username='kudu', principal='kudu/127.15.36.254@KRBTEST.COM'} at 127.0.0.1:52822
I20260811 08:03:35.777038 17862 tablet_service.cc:1514] Processing DeleteTablet for tablet 4178a64c48ea4065beb060ef9f131573 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:03:35 UTC) from {username='kudu', principal='kudu/127.15.36.254@KRBTEST.COM'} at 127.0.0.1:58786
I20260811 08:03:35.777168 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 17480
I20260811 08:03:35.783284 18115 tablet_replica.cc:330] T 4178a64c48ea4065beb060ef9f131573 P 47ba6728b7364e75abaa8cccf1382970: stopping tablet replica
I20260811 08:03:35.783438 18115 raft_consensus.cc:2229] T 4178a64c48ea4065beb060ef9f131573 P 47ba6728b7364e75abaa8cccf1382970 [term 1 LEADER]: Raft consensus shutting down.
I20260811 08:03:35.783550 18115 raft_consensus.cc:2258] T 4178a64c48ea4065beb060ef9f131573 P 47ba6728b7364e75abaa8cccf1382970 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:03:35.783730 18117 tablet_replica.cc:330] T 4178a64c48ea4065beb060ef9f131573 P 05672f65a17c42d7a7cba31d85700725: stopping tablet replica
I20260811 08:03:35.783810 18117 raft_consensus.cc:2229] T 4178a64c48ea4065beb060ef9f131573 P 05672f65a17c42d7a7cba31d85700725 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:03:35.783892 18117 raft_consensus.cc:2258] T 4178a64c48ea4065beb060ef9f131573 P 05672f65a17c42d7a7cba31d85700725 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:03:35.784183 18115 ts_tablet_manager.cc:1905] T 4178a64c48ea4065beb060ef9f131573 P 47ba6728b7364e75abaa8cccf1382970: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:03:35.785864 18117 ts_tablet_manager.cc:1905] T 4178a64c48ea4065beb060ef9f131573 P 05672f65a17c42d7a7cba31d85700725: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:03:35.786315 18115 ts_tablet_manager.cc:1918] T 4178a64c48ea4065beb060ef9f131573 P 47ba6728b7364e75abaa8cccf1382970: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 08:03:35.786432 18115 log.cc:1196] T 4178a64c48ea4065beb060ef9f131573 P 47ba6728b7364e75abaa8cccf1382970: Deleting WAL directory at /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/ts-1/wal/wals/4178a64c48ea4065beb060ef9f131573
I20260811 08:03:35.786733 18115 ts_tablet_manager.cc:1939] T 4178a64c48ea4065beb060ef9f131573 P 47ba6728b7364e75abaa8cccf1382970: Deleting consensus metadata
I20260811 08:03:35.787271 17386 catalog_manager.cc:4841] TS 47ba6728b7364e75abaa8cccf1382970 (127.15.36.194:45469): tablet 4178a64c48ea4065beb060ef9f131573 (table test-table [id=94d3b43396ba4d10938befab72258d10]) successfully deleted
W20260811 08:03:35.788347 17383 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.36.193:34467 (error 108)
I20260811 08:03:35.788520 18117 ts_tablet_manager.cc:1918] T 4178a64c48ea4065beb060ef9f131573 P 05672f65a17c42d7a7cba31d85700725: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 08:03:35.788601 18117 log.cc:1196] T 4178a64c48ea4065beb060ef9f131573 P 05672f65a17c42d7a7cba31d85700725: Deleting WAL directory at /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786435400844580-15507-0/minicluster-data/ts-2/wal/wals/4178a64c48ea4065beb060ef9f131573
I20260811 08:03:35.788735 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 17640
I20260811 08:03:35.790828 18117 ts_tablet_manager.cc:1939] T 4178a64c48ea4065beb060ef9f131573 P 05672f65a17c42d7a7cba31d85700725: Deleting consensus metadata
I20260811 08:03:35.793599 17386 catalog_manager.cc:4841] TS 05672f65a17c42d7a7cba31d85700725 (127.15.36.195:38289): tablet 4178a64c48ea4065beb060ef9f131573 (table test-table [id=94d3b43396ba4d10938befab72258d10]) successfully deleted
I20260811 08:03:35.797140 18119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:35.788923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.193:34467 (local address 127.0.0.1:40094)
0811 08:03:35.793486 (+ 4563us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:35.797040 (+ 3554us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.193:34467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":4493,"thread_start_us":82,"threads_started":1}
W20260811 08:03:35.797814 17383 catalog_manager.cc:4584] TS 6ef53eeb0b2b4676987701e7d3d273af (127.15.36.193:34467): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4178a64c48ea4065beb060ef9f131573: Network error: Client connection negotiation failed: client connection to 127.15.36.193:34467: connect: Connection refused (error 111)
I20260811 08:03:35.808653 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 17790
I20260811 08:03:35.819566 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 17367
2026-08-11T08:03:35Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6520 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:03:35 dist-test-slave-2w3w krb5kdc[18122](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:03:35 dist-test-slave-2w3w krb5kdc[18122](info): set up 2 sockets
Aug 11 08:03:35 dist-test-slave-2w3w krb5kdc[18122](info): commencing operation
krb5kdc: starting...
W20260811 08:03:37.110670 15507 mini_kdc.cc:121] Time spent starting KDC: real 1.265s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Aug 11 08:03:37 dist-test-slave-2w3w krb5kdc[18122](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435417, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:03:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:03:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.36.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab.
Entry for principal kudu/127.15.36.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab.
I20260811 08:03:37.280869 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:34569
--webserver_interface=127.15.36.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=kudu/127.15.36.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:38863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.36.254:34569
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:03:37.383793 18136 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:03:37.384075 18136 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:03:37.384104 18136 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:03:37.385696 18136 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:03:37.385772 18136 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:03:37.385789 18136 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:03:37.385804 18136 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:03:37.385831 18136 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:03:37.387974 18136 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:38863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.36.254:34569
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=kudu/127.15.36.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:34569
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.36.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18136
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:03:37.388332 18136 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:03:37.388644 18136 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:03:37.395596 18143 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:37.395574 18145 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:37.395574 18142 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:03:37.395574 18136 server_base.cc:1034] running on GCE node
I20260811 08:03:37.396173 18136 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:03:37.396473 18136 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:03:37.397677 18136 hybrid_clock.cc:648] HybridClock initialized: now 1786435417397658 us; error 37 us; skew 500 ppm
Aug 11 08:03:37 dist-test-slave-2w3w krb5kdc[18122](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435417, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:03:37.401855 18136 init.cc:377] Logged in from keytab as kudu/127.15.36.254@KRBTEST.COM (short username kudu)
I20260811 08:03:37.402554 18136 webserver.cc:460] Webserver started at http://127.15.36.254:37131/ using document root <none> and password file <none>
I20260811 08:03:37.402848 18136 fs_manager.cc:359] Metadata directory not provided
I20260811 08:03:37.402926 18136 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:03:37.403152 18136 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:03:37.404605 18136 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/minicluster-data/master-0/data/instance:
uuid: "8cbb27d335c34ef0882a97ca28e5f322"
format_stamp: "Formatted at 2026-08-11 08:03:37 on dist-test-slave-2w3w"
server_key: "2029775d2f7846cf8f28d977e61d06ad"
server_key_iv: "57e6350adc694a8c18e01de80ef18e17"
server_key_version: "encryptionkey@0"
I20260811 08:03:37.405239 18136 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/minicluster-data/master-0/wal/instance:
uuid: "8cbb27d335c34ef0882a97ca28e5f322"
format_stamp: "Formatted at 2026-08-11 08:03:37 on dist-test-slave-2w3w"
server_key: "2029775d2f7846cf8f28d977e61d06ad"
server_key_iv: "57e6350adc694a8c18e01de80ef18e17"
server_key_version: "encryptionkey@0"
I20260811 08:03:37.407361 18136 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260811 08:03:37.408456 18154 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:37.408855 18136 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:03:37.409060 18136 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/minicluster-data/master-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/minicluster-data/master-0/wal
uuid: "8cbb27d335c34ef0882a97ca28e5f322"
format_stamp: "Formatted at 2026-08-11 08:03:37 on dist-test-slave-2w3w"
server_key: "2029775d2f7846cf8f28d977e61d06ad"
server_key_iv: "57e6350adc694a8c18e01de80ef18e17"
server_key_version: "encryptionkey@0"
I20260811 08:03:37.409181 18136 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:03:37.452514 18136 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:03:37.454870 18136 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:03:37.455123 18136 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:03:37.459342 18136 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.254:34569
I20260811 08:03:37.459390 18208 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.254:34569 every 8 connection(s)
I20260811 08:03:37.459812 18136 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
I20260811 08:03:37.460796 18209 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:03:37.463548 18209 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8cbb27d335c34ef0882a97ca28e5f322: Bootstrap starting.
I20260811 08:03:37.464154 18209 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8cbb27d335c34ef0882a97ca28e5f322: Neither blocks nor log segments found. Creating new log.
I20260811 08:03:37.464414 18209 log.cc:824] T 00000000000000000000000000000000 P 8cbb27d335c34ef0882a97ca28e5f322: Log is configured to *not* fsync() on all Append() calls
I20260811 08:03:37.465227 18209 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8cbb27d335c34ef0882a97ca28e5f322: No bootstrap required, opened a new log
I20260811 08:03:37.466925 18209 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8cbb27d335c34ef0882a97ca28e5f322 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cbb27d335c34ef0882a97ca28e5f322" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 34569 } }
I20260811 08:03:37.467178 18209 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8cbb27d335c34ef0882a97ca28e5f322 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:03:37.467207 18209 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8cbb27d335c34ef0882a97ca28e5f322 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cbb27d335c34ef0882a97ca28e5f322, State: Initialized, Role: FOLLOWER
I20260811 08:03:37.467363 18209 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8cbb27d335c34ef0882a97ca28e5f322 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cbb27d335c34ef0882a97ca28e5f322" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 34569 } }
I20260811 08:03:37.467464 18209 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8cbb27d335c34ef0882a97ca28e5f322 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:03:37.467489 18209 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8cbb27d335c34ef0882a97ca28e5f322 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:03:37.467522 18209 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8cbb27d335c34ef0882a97ca28e5f322 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:03:37.468128 18209 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8cbb27d335c34ef0882a97ca28e5f322 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cbb27d335c34ef0882a97ca28e5f322" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 34569 } }
I20260811 08:03:37.468222 18209 leader_election.cc:302] T 00000000000000000000000000000000 P 8cbb27d335c34ef0882a97ca28e5f322 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8cbb27d335c34ef0882a97ca28e5f322; no voters:
I20260811 08:03:37.468381 18209 leader_election.cc:288] T 00000000000000000000000000000000 P 8cbb27d335c34ef0882a97ca28e5f322 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:03:37.468495 18212 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8cbb27d335c34ef0882a97ca28e5f322 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:03:37.468719 18209 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8cbb27d335c34ef0882a97ca28e5f322 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:03:37.468727 18212 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8cbb27d335c34ef0882a97ca28e5f322 [term 1 LEADER]: Becoming Leader. State: Replica: 8cbb27d335c34ef0882a97ca28e5f322, State: Running, Role: LEADER
I20260811 08:03:37.468896 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 18136
I20260811 08:03:37.468983 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/minicluster-data/master-0/wal/instance
I20260811 08:03:37.469071 18212 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8cbb27d335c34ef0882a97ca28e5f322 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cbb27d335c34ef0882a97ca28e5f322" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 34569 } }
I20260811 08:03:37.469161 15507 external_mini_cluster.cc:1428] Setting key 0a035d7705526ce5a502f35dcc372c87
I20260811 08:03:37.470114 18213 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8cbb27d335c34ef0882a97ca28e5f322 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8cbb27d335c34ef0882a97ca28e5f322" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cbb27d335c34ef0882a97ca28e5f322" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 34569 } } }
I20260811 08:03:37.470114 18214 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8cbb27d335c34ef0882a97ca28e5f322 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8cbb27d335c34ef0882a97ca28e5f322. Latest consensus state: current_term: 1 leader_uuid: "8cbb27d335c34ef0882a97ca28e5f322" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cbb27d335c34ef0882a97ca28e5f322" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 34569 } } }
I20260811 08:03:37.470266 18214 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8cbb27d335c34ef0882a97ca28e5f322 [sys.catalog]: This master's current role is: LEADER
I20260811 08:03:37.470263 18213 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8cbb27d335c34ef0882a97ca28e5f322 [sys.catalog]: This master's current role is: LEADER
W20260811 08:03:37.471009 18229 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8cbb27d335c34ef0882a97ca28e5f322: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 08:03:37.471095 18229 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 08:03:37.471181 18230 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:03:37.471463 18230 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:03:37.473203 18230 catalog_manager.cc:1347] Generated new cluster ID: 08a6b9c83f354eab85cb7792d21fe12b
I20260811 08:03:37.473264 18230 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 08:03:37 dist-test-slave-2w3w krb5kdc[18122](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435417, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:03:37.481096 18230 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:03:37.482012 18222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:37.469760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55880 (local address 127.15.36.254:34569)
0811 08:03:37.470038 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:37.470067 (+ 29us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:37.470250 (+ 183us) server_negotiation.cc:407] Connection header received
0811 08:03:37.470596 (+ 346us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:37.470605 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:37.470702 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:37.471506 (+ 804us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:37.471992 (+ 486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:37.473350 (+ 1358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:37.474125 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:37.474600 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:37.474752 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:37.477242 (+ 2490us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:37.477247 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:37.477248 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:37.477270 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:37.479569 (+ 2299us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:37.479978 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:37.480070 (+ 92us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:37.480071 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:37.480245 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:37.480550 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:37.480551 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:37.480551 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:37.480932 (+ 381us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:37.481244 (+ 312us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:37.481513 (+ 269us) server_negotiation.cc:299] Negotiation successful
0811 08:03:37.481790 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":83,"threads_started":1}
I20260811 08:03:37.482097 18230 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:03:37.491168 18230 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8cbb27d335c34ef0882a97ca28e5f322: Generated new TSK 0
I20260811 08:03:37.491448 18230 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.36.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab.
Entry for principal kudu/127.15.36.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab.
I20260811 08:03:37.540863 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.193:0
--local_ip_for_outbound_sockets=127.15.36.193
--webserver_interface=127.15.36.193
--webserver_port=0
--tserver_master_addrs=127.15.36.254:34569
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab
--principal=kudu/127.15.36.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:38863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:03:37.644407 18236 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:03:37.644706 18236 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:03:37.644766 18236 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:03:37.646499 18236 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:03:37.646610 18236 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:03:37.646672 18236 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.193
I20260811 08:03:37.648891 18236 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:38863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab
--principal=kudu/127.15.36.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.36.193
--webserver_port=0
--tserver_master_addrs=127.15.36.254:34569
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18236
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.193
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:03:37.649289 18236 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:03:37.649598 18236 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:03:37.656050 18242 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:37.656105 18244 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:37.656123 18241 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:03:37.656127 18236 server_base.cc:1034] running on GCE node
I20260811 08:03:37.656615 18236 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:03:37.656857 18236 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:03:37.658116 18236 hybrid_clock.cc:648] HybridClock initialized: now 1786435417658091 us; error 101 us; skew 500 ppm
Aug 11 08:03:37 dist-test-slave-2w3w krb5kdc[18122](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435417, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:03:37.663082 18236 init.cc:377] Logged in from keytab as kudu/127.15.36.193@KRBTEST.COM (short username kudu)
I20260811 08:03:37.663653 18236 webserver.cc:460] Webserver started at http://127.15.36.193:37659/ using document root <none> and password file <none>
I20260811 08:03:37.663961 18236 fs_manager.cc:359] Metadata directory not provided
I20260811 08:03:37.664048 18236 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:03:37.664227 18236 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:03:37.665489 18236 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-0/data/instance:
uuid: "9c409491734748779cfd734a91092b57"
format_stamp: "Formatted at 2026-08-11 08:03:37 on dist-test-slave-2w3w"
server_key: "49856fdf84bba4e29a17db2b2e841ce8"
server_key_iv: "9037404bf780fc95b3aca272b8980c77"
server_key_version: "encryptionkey@0"
I20260811 08:03:37.665958 18236 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-0/wal/instance:
uuid: "9c409491734748779cfd734a91092b57"
format_stamp: "Formatted at 2026-08-11 08:03:37 on dist-test-slave-2w3w"
server_key: "49856fdf84bba4e29a17db2b2e841ce8"
server_key_iv: "9037404bf780fc95b3aca272b8980c77"
server_key_version: "encryptionkey@0"
I20260811 08:03:37.667775 18236 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260811 08:03:37.669219 18252 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:37.669425 18236 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:03:37.669567 18236 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-0/wal
uuid: "9c409491734748779cfd734a91092b57"
format_stamp: "Formatted at 2026-08-11 08:03:37 on dist-test-slave-2w3w"
server_key: "49856fdf84bba4e29a17db2b2e841ce8"
server_key_iv: "9037404bf780fc95b3aca272b8980c77"
server_key_version: "encryptionkey@0"
I20260811 08:03:37.669669 18236 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:03:37.706198 18236 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:03:37.709585 18236 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:03:37.709738 18236 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:03:37.710347 18236 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:03:37.711382 18236 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:03:37.711460 18236 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:37.711489 18236 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:03:37.711503 18236 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:37.720798 18236 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.193:35573
I20260811 08:03:37.720923 18377 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.193:35573 every 8 connection(s)
I20260811 08:03:37.721262 18236 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
Aug 11 08:03:37 dist-test-slave-2w3w krb5kdc[18122](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435417, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.193@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:03:37.729422 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 18236
I20260811 08:03:37.729524 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-0/wal/instance
I20260811 08:03:37.729884 15507 external_mini_cluster.cc:1428] Setting key 63af45f5ae918ec8b03df10104ae36c2
I20260811 08:03:37.734040 18222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:37.722311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:60013 (local address 127.15.36.254:34569)
0811 08:03:37.722444 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:37.722447 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:37.722632 (+ 185us) server_negotiation.cc:407] Connection header received
0811 08:03:37.723259 (+ 627us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:37.723261 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:37.723275 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:37.723348 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:37.724536 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:37.725173 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:37.726616 (+ 1443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:37.726872 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:37.727056 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:37.730136 (+ 3080us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:37.730140 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:37.730141 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:37.730157 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:37.732076 (+ 1919us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:37.732723 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:37.732724 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:37.732725 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:37.732911 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:37.733255 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:37.733256 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:37.733256 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:37.733413 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:37.733493 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:37.733818 (+ 325us) server_negotiation.cc:299] Negotiation successful
0811 08:03:37.733942 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260811 08:03:37.734308 18380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:37.722200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:34569 (local address 127.15.36.193:60013)
0811 08:03:37.722416 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:37.722470 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:37.723130 (+ 660us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:37.723411 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:37.723414 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:37.724098 (+ 684us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:03:37.724334 (+ 236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:37.724340 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:37.725412 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:37.725413 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:37.726435 (+ 1022us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:37.726440 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:37.727287 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:37.727288 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:37.727481 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:37.728204 (+ 723us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:03:37.728214 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:03:37.729995 (+ 1781us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:03:37.732190 (+ 2195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:37.732203 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:37.732206 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:37.732638 (+ 432us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:37.733036 (+ 398us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:37.733037 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:37.733037 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:37.733178 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:37.733495 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:03:37.733504 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:03:37.733667 (+ 163us) client_negotiation.cc:769] Sending connection context
0811 08:03:37.733783 (+ 116us) client_negotiation.cc:240] Negotiation successful
0811 08:03:37.733978 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":110,"threads_started":1}
I20260811 08:03:37.735237 18378 heartbeater.cc:347] Connected to a master server at 127.15.36.254:34569
I20260811 08:03:37.735442 18378 heartbeater.cc:464] Registering TS with master...
I20260811 08:03:37.735805 18378 heartbeater.cc:511] Master 127.15.36.254:34569 requested a full tablet report, sending...
I20260811 08:03:37.736732 18172 ts_manager.cc:194] Registered new tserver with Master: 9c409491734748779cfd734a91092b57 (127.15.36.193:35573)
I20260811 08:03:37.737969 18172 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.36.193@KRBTEST.COM'} at 127.15.36.193:60013
WARNING: no policy specified for kudu/127.15.36.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab.
Entry for principal kudu/127.15.36.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab.
I20260811 08:03:37.775630 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.194:0
--local_ip_for_outbound_sockets=127.15.36.194
--webserver_interface=127.15.36.194
--webserver_port=0
--tserver_master_addrs=127.15.36.254:34569
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab
--principal=kudu/127.15.36.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:38863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:03:37.879987 18384 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:03:37.880431 18384 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:03:37.880534 18384 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:03:37.882212 18384 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:03:37.882311 18384 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:03:37.882349 18384 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.194
I20260811 08:03:37.884351 18384 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:38863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab
--principal=kudu/127.15.36.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.36.194
--webserver_port=0
--tserver_master_addrs=127.15.36.254:34569
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18384
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.194
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:03:37.884667 18384 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:03:37.884966 18384 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:03:37.890830 18389 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:37.890878 18390 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:37.890878 18393 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:03:37.891179 18384 server_base.cc:1034] running on GCE node
I20260811 08:03:37.891538 18384 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:03:37.891852 18384 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:03:37.893087 18384 hybrid_clock.cc:648] HybridClock initialized: now 1786435417893022 us; error 82 us; skew 500 ppm
Aug 11 08:03:37 dist-test-slave-2w3w krb5kdc[18122](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435417, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:03:37.897135 18384 init.cc:377] Logged in from keytab as kudu/127.15.36.194@KRBTEST.COM (short username kudu)
I20260811 08:03:37.898002 18384 webserver.cc:460] Webserver started at http://127.15.36.194:39589/ using document root <none> and password file <none>
I20260811 08:03:37.898305 18384 fs_manager.cc:359] Metadata directory not provided
I20260811 08:03:37.898387 18384 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:03:37.898557 18384 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:03:37.899950 18384 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-1/data/instance:
uuid: "65b19978a8aa4949a9e0ee50e8126ead"
format_stamp: "Formatted at 2026-08-11 08:03:37 on dist-test-slave-2w3w"
server_key: "cd5eee6b89df51070987bb3061ecf906"
server_key_iv: "5b8bc2c2b907b0e6e1422a7b20b56040"
server_key_version: "encryptionkey@0"
I20260811 08:03:37.900416 18384 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-1/wal/instance:
uuid: "65b19978a8aa4949a9e0ee50e8126ead"
format_stamp: "Formatted at 2026-08-11 08:03:37 on dist-test-slave-2w3w"
server_key: "cd5eee6b89df51070987bb3061ecf906"
server_key_iv: "5b8bc2c2b907b0e6e1422a7b20b56040"
server_key_version: "encryptionkey@0"
I20260811 08:03:37.902340 18384 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260811 08:03:37.903939 18400 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:37.904342 18384 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:03:37.904466 18384 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-1/wal
uuid: "65b19978a8aa4949a9e0ee50e8126ead"
format_stamp: "Formatted at 2026-08-11 08:03:37 on dist-test-slave-2w3w"
server_key: "cd5eee6b89df51070987bb3061ecf906"
server_key_iv: "5b8bc2c2b907b0e6e1422a7b20b56040"
server_key_version: "encryptionkey@0"
I20260811 08:03:37.904562 18384 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:03:37.922892 18384 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:03:37.926254 18384 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:03:37.926404 18384 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:03:37.926806 18384 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:03:37.927241 18384 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:03:37.927284 18384 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:37.927310 18384 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:03:37.927323 18384 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:37.937399 18384 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.194:44987
I20260811 08:03:37.937510 18523 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.194:44987 every 8 connection(s)
I20260811 08:03:37.937879 18384 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
I20260811 08:03:37.944301 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 18384
I20260811 08:03:37.944563 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-1/wal/instance
I20260811 08:03:37.944808 15507 external_mini_cluster.cc:1428] Setting key e774c441a3f57b2d23ad911a4bc6d32c
Aug 11 08:03:37 dist-test-slave-2w3w krb5kdc[18122](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435417, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.194@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:03:37.952858 18222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:37.938922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:52745 (local address 127.15.36.254:34569)
0811 08:03:37.939066 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:37.939069 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:37.939257 (+ 188us) server_negotiation.cc:407] Connection header received
0811 08:03:37.940452 (+ 1195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:37.940454 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:37.940471 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:37.940544 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:37.941506 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:37.942176 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:37.943682 (+ 1506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:37.943908 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:37.944328 (+ 420us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:37.947754 (+ 3426us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:37.947757 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:37.947757 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:37.947767 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:37.949437 (+ 1670us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:37.950105 (+ 668us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:37.950107 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:37.950107 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:37.950173 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:37.950758 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:37.950760 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:37.950760 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:37.950923 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:37.951269 (+ 346us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:37.952187 (+ 918us) server_negotiation.cc:299] Negotiation successful
0811 08:03:37.952722 (+ 535us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
I20260811 08:03:37.953290 18527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:37.938809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:34569 (local address 127.15.36.194:52745)
0811 08:03:37.939092 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:37.939154 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:37.940307 (+ 1153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:37.940627 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:37.940632 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:37.940996 (+ 364us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:03:37.941389 (+ 393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:37.941395 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:37.942322 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:37.942324 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:37.943568 (+ 1244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:37.943572 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:37.944342 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:37.944343 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:37.944531 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:37.945447 (+ 916us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:03:37.945457 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:03:37.947602 (+ 2145us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:03:37.949578 (+ 1976us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:37.949589 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:37.949592 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:37.949901 (+ 309us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:37.950279 (+ 378us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:37.950281 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:37.950281 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:37.950483 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:37.951268 (+ 785us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:03:37.951280 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:03:37.951668 (+ 388us) client_negotiation.cc:769] Sending connection context
0811 08:03:37.952145 (+ 477us) client_negotiation.cc:240] Negotiation successful
0811 08:03:37.952783 (+ 638us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":154,"threads_started":1}
I20260811 08:03:37.954499 18524 heartbeater.cc:347] Connected to a master server at 127.15.36.254:34569
I20260811 08:03:37.954674 18524 heartbeater.cc:464] Registering TS with master...
I20260811 08:03:37.955332 18524 heartbeater.cc:511] Master 127.15.36.254:34569 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.15.36.195@KRBTEST.COM; defaulting to no policy
I20260811 08:03:37.956101 18172 ts_manager.cc:194] Registered new tserver with Master: 65b19978a8aa4949a9e0ee50e8126ead (127.15.36.194:44987)
I20260811 08:03:37.956655 18172 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.36.194@KRBTEST.COM'} at 127.15.36.194:52745
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab.
Entry for principal kudu/127.15.36.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab.
I20260811 08:03:37.991986 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.195:0
--local_ip_for_outbound_sockets=127.15.36.195
--webserver_interface=127.15.36.195
--webserver_port=0
--tserver_master_addrs=127.15.36.254:34569
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab
--principal=kudu/127.15.36.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:38863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:03:38.099566 18530 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:03:38.099823 18530 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:03:38.099852 18530 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:03:38.101337 18530 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:03:38.101414 18530 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:03:38.101447 18530 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.195
I20260811 08:03:38.103605 18530 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:38863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab
--principal=kudu/127.15.36.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.36.195
--webserver_port=0
--tserver_master_addrs=127.15.36.254:34569
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18530
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.195
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:03:38.103978 18530 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:03:38.104279 18530 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:03:38.110906 18540 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:38.110913 18538 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:38.110913 18537 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:03:38.111824 18530 server_base.cc:1034] running on GCE node
I20260811 08:03:38.112151 18530 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:03:38.112504 18530 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:03:38.113720 18530 hybrid_clock.cc:648] HybridClock initialized: now 1786435418113677 us; error 58 us; skew 500 ppm
Aug 11 08:03:38 dist-test-slave-2w3w krb5kdc[18122](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435418, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:03:38.117509 18530 init.cc:377] Logged in from keytab as kudu/127.15.36.195@KRBTEST.COM (short username kudu)
I20260811 08:03:38.118193 18530 webserver.cc:460] Webserver started at http://127.15.36.195:45771/ using document root <none> and password file <none>
I20260811 08:03:38.118536 18530 fs_manager.cc:359] Metadata directory not provided
I20260811 08:03:38.118599 18530 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:03:38.118713 18530 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:03:38.120234 18530 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-2/data/instance:
uuid: "94d8ca76de40485aa4a9a50c7c6beeb1"
format_stamp: "Formatted at 2026-08-11 08:03:38 on dist-test-slave-2w3w"
server_key: "ce2a5deb7921638714b1ed0bc03d61b9"
server_key_iv: "91ef4199890a4e5623b05ab405a7ca44"
server_key_version: "encryptionkey@0"
I20260811 08:03:38.120712 18530 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-2/wal/instance:
uuid: "94d8ca76de40485aa4a9a50c7c6beeb1"
format_stamp: "Formatted at 2026-08-11 08:03:38 on dist-test-slave-2w3w"
server_key: "ce2a5deb7921638714b1ed0bc03d61b9"
server_key_iv: "91ef4199890a4e5623b05ab405a7ca44"
server_key_version: "encryptionkey@0"
I20260811 08:03:38.122452 18530 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260811 08:03:38.123699 18548 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:38.124068 18530 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:03:38.124207 18530 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-2/wal
uuid: "94d8ca76de40485aa4a9a50c7c6beeb1"
format_stamp: "Formatted at 2026-08-11 08:03:38 on dist-test-slave-2w3w"
server_key: "ce2a5deb7921638714b1ed0bc03d61b9"
server_key_iv: "91ef4199890a4e5623b05ab405a7ca44"
server_key_version: "encryptionkey@0"
I20260811 08:03:38.124318 18530 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:03:38.133925 18530 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:03:38.138731 18530 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:03:38.138978 18530 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:03:38.139370 18530 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:03:38.139837 18530 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:03:38.139911 18530 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:38.139950 18530 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:03:38.139986 18530 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:38.147166 18530 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.195:46313
I20260811 08:03:38.147214 18668 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.195:46313 every 8 connection(s)
I20260811 08:03:38.147598 18530 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
I20260811 08:03:38.150625 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 18530
I20260811 08:03:38.150717 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-2/wal/instance
I20260811 08:03:38.150949 15507 external_mini_cluster.cc:1428] Setting key e40077c1530b49ad3e9bc721ea174b93
Aug 11 08:03:38 dist-test-slave-2w3w krb5kdc[18122](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435418, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.195@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:03:38.162755 18222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:38.148550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:53213 (local address 127.15.36.254:34569)
0811 08:03:38.148703 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:38.148705 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:38.148927 (+ 222us) server_negotiation.cc:407] Connection header received
0811 08:03:38.149491 (+ 564us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:38.149493 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:38.149506 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:38.149569 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:38.150635 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:38.151412 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:38.153267 (+ 1855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:38.153504 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:38.153615 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:38.158229 (+ 4614us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:38.158232 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:38.158232 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:38.158242 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:38.161037 (+ 2795us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:38.161604 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:38.161605 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:38.161606 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:38.161681 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:38.161965 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:38.161966 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:38.161967 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:38.162107 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:38.162190 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:38.162503 (+ 313us) server_negotiation.cc:299] Negotiation successful
0811 08:03:38.162652 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114}
I20260811 08:03:38.163160 18671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:38.148454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:34569 (local address 127.15.36.195:53213)
0811 08:03:38.148723 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:38.148774 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:38.149374 (+ 600us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:38.149641 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:38.149646 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:38.150265 (+ 619us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:03:38.150519 (+ 254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:38.150524 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:38.151501 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:38.151502 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:38.153142 (+ 1640us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:38.153147 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:38.153618 (+ 471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:38.153619 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:38.153771 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:38.155011 (+ 1240us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:03:38.155023 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:03:38.158056 (+ 3033us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:03:38.161178 (+ 3122us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:38.161193 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:38.161196 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:38.161509 (+ 313us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:38.161762 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:38.161763 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:38.161763 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:38.161890 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:38.162179 (+ 289us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:03:38.162187 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:03:38.162356 (+ 169us) client_negotiation.cc:769] Sending connection context
0811 08:03:38.162479 (+ 123us) client_negotiation.cc:240] Negotiation successful
0811 08:03:38.162675 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":111,"threads_started":1}
I20260811 08:03:38.164453 18669 heartbeater.cc:347] Connected to a master server at 127.15.36.254:34569
I20260811 08:03:38.164614 18669 heartbeater.cc:464] Registering TS with master...
I20260811 08:03:38.164829 18669 heartbeater.cc:511] Master 127.15.36.254:34569 requested a full tablet report, sending...
I20260811 08:03:38.165516 18172 ts_manager.cc:194] Registered new tserver with Master: 94d8ca76de40485aa4a9a50c7c6beeb1 (127.15.36.195:46313)
I20260811 08:03:38.166004 18172 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.36.195@KRBTEST.COM'} at 127.15.36.195:53213
I20260811 08:03:38.176052 15507 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 08:03:38.191589 18222 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:03:38.190353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55884 (local address 127.15.36.254:34569)
0811 08:03:38.190462 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:38.190465 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:38.190581 (+ 116us) server_negotiation.cc:407] Connection header received
0811 08:03:38.190706 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:38.190709 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:38.190726 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:38.190791 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:38.191501 (+ 710us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55884: BlockingRecv error: recv got EOF from 127.0.0.1:55884 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 08:03:38.192725 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 18236
I20260811 08:03:38.200032 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 18384
I20260811 08:03:38.207233 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 18530
I20260811 08:03:38.216650 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 18136
2026-08-11T08:03:38Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2397 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786435400844580-15507-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:03:38 dist-test-slave-2w3w krb5kdc[18683](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:03:38 dist-test-slave-2w3w krb5kdc[18683](info): set up 2 sockets
Aug 11 08:03:38 dist-test-slave-2w3w krb5kdc[18683](info): commencing operation
krb5kdc: starting...
W20260811 08:03:39.542688 15507 mini_kdc.cc:121] Time spent starting KDC: real 1.299s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
W20260811 08:03:39.711249 15507 mini_kdc.cc:253] Time spent creating user principal test-admin: real 0.168s user 0.003s sys 0.000s
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
W20260811 08:03:39.824517 15507 mini_kdc.cc:253] Time spent creating user principal test-user: real 0.113s user 0.002s sys 0.002s
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
W20260811 08:03:39.951706 15507 mini_kdc.cc:253] Time spent creating user principal joe-interloper: real 0.127s user 0.001s sys 0.001s
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786435400844580-15507-0/krb5kdc/test-user.keytab.
W20260811 08:03:40.575469 15507 mini_kdc.cc:302] Time spent creating keytab for test-user: real 0.624s user 0.001s sys 0.001s
Aug 11 08:03:40 dist-test-slave-2w3w krb5kdc[18683](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435420, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:03:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:03:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.36.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab.
Entry for principal kudu/127.15.36.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab.
W20260811 08:03:41.192006 15507 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.15.36.254: real 0.588s user 0.001s sys 0.005s
I20260811 08:03:41.192698 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786435400844580-15507-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786435400844580-15507-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786435400844580-15507-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:37443
--webserver_interface=127.15.36.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=kudu/127.15.36.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:39501
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.36.254:37443
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:03:41.293593 18697 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:03:41.293912 18697 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:03:41.293958 18697 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:03:41.295403 18697 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:03:41.295498 18697 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:03:41.295524 18697 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:03:41.295545 18697 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:03:41.295571 18697 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:03:41.297422 18697 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:39501
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786435400844580-15507-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786435400844580-15507-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.36.254:37443
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=kudu/127.15.36.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:37443
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.36.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18697
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786435400844580-15507-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:03:41.297765 18697 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:03:41.298032 18697 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:03:41.304086 18705 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:41.304086 18703 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:41.304241 18702 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:03:41.304287 18697 server_base.cc:1034] running on GCE node
I20260811 08:03:41.304730 18697 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:03:41.305112 18697 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:03:41.306303 18697 hybrid_clock.cc:648] HybridClock initialized: now 1786435421306270 us; error 42 us; skew 500 ppm
Aug 11 08:03:41 dist-test-slave-2w3w krb5kdc[18683](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435421, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:03:41.314589 18697 init.cc:377] Logged in from keytab as kudu/127.15.36.254@KRBTEST.COM (short username kudu)
I20260811 08:03:41.315393 18697 webserver.cc:460] Webserver started at http://127.15.36.254:37811/ using document root <none> and password file <none>
I20260811 08:03:41.315620 18697 fs_manager.cc:359] Metadata directory not provided
I20260811 08:03:41.315668 18697 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:03:41.315775 18697 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:03:41.317571 18697 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786435400844580-15507-0/minicluster-data/master-0/data/instance:
uuid: "c75588de18d94054b56975f816cc7253"
format_stamp: "Formatted at 2026-08-11 08:03:41 on dist-test-slave-2w3w"
server_key: "c7d2d9a0364d7d010752c217a92a9199"
server_key_iv: "e9f77fb78c146845b732126cf2fcda49"
server_key_version: "encryptionkey@0"
I20260811 08:03:41.318353 18697 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786435400844580-15507-0/minicluster-data/master-0/wal/instance:
uuid: "c75588de18d94054b56975f816cc7253"
format_stamp: "Formatted at 2026-08-11 08:03:41 on dist-test-slave-2w3w"
server_key: "c7d2d9a0364d7d010752c217a92a9199"
server_key_iv: "e9f77fb78c146845b732126cf2fcda49"
server_key_version: "encryptionkey@0"
I20260811 08:03:41.320487 18697 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.004s
I20260811 08:03:41.321578 18713 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:41.322001 18697 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:03:41.322108 18697 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786435400844580-15507-0/minicluster-data/master-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786435400844580-15507-0/minicluster-data/master-0/wal
uuid: "c75588de18d94054b56975f816cc7253"
format_stamp: "Formatted at 2026-08-11 08:03:41 on dist-test-slave-2w3w"
server_key: "c7d2d9a0364d7d010752c217a92a9199"
server_key_iv: "e9f77fb78c146845b732126cf2fcda49"
server_key_version: "encryptionkey@0"
I20260811 08:03:41.322280 18697 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786435400844580-15507-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786435400844580-15507-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786435400844580-15507-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:03:41.360005 18697 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:03:41.363600 18697 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:03:41.363742 18697 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:03:41.368211 18697 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.254:37443
I20260811 08:03:41.368256 18770 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.254:37443 every 8 connection(s)
I20260811 08:03:41.368878 18697 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
I20260811 08:03:41.369828 18771 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:03:41.371220 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 18697
I20260811 08:03:41.371326 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786435400844580-15507-0/minicluster-data/master-0/wal/instance
I20260811 08:03:41.371519 15507 external_mini_cluster.cc:1428] Setting key edf8f38a1c67572b2d78e83d8300bbb3
I20260811 08:03:41.373528 18771 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c75588de18d94054b56975f816cc7253: Bootstrap starting.
I20260811 08:03:41.374689 18771 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c75588de18d94054b56975f816cc7253: Neither blocks nor log segments found. Creating new log.
I20260811 08:03:41.375851 18771 log.cc:824] T 00000000000000000000000000000000 P c75588de18d94054b56975f816cc7253: Log is configured to *not* fsync() on all Append() calls
I20260811 08:03:41.376849 18771 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c75588de18d94054b56975f816cc7253: No bootstrap required, opened a new log
I20260811 08:03:41.379485 18771 raft_consensus.cc:348] T 00000000000000000000000000000000 P c75588de18d94054b56975f816cc7253 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c75588de18d94054b56975f816cc7253" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 37443 } }
I20260811 08:03:41.379652 18771 raft_consensus.cc:374] T 00000000000000000000000000000000 P c75588de18d94054b56975f816cc7253 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:03:41.379675 18771 raft_consensus.cc:729] T 00000000000000000000000000000000 P c75588de18d94054b56975f816cc7253 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c75588de18d94054b56975f816cc7253, State: Initialized, Role: FOLLOWER
I20260811 08:03:41.379840 18771 consensus_queue.cc:260] T 00000000000000000000000000000000 P c75588de18d94054b56975f816cc7253 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c75588de18d94054b56975f816cc7253" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 37443 } }
I20260811 08:03:41.379935 18771 raft_consensus.cc:388] T 00000000000000000000000000000000 P c75588de18d94054b56975f816cc7253 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:03:41.379983 18771 raft_consensus.cc:482] T 00000000000000000000000000000000 P c75588de18d94054b56975f816cc7253 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:03:41.380304 18771 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c75588de18d94054b56975f816cc7253 [term 0 FOLLOWER]: Advancing to term 1
Aug 11 08:03:41 dist-test-slave-2w3w krb5kdc[18683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435420, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:03:41.381431 18771 raft_consensus.cc:504] T 00000000000000000000000000000000 P c75588de18d94054b56975f816cc7253 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c75588de18d94054b56975f816cc7253" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 37443 } }
I20260811 08:03:41.381593 18771 leader_election.cc:302] T 00000000000000000000000000000000 P c75588de18d94054b56975f816cc7253 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c75588de18d94054b56975f816cc7253; no voters:
I20260811 08:03:41.381822 18771 leader_election.cc:288] T 00000000000000000000000000000000 P c75588de18d94054b56975f816cc7253 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:03:41.381950 18776 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c75588de18d94054b56975f816cc7253 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:03:41.382150 18771 sys_catalog.cc:564] T 00000000000000000000000000000000 P c75588de18d94054b56975f816cc7253 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:03:41.382189 18776 raft_consensus.cc:686] T 00000000000000000000000000000000 P c75588de18d94054b56975f816cc7253 [term 1 LEADER]: Becoming Leader. State: Replica: c75588de18d94054b56975f816cc7253, State: Running, Role: LEADER
I20260811 08:03:41.382776 18776 consensus_queue.cc:237] T 00000000000000000000000000000000 P c75588de18d94054b56975f816cc7253 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c75588de18d94054b56975f816cc7253" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 37443 } }
I20260811 08:03:41.383739 18778 sys_catalog.cc:455] T 00000000000000000000000000000000 P c75588de18d94054b56975f816cc7253 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c75588de18d94054b56975f816cc7253. Latest consensus state: current_term: 1 leader_uuid: "c75588de18d94054b56975f816cc7253" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c75588de18d94054b56975f816cc7253" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 37443 } } }
I20260811 08:03:41.383736 18777 sys_catalog.cc:455] T 00000000000000000000000000000000 P c75588de18d94054b56975f816cc7253 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c75588de18d94054b56975f816cc7253" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c75588de18d94054b56975f816cc7253" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 37443 } } }
I20260811 08:03:41.383867 18778 sys_catalog.cc:458] T 00000000000000000000000000000000 P c75588de18d94054b56975f816cc7253 [sys.catalog]: This master's current role is: LEADER
I20260811 08:03:41.383872 18777 sys_catalog.cc:458] T 00000000000000000000000000000000 P c75588de18d94054b56975f816cc7253 [sys.catalog]: This master's current role is: LEADER
W20260811 08:03:41.384295 18791 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c75588de18d94054b56975f816cc7253: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 08:03:41.384693 18791 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 08:03:41.384852 18792 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:03:41.385118 18792 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:03:41.386622 18774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:41.372137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42542 (local address 127.15.36.254:37443)
0811 08:03:41.372456 (+ 319us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:41.372467 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:41.372503 (+ 36us) server_negotiation.cc:407] Connection header received
0811 08:03:41.373097 (+ 594us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:41.373108 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:41.373180 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:41.373371 (+ 191us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:41.374288 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:41.376501 (+ 2213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:41.377514 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:41.378183 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:41.378314 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:41.381589 (+ 3275us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:41.381594 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:41.381594 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:41.381609 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:41.384568 (+ 2959us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:41.385116 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:41.385120 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:41.385120 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:41.385272 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:41.385530 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:41.385531 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:41.385531 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:41.385909 (+ 378us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:41.386084 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:41.386205 (+ 121us) server_negotiation.cc:299] Negotiation successful
0811 08:03:41.386373 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":260,"thread_start_us":167,"threads_started":1}
I20260811 08:03:41.387472 18792 catalog_manager.cc:1347] Generated new cluster ID: d658a52dc45c4273bd60df5aba2656b4
I20260811 08:03:41.387566 18792 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:03:41.387750 15507 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:03:41.416430 18774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:41.409550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42556 (local address 127.15.36.254:37443)
0811 08:03:41.409606 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:41.409609 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:41.409735 (+ 126us) server_negotiation.cc:407] Connection header received
0811 08:03:41.409822 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:41.409823 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:41.409840 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:41.409903 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:41.410441 (+ 538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:41.411517 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:41.413728 (+ 2211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:41.414216 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:41.414324 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:41.415588 (+ 1264us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:41.415591 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:41.415591 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:03:41.416034 (+ 443us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:41.416064 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:03:41.416075 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:41.416155 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:41.416301 (+ 146us) server_negotiation.cc:299] Negotiation successful
0811 08:03:41.416337 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 08:03:41.425735 18792 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:03:41.426560 18792 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:03:41.432679 18792 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c75588de18d94054b56975f816cc7253: Generated new TSK 0
I20260811 08:03:41.433002 18792 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:03:41.443282 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 18697
2026-08-11T08:03:41Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (3223 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:03:41 dist-test-slave-2w3w krb5kdc[18807](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:03:41 dist-test-slave-2w3w krb5kdc[18807](info): set up 2 sockets
Aug 11 08:03:41 dist-test-slave-2w3w krb5kdc[18807](info): commencing operation
krb5kdc: starting...
W20260811 08:03:42.657732 15507 mini_kdc.cc:121] Time spent starting KDC: real 1.191s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Aug 11 08:03:42 dist-test-slave-2w3w krb5kdc[18807](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435422, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:03:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:03:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.36.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab.
Entry for principal kudu/127.15.36.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab.
I20260811 08:03:42.823189 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:36507
--webserver_interface=127.15.36.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=kudu/127.15.36.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:42907
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.36.254:36507
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:03:42.918895 18823 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:03:42.919217 18823 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:03:42.919263 18823 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:03:42.920629 18823 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:03:42.920722 18823 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:03:42.920756 18823 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:03:42.920789 18823 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:03:42.920812 18823 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:03:42.922613 18823 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:42907
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.36.254:36507
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=kudu/127.15.36.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:36507
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.36.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18823
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:03:42.923002 18823 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:03:42.923280 18823 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:03:42.929035 18828 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:42.929121 18829 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:03:42.929204 18823 server_base.cc:1034] running on GCE node
W20260811 08:03:42.929039 18831 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:03:42.929693 18823 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:03:42.930130 18823 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:03:42.931354 18823 hybrid_clock.cc:648] HybridClock initialized: now 1786435422931279 us; error 94 us; skew 500 ppm
Aug 11 08:03:42 dist-test-slave-2w3w krb5kdc[18807](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435422, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:03:42.935516 18823 init.cc:377] Logged in from keytab as kudu/127.15.36.254@KRBTEST.COM (short username kudu)
I20260811 08:03:42.936097 18823 webserver.cc:460] Webserver started at http://127.15.36.254:43749/ using document root <none> and password file <none>
I20260811 08:03:42.936347 18823 fs_manager.cc:359] Metadata directory not provided
I20260811 08:03:42.936394 18823 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:03:42.936496 18823 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:03:42.937929 18823 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/minicluster-data/master-0/data/instance:
uuid: "5ccbe3b00dd54b849ea3238a1a0982a4"
format_stamp: "Formatted at 2026-08-11 08:03:42 on dist-test-slave-2w3w"
server_key: "cbcbb85fcc776b8620dc31716e135f02"
server_key_iv: "94dda04e1e1608d404e3db32940cd7fc"
server_key_version: "encryptionkey@0"
I20260811 08:03:42.938779 18823 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/minicluster-data/master-0/wal/instance:
uuid: "5ccbe3b00dd54b849ea3238a1a0982a4"
format_stamp: "Formatted at 2026-08-11 08:03:42 on dist-test-slave-2w3w"
server_key: "cbcbb85fcc776b8620dc31716e135f02"
server_key_iv: "94dda04e1e1608d404e3db32940cd7fc"
server_key_version: "encryptionkey@0"
I20260811 08:03:42.940910 18823 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.001s
I20260811 08:03:42.941898 18839 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:42.942188 18823 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:03:42.942287 18823 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/minicluster-data/master-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/minicluster-data/master-0/wal
uuid: "5ccbe3b00dd54b849ea3238a1a0982a4"
format_stamp: "Formatted at 2026-08-11 08:03:42 on dist-test-slave-2w3w"
server_key: "cbcbb85fcc776b8620dc31716e135f02"
server_key_iv: "94dda04e1e1608d404e3db32940cd7fc"
server_key_version: "encryptionkey@0"
I20260811 08:03:42.942371 18823 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:03:42.953871 18823 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:03:42.956490 18823 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:03:42.956622 18823 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:03:42.961083 18823 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.254:36507
I20260811 08:03:42.961163 18894 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.254:36507 every 8 connection(s)
I20260811 08:03:42.961534 18823 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
I20260811 08:03:42.962673 18895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:03:42.965338 18895 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5ccbe3b00dd54b849ea3238a1a0982a4: Bootstrap starting.
I20260811 08:03:42.966101 18895 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5ccbe3b00dd54b849ea3238a1a0982a4: Neither blocks nor log segments found. Creating new log.
I20260811 08:03:42.966426 18895 log.cc:824] T 00000000000000000000000000000000 P 5ccbe3b00dd54b849ea3238a1a0982a4: Log is configured to *not* fsync() on all Append() calls
I20260811 08:03:42.967730 18895 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5ccbe3b00dd54b849ea3238a1a0982a4: No bootstrap required, opened a new log
I20260811 08:03:42.970074 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 18823
I20260811 08:03:42.970271 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/minicluster-data/master-0/wal/instance
I20260811 08:03:42.970724 15507 external_mini_cluster.cc:1428] Setting key e1e19275e65d41ac0af61b5b44397528
I20260811 08:03:42.971156 18895 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5ccbe3b00dd54b849ea3238a1a0982a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ccbe3b00dd54b849ea3238a1a0982a4" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 36507 } }
I20260811 08:03:42.971534 18895 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5ccbe3b00dd54b849ea3238a1a0982a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:03:42.971608 18895 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5ccbe3b00dd54b849ea3238a1a0982a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccbe3b00dd54b849ea3238a1a0982a4, State: Initialized, Role: FOLLOWER
I20260811 08:03:42.971828 18895 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5ccbe3b00dd54b849ea3238a1a0982a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ccbe3b00dd54b849ea3238a1a0982a4" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 36507 } }
I20260811 08:03:42.971947 18895 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5ccbe3b00dd54b849ea3238a1a0982a4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:03:42.972004 18895 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5ccbe3b00dd54b849ea3238a1a0982a4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:03:42.972069 18895 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5ccbe3b00dd54b849ea3238a1a0982a4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:03:42.973680 18895 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5ccbe3b00dd54b849ea3238a1a0982a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ccbe3b00dd54b849ea3238a1a0982a4" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 36507 } }
I20260811 08:03:42.973845 18895 leader_election.cc:302] T 00000000000000000000000000000000 P 5ccbe3b00dd54b849ea3238a1a0982a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5ccbe3b00dd54b849ea3238a1a0982a4; no voters:
I20260811 08:03:42.974102 18895 leader_election.cc:288] T 00000000000000000000000000000000 P 5ccbe3b00dd54b849ea3238a1a0982a4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:03:42.974145 18900 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5ccbe3b00dd54b849ea3238a1a0982a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:03:42.974273 18900 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5ccbe3b00dd54b849ea3238a1a0982a4 [term 1 LEADER]: Becoming Leader. State: Replica: 5ccbe3b00dd54b849ea3238a1a0982a4, State: Running, Role: LEADER
I20260811 08:03:42.974447 18895 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5ccbe3b00dd54b849ea3238a1a0982a4 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:03:42.974447 18900 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5ccbe3b00dd54b849ea3238a1a0982a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ccbe3b00dd54b849ea3238a1a0982a4" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 36507 } }
I20260811 08:03:42.975227 18902 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ccbe3b00dd54b849ea3238a1a0982a4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5ccbe3b00dd54b849ea3238a1a0982a4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ccbe3b00dd54b849ea3238a1a0982a4" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 36507 } } }
I20260811 08:03:42.975253 18901 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ccbe3b00dd54b849ea3238a1a0982a4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5ccbe3b00dd54b849ea3238a1a0982a4. Latest consensus state: current_term: 1 leader_uuid: "5ccbe3b00dd54b849ea3238a1a0982a4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ccbe3b00dd54b849ea3238a1a0982a4" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 36507 } } }
I20260811 08:03:42.975349 18902 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ccbe3b00dd54b849ea3238a1a0982a4 [sys.catalog]: This master's current role is: LEADER
I20260811 08:03:42.975373 18901 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ccbe3b00dd54b849ea3238a1a0982a4 [sys.catalog]: This master's current role is: LEADER
I20260811 08:03:42.975739 18910 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:03:42.976464 18910 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:03:42.978760 18910 catalog_manager.cc:1347] Generated new cluster ID: 27a1939947204564a34ea0444e41effc
I20260811 08:03:42.978833 18910 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 08:03:42 dist-test-slave-2w3w krb5kdc[18807](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435422, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:03:42.986809 18899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:42.971822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50634 (local address 127.15.36.254:36507)
0811 08:03:42.972233 (+ 411us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:42.972257 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:42.972294 (+ 37us) server_negotiation.cc:407] Connection header received
0811 08:03:42.972427 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:42.972434 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:42.972486 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:42.972633 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:42.973726 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:42.975706 (+ 1980us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:42.977096 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:42.977695 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:42.977850 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:42.981414 (+ 3564us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:42.981419 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:42.981419 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:42.981436 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:42.984025 (+ 2589us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:42.984546 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:42.984549 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:42.984550 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:42.985391 (+ 841us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:42.985704 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:42.985706 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:42.985706 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:42.986102 (+ 396us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:42.986315 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:42.986392 (+ 77us) server_negotiation.cc:299] Negotiation successful
0811 08:03:42.986563 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":339,"thread_start_us":287,"threads_started":1}
I20260811 08:03:43.012542 18910 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:03:43.013361 18910 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:03:43.016310 18910 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5ccbe3b00dd54b849ea3238a1a0982a4: Generated new TSK 0
I20260811 08:03:43.016579 18910 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.36.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab.
Entry for principal kudu/127.15.36.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab.
I20260811 08:03:43.061998 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.193:0
--local_ip_for_outbound_sockets=127.15.36.193
--webserver_interface=127.15.36.193
--webserver_port=0
--tserver_master_addrs=127.15.36.254:36507
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab
--principal=kudu/127.15.36.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:42907
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:03:43.163772 18923 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:03:43.164100 18923 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:03:43.164151 18923 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:03:43.165568 18923 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:03:43.165663 18923 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:03:43.165722 18923 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.193
I20260811 08:03:43.167984 18923 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:42907
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab
--principal=kudu/127.15.36.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.36.193
--webserver_port=0
--tserver_master_addrs=127.15.36.254:36507
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18923
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.193
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:03:43.168347 18923 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:03:43.168620 18923 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:03:43.174876 18933 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:43.174939 18929 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:43.174935 18931 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:03:43.175298 18923 server_base.cc:1034] running on GCE node
I20260811 08:03:43.175632 18923 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:03:43.176024 18923 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:03:43.177178 18923 hybrid_clock.cc:648] HybridClock initialized: now 1786435423177140 us; error 59 us; skew 500 ppm
Aug 11 08:03:43 dist-test-slave-2w3w krb5kdc[18807](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435423, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:03:43.180330 18923 init.cc:377] Logged in from keytab as kudu/127.15.36.193@KRBTEST.COM (short username kudu)
I20260811 08:03:43.180817 18923 webserver.cc:460] Webserver started at http://127.15.36.193:35417/ using document root <none> and password file <none>
I20260811 08:03:43.181046 18923 fs_manager.cc:359] Metadata directory not provided
I20260811 08:03:43.181098 18923 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:03:43.181206 18923 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:03:43.182554 18923 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-0/data/instance:
uuid: "197838a8220441f4bc8a9a748eea3ef3"
format_stamp: "Formatted at 2026-08-11 08:03:43 on dist-test-slave-2w3w"
server_key: "dcffaa6b002507ff35f614fc0beef3aa"
server_key_iv: "b90cb370d75037ef6ac733e0430202ee"
server_key_version: "encryptionkey@0"
I20260811 08:03:43.182925 18923 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-0/wal/instance:
uuid: "197838a8220441f4bc8a9a748eea3ef3"
format_stamp: "Formatted at 2026-08-11 08:03:43 on dist-test-slave-2w3w"
server_key: "dcffaa6b002507ff35f614fc0beef3aa"
server_key_iv: "b90cb370d75037ef6ac733e0430202ee"
server_key_version: "encryptionkey@0"
I20260811 08:03:43.184525 18923 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:03:43.185606 18940 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:43.185822 18923 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:03:43.185927 18923 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-0/wal
uuid: "197838a8220441f4bc8a9a748eea3ef3"
format_stamp: "Formatted at 2026-08-11 08:03:43 on dist-test-slave-2w3w"
server_key: "dcffaa6b002507ff35f614fc0beef3aa"
server_key_iv: "b90cb370d75037ef6ac733e0430202ee"
server_key_version: "encryptionkey@0"
I20260811 08:03:43.185992 18923 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:03:43.196400 18923 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:03:43.199110 18923 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:03:43.199280 18923 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:03:43.199597 18923 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:03:43.199966 18923 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:03:43.200002 18923 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:43.200026 18923 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:03:43.200039 18923 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:43.206032 18923 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.193:37187
I20260811 08:03:43.206194 19067 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.193:37187 every 8 connection(s)
I20260811 08:03:43.206489 18923 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
I20260811 08:03:43.209704 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 18923
I20260811 08:03:43.209822 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-0/wal/instance
I20260811 08:03:43.210008 15507 external_mini_cluster.cc:1428] Setting key f6d580412a0f2dd51fdc3ed621c4d980
Aug 11 08:03:43 dist-test-slave-2w3w krb5kdc[18807](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435423, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.193@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:03:43.218662 18899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:43.207418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:53429 (local address 127.15.36.254:36507)
0811 08:03:43.207462 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:43.207465 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:43.207696 (+ 231us) server_negotiation.cc:407] Connection header received
0811 08:03:43.208294 (+ 598us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:43.208299 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:43.208322 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:43.208382 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:43.209600 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:43.210318 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:43.212099 (+ 1781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:43.212309 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:43.212440 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:43.215139 (+ 2699us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:43.215142 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:43.215142 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:43.215151 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:43.216895 (+ 1744us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:43.217439 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:43.217441 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:43.217441 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:43.217509 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:43.217836 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:43.217837 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:43.217837 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:43.217988 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:43.218072 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:43.218424 (+ 352us) server_negotiation.cc:299] Negotiation successful
0811 08:03:43.218540 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 08:03:43.218904 19071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:43.207389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:36507 (local address 127.15.36.193:53429)
0811 08:03:43.207578 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:43.207617 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:43.208155 (+ 538us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:43.208500 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:43.208504 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:43.209165 (+ 661us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:03:43.209381 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:43.209386 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:43.210444 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:43.210445 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:43.211838 (+ 1393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:43.211841 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:43.212447 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:43.212448 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:43.212638 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:43.213292 (+ 654us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:03:43.213301 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:03:43.214979 (+ 1678us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:03:43.217013 (+ 2034us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:43.217027 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:43.217030 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:43.217320 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:43.217590 (+ 270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:43.217591 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:43.217592 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:43.217744 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:43.218075 (+ 331us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:03:43.218085 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:03:43.218257 (+ 172us) client_negotiation.cc:769] Sending connection context
0811 08:03:43.218399 (+ 142us) client_negotiation.cc:240] Negotiation successful
0811 08:03:43.218598 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":108,"threads_started":1}
WARNING: no policy specified for kudu/127.15.36.194@KRBTEST.COM; defaulting to no policy
I20260811 08:03:43.219573 19068 heartbeater.cc:347] Connected to a master server at 127.15.36.254:36507
I20260811 08:03:43.219681 19068 heartbeater.cc:464] Registering TS with master...
I20260811 08:03:43.219929 19068 heartbeater.cc:511] Master 127.15.36.254:36507 requested a full tablet report, sending...
I20260811 08:03:43.220984 18857 ts_manager.cc:194] Registered new tserver with Master: 197838a8220441f4bc8a9a748eea3ef3 (127.15.36.193:37187)
I20260811 08:03:43.221604 18857 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.36.193@KRBTEST.COM'} at 127.15.36.193:53429
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab.
Entry for principal kudu/127.15.36.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab.
I20260811 08:03:43.244334 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.194:0
--local_ip_for_outbound_sockets=127.15.36.194
--webserver_interface=127.15.36.194
--webserver_port=0
--tserver_master_addrs=127.15.36.254:36507
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab
--principal=kudu/127.15.36.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:42907
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:03:43.348222 19074 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:03:43.348472 19074 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:03:43.348500 19074 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:03:43.349783 19074 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:03:43.349846 19074 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:03:43.349879 19074 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.194
I20260811 08:03:43.351625 19074 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:42907
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab
--principal=kudu/127.15.36.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.36.194
--webserver_port=0
--tserver_master_addrs=127.15.36.254:36507
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19074
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.194
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:03:43.351938 19074 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:03:43.352299 19074 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:03:43.359537 19080 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:43.359651 19079 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:43.359531 19082 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:03:43.360554 19074 server_base.cc:1034] running on GCE node
I20260811 08:03:43.360961 19074 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:03:43.361536 19074 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:03:43.362766 19074 hybrid_clock.cc:648] HybridClock initialized: now 1786435423362771 us; error 75 us; skew 500 ppm
Aug 11 08:03:43 dist-test-slave-2w3w krb5kdc[18807](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435423, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:03:43.365777 19074 init.cc:377] Logged in from keytab as kudu/127.15.36.194@KRBTEST.COM (short username kudu)
I20260811 08:03:43.366307 19074 webserver.cc:460] Webserver started at http://127.15.36.194:41743/ using document root <none> and password file <none>
I20260811 08:03:43.366575 19074 fs_manager.cc:359] Metadata directory not provided
I20260811 08:03:43.366649 19074 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:03:43.366858 19074 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:03:43.368124 19074 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-1/data/instance:
uuid: "f35d839b99c845aba0ab08af9e5c414c"
format_stamp: "Formatted at 2026-08-11 08:03:43 on dist-test-slave-2w3w"
server_key: "1981d59342c618bc0c6279c608ae1390"
server_key_iv: "f51976fc62d7312aa43605f629c4a6d1"
server_key_version: "encryptionkey@0"
I20260811 08:03:43.368520 19074 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-1/wal/instance:
uuid: "f35d839b99c845aba0ab08af9e5c414c"
format_stamp: "Formatted at 2026-08-11 08:03:43 on dist-test-slave-2w3w"
server_key: "1981d59342c618bc0c6279c608ae1390"
server_key_iv: "f51976fc62d7312aa43605f629c4a6d1"
server_key_version: "encryptionkey@0"
I20260811 08:03:43.370007 19074 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 08:03:43.371114 19092 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:43.371412 19074 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260811 08:03:43.371502 19074 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-1/wal
uuid: "f35d839b99c845aba0ab08af9e5c414c"
format_stamp: "Formatted at 2026-08-11 08:03:43 on dist-test-slave-2w3w"
server_key: "1981d59342c618bc0c6279c608ae1390"
server_key_iv: "f51976fc62d7312aa43605f629c4a6d1"
server_key_version: "encryptionkey@0"
I20260811 08:03:43.371564 19074 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:03:43.395426 19074 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:03:43.397987 19074 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:03:43.398125 19074 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:03:43.398478 19074 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:03:43.398885 19074 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:03:43.398928 19074 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:43.398953 19074 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:03:43.399030 19074 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:43.405805 19074 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.194:38459
I20260811 08:03:43.405913 19214 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.194:38459 every 8 connection(s)
I20260811 08:03:43.406315 19074 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
I20260811 08:03:43.412077 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 19074
I20260811 08:03:43.412177 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-1/wal/instance
I20260811 08:03:43.412405 15507 external_mini_cluster.cc:1428] Setting key 33abffb968ec3296264853ec228439ba
Aug 11 08:03:43 dist-test-slave-2w3w krb5kdc[18807](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435423, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.194@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:03:43.417773 18899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:43.407296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:35557 (local address 127.15.36.254:36507)
0811 08:03:43.407350 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:43.407352 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:43.407598 (+ 246us) server_negotiation.cc:407] Connection header received
0811 08:03:43.408231 (+ 633us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:43.408232 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:43.408246 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:43.408312 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:43.409370 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:43.409891 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:43.411004 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:43.411221 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:43.411323 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:43.414164 (+ 2841us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:43.414166 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:43.414166 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:43.414175 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:43.415755 (+ 1580us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:43.416370 (+ 615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:43.416371 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:43.416372 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:43.416438 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:43.416837 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:43.416838 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:43.416838 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:43.416996 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:43.417065 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:43.417519 (+ 454us) server_negotiation.cc:299] Negotiation successful
0811 08:03:43.417648 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 08:03:43.417995 19218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:43.407247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:36507 (local address 127.15.36.194:35557)
0811 08:03:43.407458 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:43.407497 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:43.408095 (+ 598us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:43.408395 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:43.408399 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:43.409017 (+ 618us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:03:43.409239 (+ 222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:43.409244 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:43.410011 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:43.410012 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:43.410864 (+ 852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:43.410866 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:43.411337 (+ 471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:43.411338 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:43.411497 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:43.412119 (+ 622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:03:43.412128 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:03:43.414047 (+ 1919us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:03:43.415864 (+ 1817us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:43.415883 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:43.415886 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:43.416262 (+ 376us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:43.416532 (+ 270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:43.416533 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:43.416534 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:43.416699 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:43.417079 (+ 380us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:03:43.417086 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:03:43.417306 (+ 220us) client_negotiation.cc:769] Sending connection context
0811 08:03:43.417446 (+ 140us) client_negotiation.cc:240] Negotiation successful
0811 08:03:43.417660 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":92,"threads_started":1}
I20260811 08:03:43.418712 19215 heartbeater.cc:347] Connected to a master server at 127.15.36.254:36507
I20260811 08:03:43.418846 19215 heartbeater.cc:464] Registering TS with master...
I20260811 08:03:43.419113 19215 heartbeater.cc:511] Master 127.15.36.254:36507 requested a full tablet report, sending...
I20260811 08:03:43.419579 18857 ts_manager.cc:194] Registered new tserver with Master: f35d839b99c845aba0ab08af9e5c414c (127.15.36.194:38459)
I20260811 08:03:43.420042 18857 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.36.194@KRBTEST.COM'} at 127.15.36.194:35557
WARNING: no policy specified for kudu/127.15.36.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab.
Entry for principal kudu/127.15.36.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab.
I20260811 08:03:43.447824 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.195:0
--local_ip_for_outbound_sockets=127.15.36.195
--webserver_interface=127.15.36.195
--webserver_port=0
--tserver_master_addrs=127.15.36.254:36507
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab
--principal=kudu/127.15.36.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:42907
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:03:43.545346 19222 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:03:43.545674 19222 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:03:43.545704 19222 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:03:43.547298 19222 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:03:43.547372 19222 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:03:43.547434 19222 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.195
I20260811 08:03:43.549428 19222 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:42907
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab
--principal=kudu/127.15.36.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.36.195
--webserver_port=0
--tserver_master_addrs=127.15.36.254:36507
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19222
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.195
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:03:43.549678 19222 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:03:43.549896 19222 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:03:43.556061 19228 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:43.556043 19231 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:43.556288 19229 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:03:43.556576 19222 server_base.cc:1034] running on GCE node
I20260811 08:03:43.556828 19222 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:03:43.557111 19222 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:03:43.558339 19222 hybrid_clock.cc:648] HybridClock initialized: now 1786435423558324 us; error 31 us; skew 500 ppm
Aug 11 08:03:43 dist-test-slave-2w3w krb5kdc[18807](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435423, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:03:43.561230 19222 init.cc:377] Logged in from keytab as kudu/127.15.36.195@KRBTEST.COM (short username kudu)
I20260811 08:03:43.561798 19222 webserver.cc:460] Webserver started at http://127.15.36.195:33193/ using document root <none> and password file <none>
I20260811 08:03:43.562067 19222 fs_manager.cc:359] Metadata directory not provided
I20260811 08:03:43.562143 19222 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:03:43.562304 19222 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:03:43.563534 19222 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-2/data/instance:
uuid: "c1ab3bb360c44d739f3ec1cf3fadafce"
format_stamp: "Formatted at 2026-08-11 08:03:43 on dist-test-slave-2w3w"
server_key: "0fcb436e43051c685be2f559a19a6177"
server_key_iv: "c0a0b065312e05225844f75c15ca858e"
server_key_version: "encryptionkey@0"
I20260811 08:03:43.563982 19222 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-2/wal/instance:
uuid: "c1ab3bb360c44d739f3ec1cf3fadafce"
format_stamp: "Formatted at 2026-08-11 08:03:43 on dist-test-slave-2w3w"
server_key: "0fcb436e43051c685be2f559a19a6177"
server_key_iv: "c0a0b065312e05225844f75c15ca858e"
server_key_version: "encryptionkey@0"
I20260811 08:03:43.565438 19222 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 08:03:43.566359 19238 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:43.566581 19222 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:03:43.566694 19222 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-2/wal
uuid: "c1ab3bb360c44d739f3ec1cf3fadafce"
format_stamp: "Formatted at 2026-08-11 08:03:43 on dist-test-slave-2w3w"
server_key: "0fcb436e43051c685be2f559a19a6177"
server_key_iv: "c0a0b065312e05225844f75c15ca858e"
server_key_version: "encryptionkey@0"
I20260811 08:03:43.566776 19222 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:03:43.587955 19222 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:03:43.592067 19222 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:03:43.592271 19222 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:03:43.592545 19222 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:03:43.592917 19222 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:03:43.592978 19222 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:43.593025 19222 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:03:43.593055 19222 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:43.599509 19222 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.195:44443
I20260811 08:03:43.599607 19362 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.195:44443 every 8 connection(s)
I20260811 08:03:43.599975 19222 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
I20260811 08:03:43.604674 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 19222
I20260811 08:03:43.604809 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786435400844580-15507-0/minicluster-data/ts-2/wal/instance
I20260811 08:03:43.605039 15507 external_mini_cluster.cc:1428] Setting key 25e16944692f364271c8df738bb04b5d
Aug 11 08:03:43 dist-test-slave-2w3w krb5kdc[18807](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435423, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.195@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:03:43.612407 18899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:43.601039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:34663 (local address 127.15.36.254:36507)
0811 08:03:43.601088 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:43.601090 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:43.601337 (+ 247us) server_negotiation.cc:407] Connection header received
0811 08:03:43.601861 (+ 524us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:43.601862 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:43.601873 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:43.601942 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:43.603122 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:43.603712 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:43.604823 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:43.605105 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:43.605202 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:43.608324 (+ 3122us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:43.608327 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:43.608327 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:43.608335 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:43.609923 (+ 1588us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:43.610508 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:43.610511 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:43.610511 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:43.610642 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:43.611408 (+ 766us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:43.611410 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:43.611410 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:43.611572 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:43.611648 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:43.612227 (+ 579us) server_negotiation.cc:299] Negotiation successful
0811 08:03:43.612334 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 08:03:43.612574 19365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:43.601005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:36507 (local address 127.15.36.195:34663)
0811 08:03:43.601187 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:43.601233 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:43.601761 (+ 528us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:43.602045 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:43.602049 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:43.602704 (+ 655us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:03:43.602929 (+ 225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:43.602934 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:43.603830 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:43.603830 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:43.604695 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:43.604698 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:43.605218 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:43.605219 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:43.605382 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:43.606107 (+ 725us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:03:43.606120 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:03:43.608166 (+ 2046us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:03:43.610030 (+ 1864us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:43.610039 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:43.610042 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:43.610334 (+ 292us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:43.610821 (+ 487us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:43.610823 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:43.610824 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:43.611277 (+ 453us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:43.611683 (+ 406us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:03:43.611689 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:03:43.611908 (+ 219us) client_negotiation.cc:769] Sending connection context
0811 08:03:43.612134 (+ 226us) client_negotiation.cc:240] Negotiation successful
0811 08:03:43.612316 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":105,"threads_started":1}
I20260811 08:03:43.613147 19363 heartbeater.cc:347] Connected to a master server at 127.15.36.254:36507
I20260811 08:03:43.613255 19363 heartbeater.cc:464] Registering TS with master...
I20260811 08:03:43.613512 19363 heartbeater.cc:511] Master 127.15.36.254:36507 requested a full tablet report, sending...
I20260811 08:03:43.613904 18857 ts_manager.cc:194] Registered new tserver with Master: c1ab3bb360c44d739f3ec1cf3fadafce (127.15.36.195:44443)
I20260811 08:03:43.614264 18857 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.36.195@KRBTEST.COM'} at 127.15.36.195:34663
I20260811 08:03:43.617784 15507 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 08:03:43 dist-test-slave-2w3w krb5kdc[18807](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435423, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 11 08:03:43 dist-test-slave-2w3w krb5kdc[18807](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435423, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:03:43.648603 18899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:43.637279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50646 (local address 127.15.36.254:36507)
0811 08:03:43.637408 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:43.637411 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:43.637542 (+ 131us) server_negotiation.cc:407] Connection header received
0811 08:03:43.637651 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:43.637652 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:43.637663 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:43.637745 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:43.638530 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:43.639175 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:43.640657 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:43.640904 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:43.641087 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:43.644075 (+ 2988us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:43.644078 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:43.644078 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:43.644088 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:43.646274 (+ 2186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:43.647243 (+ 969us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:43.647244 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:43.647245 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:43.647340 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:43.647563 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:43.647564 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:43.647565 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:43.647762 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:43.647887 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:43.648021 (+ 134us) server_negotiation.cc:299] Negotiation successful
0811 08:03:43.648356 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
W20260811 08:03:43.649199 18857 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:50646
I20260811 08:03:43.649766 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 18923
I20260811 08:03:43.660545 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 19074
I20260811 08:03:43.672657 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 19222
I20260811 08:03:43.681594 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 18823
2026-08-11T08:03:43Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2238 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:03:43 dist-test-slave-2w3w krb5kdc[19376](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:03:43 dist-test-slave-2w3w krb5kdc[19376](info): set up 2 sockets
Aug 11 08:03:43 dist-test-slave-2w3w krb5kdc[19376](info): commencing operation
krb5kdc: starting...
W20260811 08:03:44.854843 15507 mini_kdc.cc:121] Time spent starting KDC: real 1.149s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Aug 11 08:03:44 dist-test-slave-2w3w krb5kdc[19376](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435424, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:03:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:03:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.36.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab.
Entry for principal kudu/127.15.36.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab.
I20260811 08:03:45.012606 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:34251
--webserver_interface=127.15.36.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=kudu/127.15.36.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:41387
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.36.254:34251
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:03:45.112136 19390 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:03:45.112367 19390 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:03:45.112392 19390 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:03:45.113621 19390 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:03:45.113680 19390 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:03:45.113695 19390 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:03:45.113708 19390 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:03:45.113720 19390 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:03:45.115505 19390 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:41387
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.36.254:34251
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=kudu/127.15.36.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:34251
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.36.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19390
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:03:45.115765 19390 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:03:45.115970 19390 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:03:45.121860 19395 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:45.121876 19398 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:03:45.122159 19390 server_base.cc:1034] running on GCE node
W20260811 08:03:45.121937 19396 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:03:45.122671 19390 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:03:45.123112 19390 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:03:45.124394 19390 hybrid_clock.cc:648] HybridClock initialized: now 1786435425124356 us; error 61 us; skew 500 ppm
Aug 11 08:03:45 dist-test-slave-2w3w krb5kdc[19376](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435425, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:03:45.127717 19390 init.cc:377] Logged in from keytab as kudu/127.15.36.254@KRBTEST.COM (short username kudu)
I20260811 08:03:45.128255 19390 webserver.cc:460] Webserver started at http://127.15.36.254:46363/ using document root <none> and password file <none>
I20260811 08:03:45.128520 19390 fs_manager.cc:359] Metadata directory not provided
I20260811 08:03:45.128592 19390 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:03:45.128741 19390 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:03:45.129983 19390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/minicluster-data/master-0/data/instance:
uuid: "8a067fdd0b24402c8db76af1978af2c5"
format_stamp: "Formatted at 2026-08-11 08:03:45 on dist-test-slave-2w3w"
server_key: "6005c46ed0f12ec86f807ed68cad6f84"
server_key_iv: "acf74369e30d3c4d194c0fbee3535c42"
server_key_version: "encryptionkey@0"
I20260811 08:03:45.130388 19390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/minicluster-data/master-0/wal/instance:
uuid: "8a067fdd0b24402c8db76af1978af2c5"
format_stamp: "Formatted at 2026-08-11 08:03:45 on dist-test-slave-2w3w"
server_key: "6005c46ed0f12ec86f807ed68cad6f84"
server_key_iv: "acf74369e30d3c4d194c0fbee3535c42"
server_key_version: "encryptionkey@0"
I20260811 08:03:45.132529 19390 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260811 08:03:45.133673 19405 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:45.134244 19390 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:03:45.134430 19390 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/minicluster-data/master-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/minicluster-data/master-0/wal
uuid: "8a067fdd0b24402c8db76af1978af2c5"
format_stamp: "Formatted at 2026-08-11 08:03:45 on dist-test-slave-2w3w"
server_key: "6005c46ed0f12ec86f807ed68cad6f84"
server_key_iv: "acf74369e30d3c4d194c0fbee3535c42"
server_key_version: "encryptionkey@0"
I20260811 08:03:45.134536 19390 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:03:45.146307 19390 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:03:45.148933 19390 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:03:45.149124 19390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:03:45.153733 19390 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.254:34251
I20260811 08:03:45.154191 19390 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
I20260811 08:03:45.154244 19460 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.254:34251 every 8 connection(s)
I20260811 08:03:45.155588 19461 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:03:45.159354 19461 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a067fdd0b24402c8db76af1978af2c5: Bootstrap starting.
I20260811 08:03:45.160108 19461 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8a067fdd0b24402c8db76af1978af2c5: Neither blocks nor log segments found. Creating new log.
I20260811 08:03:45.160470 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 19390
I20260811 08:03:45.160523 19461 log.cc:824] T 00000000000000000000000000000000 P 8a067fdd0b24402c8db76af1978af2c5: Log is configured to *not* fsync() on all Append() calls
I20260811 08:03:45.160583 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/minicluster-data/master-0/wal/instance
I20260811 08:03:45.160786 15507 external_mini_cluster.cc:1428] Setting key 4a2fee44fadb04e245aa54fca68745ae
I20260811 08:03:45.161592 19461 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a067fdd0b24402c8db76af1978af2c5: No bootstrap required, opened a new log
I20260811 08:03:45.164213 19461 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8a067fdd0b24402c8db76af1978af2c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a067fdd0b24402c8db76af1978af2c5" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 34251 } }
I20260811 08:03:45.164443 19461 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8a067fdd0b24402c8db76af1978af2c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:03:45.164498 19461 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8a067fdd0b24402c8db76af1978af2c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a067fdd0b24402c8db76af1978af2c5, State: Initialized, Role: FOLLOWER
I20260811 08:03:45.164641 19461 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8a067fdd0b24402c8db76af1978af2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a067fdd0b24402c8db76af1978af2c5" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 34251 } }
I20260811 08:03:45.164742 19461 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8a067fdd0b24402c8db76af1978af2c5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:03:45.164789 19461 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8a067fdd0b24402c8db76af1978af2c5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:03:45.164839 19461 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8a067fdd0b24402c8db76af1978af2c5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:03:45.165591 19461 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8a067fdd0b24402c8db76af1978af2c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a067fdd0b24402c8db76af1978af2c5" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 34251 } }
I20260811 08:03:45.165714 19461 leader_election.cc:302] T 00000000000000000000000000000000 P 8a067fdd0b24402c8db76af1978af2c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8a067fdd0b24402c8db76af1978af2c5; no voters:
I20260811 08:03:45.165913 19461 leader_election.cc:288] T 00000000000000000000000000000000 P 8a067fdd0b24402c8db76af1978af2c5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:03:45.165990 19467 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8a067fdd0b24402c8db76af1978af2c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:03:45.166172 19461 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8a067fdd0b24402c8db76af1978af2c5 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:03:45.166203 19467 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8a067fdd0b24402c8db76af1978af2c5 [term 1 LEADER]: Becoming Leader. State: Replica: 8a067fdd0b24402c8db76af1978af2c5, State: Running, Role: LEADER
I20260811 08:03:45.166389 19467 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8a067fdd0b24402c8db76af1978af2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a067fdd0b24402c8db76af1978af2c5" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 34251 } }
I20260811 08:03:45.166796 19468 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a067fdd0b24402c8db76af1978af2c5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8a067fdd0b24402c8db76af1978af2c5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a067fdd0b24402c8db76af1978af2c5" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 34251 } } }
I20260811 08:03:45.167300 19469 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a067fdd0b24402c8db76af1978af2c5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8a067fdd0b24402c8db76af1978af2c5. Latest consensus state: current_term: 1 leader_uuid: "8a067fdd0b24402c8db76af1978af2c5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a067fdd0b24402c8db76af1978af2c5" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 34251 } } }
I20260811 08:03:45.167393 19469 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a067fdd0b24402c8db76af1978af2c5 [sys.catalog]: This master's current role is: LEADER
I20260811 08:03:45.166927 19468 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a067fdd0b24402c8db76af1978af2c5 [sys.catalog]: This master's current role is: LEADER
I20260811 08:03:45.167783 19482 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:03:45.168445 19482 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 11 08:03:45 dist-test-slave-2w3w krb5kdc[19376](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435424, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:03:45.170372 19482 catalog_manager.cc:1347] Generated new cluster ID: f7403f796927402badb11b98109e0ee2
I20260811 08:03:45.170429 19482 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:03:45.175550 19466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:45.161514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57140 (local address 127.15.36.254:34251)
0811 08:03:45.161765 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:45.161774 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:45.161804 (+ 30us) server_negotiation.cc:407] Connection header received
0811 08:03:45.162385 (+ 581us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:45.162400 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:45.162497 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:45.162672 (+ 175us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:45.163589 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:45.165185 (+ 1596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:45.166324 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:45.167095 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:45.167179 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:45.170447 (+ 3268us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:45.170452 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:45.170452 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:45.170465 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:45.173083 (+ 2618us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:45.173971 (+ 888us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:45.173975 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:45.173975 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:45.174124 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:45.174375 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:45.174376 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:45.174377 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:45.174789 (+ 412us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:45.175052 (+ 263us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:45.175154 (+ 102us) server_negotiation.cc:299] Negotiation successful
0811 08:03:45.175323 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":199,"thread_start_us":120,"threads_started":1}
I20260811 08:03:45.185905 19482 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:03:45.186517 19482 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:03:45.193233 19482 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8a067fdd0b24402c8db76af1978af2c5: Generated new TSK 0
I20260811 08:03:45.193585 19482 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.36.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab.
Entry for principal kudu/127.15.36.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab.
I20260811 08:03:45.236343 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.193:0
--local_ip_for_outbound_sockets=127.15.36.193
--webserver_interface=127.15.36.193
--webserver_port=0
--tserver_master_addrs=127.15.36.254:34251
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab
--principal=kudu/127.15.36.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:41387
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:03:45.345013 19492 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:03:45.345278 19492 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:03:45.345310 19492 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:03:45.346786 19492 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:03:45.346848 19492 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:03:45.346880 19492 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.193
I20260811 08:03:45.349026 19492 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:41387
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab
--principal=kudu/127.15.36.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.36.193
--webserver_port=0
--tserver_master_addrs=127.15.36.254:34251
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19492
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.193
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:03:45.349318 19492 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:03:45.349548 19492 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:03:45.355850 19498 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:45.356159 19497 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:45.355849 19500 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:03:45.357170 19492 server_base.cc:1034] running on GCE node
I20260811 08:03:45.357508 19492 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:03:45.357777 19492 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:03:45.359103 19492 hybrid_clock.cc:648] HybridClock initialized: now 1786435425359065 us; error 64 us; skew 500 ppm
Aug 11 08:03:45 dist-test-slave-2w3w krb5kdc[19376](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435425, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:03:45.362360 19492 init.cc:377] Logged in from keytab as kudu/127.15.36.193@KRBTEST.COM (short username kudu)
I20260811 08:03:45.363049 19492 webserver.cc:460] Webserver started at http://127.15.36.193:39225/ using document root <none> and password file <none>
I20260811 08:03:45.363338 19492 fs_manager.cc:359] Metadata directory not provided
I20260811 08:03:45.363413 19492 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:03:45.363587 19492 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:03:45.365211 19492 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/minicluster-data/ts-0/data/instance:
uuid: "ab99b74db4a248e7a6f5367b333f057e"
format_stamp: "Formatted at 2026-08-11 08:03:45 on dist-test-slave-2w3w"
server_key: "3ea6d04edc79ae8047d92cad255fa961"
server_key_iv: "82b8adbd90b2ad70bfe3cb5306bc1798"
server_key_version: "encryptionkey@0"
I20260811 08:03:45.365660 19492 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/minicluster-data/ts-0/wal/instance:
uuid: "ab99b74db4a248e7a6f5367b333f057e"
format_stamp: "Formatted at 2026-08-11 08:03:45 on dist-test-slave-2w3w"
server_key: "3ea6d04edc79ae8047d92cad255fa961"
server_key_iv: "82b8adbd90b2ad70bfe3cb5306bc1798"
server_key_version: "encryptionkey@0"
I20260811 08:03:45.367654 19492 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.003s
I20260811 08:03:45.368747 19507 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:45.369029 19492 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:03:45.369122 19492 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/minicluster-data/ts-0/wal
uuid: "ab99b74db4a248e7a6f5367b333f057e"
format_stamp: "Formatted at 2026-08-11 08:03:45 on dist-test-slave-2w3w"
server_key: "3ea6d04edc79ae8047d92cad255fa961"
server_key_iv: "82b8adbd90b2ad70bfe3cb5306bc1798"
server_key_version: "encryptionkey@0"
I20260811 08:03:45.369189 19492 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:03:45.387970 19492 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:03:45.392273 19492 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:03:45.392788 19492 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:03:45.393240 19492 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:03:45.393772 19492 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:03:45.393827 19492 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:45.393857 19492 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:03:45.393870 19492 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:45.402927 19492 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.193:38713
I20260811 08:03:45.403131 19635 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.193:38713 every 8 connection(s)
I20260811 08:03:45.403491 19492 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
I20260811 08:03:45.406143 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 19492
I20260811 08:03:45.406275 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/minicluster-data/ts-0/wal/instance
I20260811 08:03:45.406492 15507 external_mini_cluster.cc:1428] Setting key 148cfa64f65384aa6df306870f75834b
Aug 11 08:03:45 dist-test-slave-2w3w krb5kdc[19376](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435425, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.193@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.15.36.194@KRBTEST.COM; defaulting to no policy
I20260811 08:03:45.417416 19466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:45.404551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:36611 (local address 127.15.36.254:34251)
0811 08:03:45.404641 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:45.404643 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:45.404890 (+ 247us) server_negotiation.cc:407] Connection header received
0811 08:03:45.406275 (+ 1385us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:45.406277 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:45.406300 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:45.406436 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:45.407437 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:45.408089 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:45.409808 (+ 1719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:45.410061 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:45.410146 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:45.413062 (+ 2916us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:45.413064 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:45.413064 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:45.413074 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:45.415415 (+ 2341us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:45.416107 (+ 692us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:45.416109 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:45.416109 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:45.416182 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:45.416490 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:45.416490 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:45.416491 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:45.416679 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:45.416767 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:45.417166 (+ 399us) server_negotiation.cc:299] Negotiation successful
0811 08:03:45.417277 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 08:03:45.417960 19638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:45.404497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:34251 (local address 127.15.36.193:36611)
0811 08:03:45.404679 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:45.404727 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:45.405990 (+ 1263us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:45.406539 (+ 549us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:45.406545 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:45.406961 (+ 416us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:03:45.407278 (+ 317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:45.407285 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:45.408216 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:45.408218 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:45.409684 (+ 1466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:45.409688 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:45.410174 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:45.410175 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:45.410330 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:45.411046 (+ 716us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:03:45.411060 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:03:45.412920 (+ 1860us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:03:45.415554 (+ 2634us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:45.415569 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:45.415572 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:45.415965 (+ 393us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:45.416260 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:45.416261 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:45.416261 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:45.416403 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:45.416768 (+ 365us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:03:45.416778 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:03:45.417013 (+ 235us) client_negotiation.cc:769] Sending connection context
0811 08:03:45.417145 (+ 132us) client_negotiation.cc:240] Negotiation successful
0811 08:03:45.417347 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":98,"threads_started":1}
I20260811 08:03:45.419399 19636 heartbeater.cc:347] Connected to a master server at 127.15.36.254:34251
I20260811 08:03:45.419539 19636 heartbeater.cc:464] Registering TS with master...
I20260811 08:03:45.419909 19636 heartbeater.cc:511] Master 127.15.36.254:34251 requested a full tablet report, sending...
I20260811 08:03:45.421025 19422 ts_manager.cc:194] Registered new tserver with Master: ab99b74db4a248e7a6f5367b333f057e (127.15.36.193:38713)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.194@KRBTEST.COM" created.
I20260811 08:03:45.421833 19422 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.36.193@KRBTEST.COM'} at 127.15.36.193:36611
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab.
Entry for principal kudu/127.15.36.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab.
I20260811 08:03:45.446502 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.194:0
--local_ip_for_outbound_sockets=127.15.36.194
--webserver_interface=127.15.36.194
--webserver_port=0
--tserver_master_addrs=127.15.36.254:34251
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab
--principal=kudu/127.15.36.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:41387
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:03:45.556546 19641 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:03:45.556816 19641 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:03:45.556846 19641 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:03:45.558409 19641 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:03:45.558480 19641 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:03:45.558512 19641 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.194
I20260811 08:03:45.560287 19641 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:41387
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab
--principal=kudu/127.15.36.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.36.194
--webserver_port=0
--tserver_master_addrs=127.15.36.254:34251
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19641
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.194
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:03:45.560550 19641 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:03:45.560770 19641 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:03:45.567782 19646 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:45.567782 19650 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:45.567812 19647 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:03:45.569202 19641 server_base.cc:1034] running on GCE node
I20260811 08:03:45.569485 19641 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:03:45.569792 19641 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:03:45.571066 19641 hybrid_clock.cc:648] HybridClock initialized: now 1786435425570968 us; error 109 us; skew 500 ppm
Aug 11 08:03:45 dist-test-slave-2w3w krb5kdc[19376](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435425, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:03:45.574466 19641 init.cc:377] Logged in from keytab as kudu/127.15.36.194@KRBTEST.COM (short username kudu)
I20260811 08:03:45.575136 19641 webserver.cc:460] Webserver started at http://127.15.36.194:36621/ using document root <none> and password file <none>
I20260811 08:03:45.575402 19641 fs_manager.cc:359] Metadata directory not provided
I20260811 08:03:45.575455 19641 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:03:45.575615 19641 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:03:45.576807 19641 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/minicluster-data/ts-1/data/instance:
uuid: "606ba3a144a041a8a71b6e3d2e202678"
format_stamp: "Formatted at 2026-08-11 08:03:45 on dist-test-slave-2w3w"
server_key: "47212d8314217a3ae5314f360ada487e"
server_key_iv: "bc57896f650ae5224cf5f23ffb51cbaf"
server_key_version: "encryptionkey@0"
I20260811 08:03:45.577176 19641 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/minicluster-data/ts-1/wal/instance:
uuid: "606ba3a144a041a8a71b6e3d2e202678"
format_stamp: "Formatted at 2026-08-11 08:03:45 on dist-test-slave-2w3w"
server_key: "47212d8314217a3ae5314f360ada487e"
server_key_iv: "bc57896f650ae5224cf5f23ffb51cbaf"
server_key_version: "encryptionkey@0"
I20260811 08:03:45.578809 19641 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 08:03:45.580093 19659 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:45.580425 19641 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:03:45.580847 19641 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/minicluster-data/ts-1/wal
uuid: "606ba3a144a041a8a71b6e3d2e202678"
format_stamp: "Formatted at 2026-08-11 08:03:45 on dist-test-slave-2w3w"
server_key: "47212d8314217a3ae5314f360ada487e"
server_key_iv: "bc57896f650ae5224cf5f23ffb51cbaf"
server_key_version: "encryptionkey@0"
I20260811 08:03:45.581004 19641 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:03:45.592852 19641 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:03:45.595615 19641 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:03:45.595813 19641 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:03:45.596109 19641 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:03:45.596454 19641 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:03:45.596513 19641 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:45.596555 19641 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:03:45.596585 19641 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:45.604544 19641 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.194:37841
I20260811 08:03:45.604808 19785 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.194:37841 every 8 connection(s)
I20260811 08:03:45.605108 19641 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
Aug 11 08:03:45 dist-test-slave-2w3w krb5kdc[19376](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435425, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.194@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:03:45.614759 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 19641
I20260811 08:03:45.614885 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/minicluster-data/ts-1/wal/instance
I20260811 08:03:45.615190 15507 external_mini_cluster.cc:1428] Setting key 6d0b07a93e0b5010cf1b651c20f06254
I20260811 08:03:45.618577 19466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:45.605986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:50217 (local address 127.15.36.254:34251)
0811 08:03:45.606080 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:45.606083 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:45.606286 (+ 203us) server_negotiation.cc:407] Connection header received
0811 08:03:45.607359 (+ 1073us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:45.607361 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:45.607380 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:45.607534 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:45.608804 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:45.609403 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:45.610633 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:45.610871 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:45.611106 (+ 235us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:45.614230 (+ 3124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:45.614234 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:45.614236 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:45.614250 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:45.616364 (+ 2114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:45.616964 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:45.616965 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:45.616965 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:45.617048 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:45.617383 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:45.617384 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:45.617384 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:45.617521 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:45.617587 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:45.618313 (+ 726us) server_negotiation.cc:299] Negotiation successful
0811 08:03:45.618444 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 08:03:45.618608 19788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:45.605933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:34251 (local address 127.15.36.194:50217)
0811 08:03:45.606113 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:45.606151 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:45.607212 (+ 1061us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:45.607812 (+ 600us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:45.607818 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:45.608237 (+ 419us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:03:45.608635 (+ 398us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:45.608646 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:45.609566 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:45.609567 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:45.610488 (+ 921us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:45.610491 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:45.611163 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:45.611165 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:45.611392 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:45.612059 (+ 667us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:03:45.612068 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:03:45.613948 (+ 1880us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:03:45.616471 (+ 2523us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:45.616483 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:45.616486 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:45.616853 (+ 367us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:45.617126 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:45.617127 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:45.617127 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:45.617291 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:45.617710 (+ 419us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:03:45.617718 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:03:45.617925 (+ 207us) client_negotiation.cc:769] Sending connection context
0811 08:03:45.618166 (+ 241us) client_negotiation.cc:240] Negotiation successful
0811 08:03:45.618404 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":108,"threads_started":1}
I20260811 08:03:45.619205 19786 heartbeater.cc:347] Connected to a master server at 127.15.36.254:34251
I20260811 08:03:45.619302 19786 heartbeater.cc:464] Registering TS with master...
I20260811 08:03:45.619527 19786 heartbeater.cc:511] Master 127.15.36.254:34251 requested a full tablet report, sending...
I20260811 08:03:45.620016 19422 ts_manager.cc:194] Registered new tserver with Master: 606ba3a144a041a8a71b6e3d2e202678 (127.15.36.194:37841)
I20260811 08:03:45.620455 19422 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.36.194@KRBTEST.COM'} at 127.15.36.194:50217
WARNING: no policy specified for kudu/127.15.36.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab.
Entry for principal kudu/127.15.36.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab.
I20260811 08:03:45.651284 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.195:0
--local_ip_for_outbound_sockets=127.15.36.195
--webserver_interface=127.15.36.195
--webserver_port=0
--tserver_master_addrs=127.15.36.254:34251
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab
--principal=kudu/127.15.36.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:41387
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:03:45.750370 19791 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:03:45.750674 19791 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:03:45.750722 19791 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:03:45.752142 19791 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:03:45.752223 19791 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:03:45.752275 19791 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.195
I20260811 08:03:45.754760 19791 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:41387
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab
--principal=kudu/127.15.36.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.36.195
--webserver_port=0
--tserver_master_addrs=127.15.36.254:34251
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19791
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.195
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:03:45.755282 19791 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:03:45.755632 19791 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:03:45.761765 19797 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:45.761750 19800 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:03:45.761921 19791 server_base.cc:1034] running on GCE node
W20260811 08:03:45.761750 19798 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:03:45.762388 19791 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:03:45.762720 19791 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:03:45.763974 19791 hybrid_clock.cc:648] HybridClock initialized: now 1786435425763936 us; error 58 us; skew 500 ppm
Aug 11 08:03:45 dist-test-slave-2w3w krb5kdc[19376](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435425, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:03:45.767087 19791 init.cc:377] Logged in from keytab as kudu/127.15.36.195@KRBTEST.COM (short username kudu)
I20260811 08:03:45.767619 19791 webserver.cc:460] Webserver started at http://127.15.36.195:35895/ using document root <none> and password file <none>
I20260811 08:03:45.767895 19791 fs_manager.cc:359] Metadata directory not provided
I20260811 08:03:45.767942 19791 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:03:45.768050 19791 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:03:45.769179 19791 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/minicluster-data/ts-2/data/instance:
uuid: "26d01381fc1d4d83a7eb90c44ba4b46b"
format_stamp: "Formatted at 2026-08-11 08:03:45 on dist-test-slave-2w3w"
server_key: "13daba06198f456f7704dc4978010eac"
server_key_iv: "8dc8b77c944e9523fbc6a388fc3c8e9d"
server_key_version: "encryptionkey@0"
I20260811 08:03:45.769568 19791 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/minicluster-data/ts-2/wal/instance:
uuid: "26d01381fc1d4d83a7eb90c44ba4b46b"
format_stamp: "Formatted at 2026-08-11 08:03:45 on dist-test-slave-2w3w"
server_key: "13daba06198f456f7704dc4978010eac"
server_key_iv: "8dc8b77c944e9523fbc6a388fc3c8e9d"
server_key_version: "encryptionkey@0"
I20260811 08:03:45.771111 19791 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 08:03:45.772125 19807 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:45.772418 19791 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:03:45.772519 19791 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/minicluster-data/ts-2/wal
uuid: "26d01381fc1d4d83a7eb90c44ba4b46b"
format_stamp: "Formatted at 2026-08-11 08:03:45 on dist-test-slave-2w3w"
server_key: "13daba06198f456f7704dc4978010eac"
server_key_iv: "8dc8b77c944e9523fbc6a388fc3c8e9d"
server_key_version: "encryptionkey@0"
I20260811 08:03:45.772588 19791 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:03:45.787809 19791 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:03:45.790304 19791 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:03:45.790448 19791 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:03:45.790861 19791 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:03:45.791522 19791 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:03:45.791589 19791 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:45.791625 19791 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:03:45.791642 19791 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:45.799273 19791 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.195:38589
I20260811 08:03:45.799319 19937 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.195:38589 every 8 connection(s)
I20260811 08:03:45.799702 19791 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
Aug 11 08:03:45 dist-test-slave-2w3w krb5kdc[19376](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435425, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.195@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:03:45.809267 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 19791
I20260811 08:03:45.809345 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786435400844580-15507-0/minicluster-data/ts-2/wal/instance
I20260811 08:03:45.809563 15507 external_mini_cluster.cc:1428] Setting key 39f0902c33a56f455d2ef663522b2486
I20260811 08:03:45.811918 19466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:45.800612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:55201 (local address 127.15.36.254:34251)
0811 08:03:45.800675 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:45.800677 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:45.800985 (+ 308us) server_negotiation.cc:407] Connection header received
0811 08:03:45.802226 (+ 1241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:45.802228 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:45.802240 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:45.802353 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:45.803465 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:45.804300 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:45.805512 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:45.805719 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:45.805783 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:45.808286 (+ 2503us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:45.808289 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:45.808289 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:45.808298 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:45.810013 (+ 1715us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:45.810702 (+ 689us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:45.810703 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:45.810704 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:45.810773 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:45.811197 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:45.811198 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:45.811198 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:45.811337 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:45.811397 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:45.811758 (+ 361us) server_negotiation.cc:299] Negotiation successful
0811 08:03:45.811846 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 08:03:45.813133 19941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:45.800519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:34251 (local address 127.15.36.195:55201)
0811 08:03:45.800696 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:45.800753 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:45.802071 (+ 1318us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:45.802468 (+ 397us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:45.802471 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:45.802940 (+ 469us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:03:45.803253 (+ 313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:45.803259 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:45.804463 (+ 1204us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:45.804464 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:45.805400 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:45.805404 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:45.805813 (+ 409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:45.805814 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:45.805956 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:45.806560 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:03:45.806569 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:03:45.808157 (+ 1588us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:03:45.810105 (+ 1948us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:45.810135 (+ 30us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:45.810139 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:45.810523 (+ 384us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:45.810886 (+ 363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:45.810887 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:45.810888 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:45.811118 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:45.811413 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:03:45.811419 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:03:45.811566 (+ 147us) client_negotiation.cc:769] Sending connection context
0811 08:03:45.811661 (+ 95us) client_negotiation.cc:240] Negotiation successful
0811 08:03:45.811955 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":106,"threads_started":1}
I20260811 08:03:45.814078 19938 heartbeater.cc:347] Connected to a master server at 127.15.36.254:34251
I20260811 08:03:45.814191 19938 heartbeater.cc:464] Registering TS with master...
I20260811 08:03:45.814430 19938 heartbeater.cc:511] Master 127.15.36.254:34251 requested a full tablet report, sending...
I20260811 08:03:45.814945 19422 ts_manager.cc:194] Registered new tserver with Master: 26d01381fc1d4d83a7eb90c44ba4b46b (127.15.36.195:38589)
I20260811 08:03:45.815763 19422 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.36.195@KRBTEST.COM'} at 127.15.36.195:55201
I20260811 08:03:45.823048 15507 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 08:03:45 dist-test-slave-2w3w krb5kdc[19376](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435425, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 08:03:45 dist-test-slave-2w3w krb5kdc[19376](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435425, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.36.193@KRBTEST.COM
I20260811 08:03:45.852001 19947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:45.841963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55274 (local address 127.15.36.193:38713)
0811 08:03:45.842179 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:45.842184 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:45.842196 (+ 12us) server_negotiation.cc:407] Connection header received
0811 08:03:45.842233 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:45.842235 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:45.842250 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:45.842330 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:45.843078 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:45.843846 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:45.845025 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:45.845380 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:45.845451 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:45.848306 (+ 2855us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:45.848320 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:45.848320 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:45.848331 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:45.850321 (+ 1990us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:45.850736 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:45.850739 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:45.850739 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:45.850804 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:45.851303 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:45.851304 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:45.851304 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:45.851480 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:45.851609 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:45.851815 (+ 206us) server_negotiation.cc:299] Negotiation successful
0811 08:03:45.851898 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":120,"threads_started":1}
Aug 11 08:03:45 dist-test-slave-2w3w krb5kdc[19376](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435425, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:03:45.862571 19466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:45.853990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57142 (local address 127.15.36.254:34251)
0811 08:03:45.854068 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:45.854071 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:45.854177 (+ 106us) server_negotiation.cc:407] Connection header received
0811 08:03:45.854248 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:45.854249 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:45.854259 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:45.854301 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:45.855188 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:45.855704 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:45.856435 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:45.856686 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:45.856767 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:45.859525 (+ 2758us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:45.859527 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:45.859527 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:45.859535 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:45.861089 (+ 1554us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:45.861534 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:45.861535 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:45.861535 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:45.861597 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:45.861877 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:45.861879 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:45.861879 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:45.862074 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:45.862162 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:45.862323 (+ 161us) server_negotiation.cc:299] Negotiation successful
0811 08:03:45.862433 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
W20260811 08:03:45.863071 19422 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57142
I20260811 08:03:45.863533 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 19492
I20260811 08:03:45.871698 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 19641
I20260811 08:03:45.879271 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 19791
I20260811 08:03:45.885666 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 19390
2026-08-11T08:03:45Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2203 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:03:45 dist-test-slave-2w3w krb5kdc[19952](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:03:45 dist-test-slave-2w3w krb5kdc[19952](info): set up 2 sockets
Aug 11 08:03:45 dist-test-slave-2w3w krb5kdc[19952](info): commencing operation
krb5kdc: starting...
W20260811 08:03:47.064990 15507 mini_kdc.cc:121] Time spent starting KDC: real 1.156s user 0.003s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Aug 11 08:03:47 dist-test-slave-2w3w krb5kdc[19952](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435427, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:03:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:03:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.36.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab.
Entry for principal kudu/127.15.36.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab.
I20260811 08:03:47.211661 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:36257
--webserver_interface=127.15.36.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=kudu/127.15.36.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:43737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.36.254:36257
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:03:47.302542 19965 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:03:47.302853 19965 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:03:47.302896 19965 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:03:47.304248 19965 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:03:47.304347 19965 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:03:47.304371 19965 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:03:47.304401 19965 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:03:47.304432 19965 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:03:47.306190 19965 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:43737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.36.254:36257
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=kudu/127.15.36.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:36257
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.36.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19965
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:03:47.306543 19965 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:03:47.306802 19965 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:03:47.313522 19976 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:47.313611 19972 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:47.313613 19974 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:03:47.313877 19965 server_base.cc:1034] running on GCE node
I20260811 08:03:47.314186 19965 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:03:47.314548 19965 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:03:47.315797 19965 hybrid_clock.cc:648] HybridClock initialized: now 1786435427315810 us; error 65 us; skew 500 ppm
Aug 11 08:03:47 dist-test-slave-2w3w krb5kdc[19952](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435427, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:03:47.323908 19965 init.cc:377] Logged in from keytab as kudu/127.15.36.254@KRBTEST.COM (short username kudu)
I20260811 08:03:47.324410 19965 fs_manager.cc:359] Metadata directory not provided
I20260811 08:03:47.324496 19965 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:03:47.324663 19965 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:03:47.326015 19965 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/minicluster-data/master-0/data/instance:
uuid: "0ed65d0366e34a6e8912f212c4c1dc0d"
format_stamp: "Formatted at 2026-08-11 08:03:47 on dist-test-slave-2w3w"
server_key: "fe53b457a5a48c86be7a16a123bcb883"
server_key_iv: "21d4d238510386b5003bee83612a4f01"
server_key_version: "encryptionkey@0"
I20260811 08:03:47.326459 19965 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/minicluster-data/master-0/wal/instance:
uuid: "0ed65d0366e34a6e8912f212c4c1dc0d"
format_stamp: "Formatted at 2026-08-11 08:03:47 on dist-test-slave-2w3w"
server_key: "fe53b457a5a48c86be7a16a123bcb883"
server_key_iv: "21d4d238510386b5003bee83612a4f01"
server_key_version: "encryptionkey@0"
I20260811 08:03:47.328344 19965 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260811 08:03:47.329506 19983 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:47.329777 19965 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:03:47.329926 19965 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/minicluster-data/master-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/minicluster-data/master-0/wal
uuid: "0ed65d0366e34a6e8912f212c4c1dc0d"
format_stamp: "Formatted at 2026-08-11 08:03:47 on dist-test-slave-2w3w"
server_key: "fe53b457a5a48c86be7a16a123bcb883"
server_key_iv: "21d4d238510386b5003bee83612a4f01"
server_key_version: "encryptionkey@0"
I20260811 08:03:47.330088 19965 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:03:47.348575 19965 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:03:47.351142 19965 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:03:47.351272 19965 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:03:47.355759 19965 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.254:36257
I20260811 08:03:47.355862 20041 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.254:36257 every 8 connection(s)
I20260811 08:03:47.356357 19965 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
I20260811 08:03:47.357621 20042 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:03:47.358204 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 19965
I20260811 08:03:47.358299 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/minicluster-data/master-0/wal/instance
I20260811 08:03:47.358517 15507 external_mini_cluster.cc:1428] Setting key d4799e7d8f8ea6ac94503c8b099692a9
I20260811 08:03:47.361328 20042 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ed65d0366e34a6e8912f212c4c1dc0d: Bootstrap starting.
I20260811 08:03:47.362202 20042 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0ed65d0366e34a6e8912f212c4c1dc0d: Neither blocks nor log segments found. Creating new log.
I20260811 08:03:47.362540 20042 log.cc:824] T 00000000000000000000000000000000 P 0ed65d0366e34a6e8912f212c4c1dc0d: Log is configured to *not* fsync() on all Append() calls
I20260811 08:03:47.363826 20042 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ed65d0366e34a6e8912f212c4c1dc0d: No bootstrap required, opened a new log
I20260811 08:03:47.366144 20042 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0ed65d0366e34a6e8912f212c4c1dc0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ed65d0366e34a6e8912f212c4c1dc0d" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 36257 } }
I20260811 08:03:47.366308 20042 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0ed65d0366e34a6e8912f212c4c1dc0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:03:47.366333 20042 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0ed65d0366e34a6e8912f212c4c1dc0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ed65d0366e34a6e8912f212c4c1dc0d, State: Initialized, Role: FOLLOWER
I20260811 08:03:47.366501 20042 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0ed65d0366e34a6e8912f212c4c1dc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ed65d0366e34a6e8912f212c4c1dc0d" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 36257 } }
I20260811 08:03:47.366582 20042 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0ed65d0366e34a6e8912f212c4c1dc0d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:03:47.366623 20042 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0ed65d0366e34a6e8912f212c4c1dc0d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:03:47.366673 20042 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0ed65d0366e34a6e8912f212c4c1dc0d [term 0 FOLLOWER]: Advancing to term 1
Aug 11 08:03:47 dist-test-slave-2w3w krb5kdc[19952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435427, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:03:47.367467 20042 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0ed65d0366e34a6e8912f212c4c1dc0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ed65d0366e34a6e8912f212c4c1dc0d" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 36257 } }
I20260811 08:03:47.367600 20042 leader_election.cc:302] T 00000000000000000000000000000000 P 0ed65d0366e34a6e8912f212c4c1dc0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0ed65d0366e34a6e8912f212c4c1dc0d; no voters:
I20260811 08:03:47.367810 20042 leader_election.cc:288] T 00000000000000000000000000000000 P 0ed65d0366e34a6e8912f212c4c1dc0d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:03:47.367869 20047 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0ed65d0366e34a6e8912f212c4c1dc0d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:03:47.368026 20047 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0ed65d0366e34a6e8912f212c4c1dc0d [term 1 LEADER]: Becoming Leader. State: Replica: 0ed65d0366e34a6e8912f212c4c1dc0d, State: Running, Role: LEADER
I20260811 08:03:47.368112 20042 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0ed65d0366e34a6e8912f212c4c1dc0d [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:03:47.368150 20047 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0ed65d0366e34a6e8912f212c4c1dc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ed65d0366e34a6e8912f212c4c1dc0d" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 36257 } }
I20260811 08:03:47.368544 20047 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ed65d0366e34a6e8912f212c4c1dc0d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0ed65d0366e34a6e8912f212c4c1dc0d. Latest consensus state: current_term: 1 leader_uuid: "0ed65d0366e34a6e8912f212c4c1dc0d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ed65d0366e34a6e8912f212c4c1dc0d" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 36257 } } }
I20260811 08:03:47.368655 20047 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ed65d0366e34a6e8912f212c4c1dc0d [sys.catalog]: This master's current role is: LEADER
W20260811 08:03:47.370229 20065 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0ed65d0366e34a6e8912f212c4c1dc0d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 08:03:47.370342 20065 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 08:03:47.368765 20049 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ed65d0366e34a6e8912f212c4c1dc0d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0ed65d0366e34a6e8912f212c4c1dc0d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ed65d0366e34a6e8912f212c4c1dc0d" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 36257 } } }
I20260811 08:03:47.370754 20049 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ed65d0366e34a6e8912f212c4c1dc0d [sys.catalog]: This master's current role is: LEADER
I20260811 08:03:47.371272 20058 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:03:47.371526 20058 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:03:47.372144 20045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:47.359229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38812 (local address 127.15.36.254:36257)
0811 08:03:47.359449 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:47.359460 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:47.359498 (+ 38us) server_negotiation.cc:407] Connection header received
0811 08:03:47.360150 (+ 652us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:47.360159 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:47.360227 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:47.360414 (+ 187us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:47.361087 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:47.362652 (+ 1565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:47.364111 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:47.364749 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:47.364894 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:47.367601 (+ 2707us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:47.367605 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:47.367606 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:47.367621 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:47.369902 (+ 2281us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:47.370399 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:47.370403 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:47.370403 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:47.370530 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:47.370812 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:47.370813 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:47.370813 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:47.371164 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:47.371318 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:47.371792 (+ 474us) server_negotiation.cc:299] Negotiation successful
0811 08:03:47.371942 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":73,"threads_started":1}
I20260811 08:03:47.373670 20058 catalog_manager.cc:1347] Generated new cluster ID: 262d76237adb418fbf8c998974cd3104
I20260811 08:03:47.373730 20058 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:03:47.386348 20058 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:03:47.387156 20058 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:03:47.390707 20058 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0ed65d0366e34a6e8912f212c4c1dc0d: Generated new TSK 0
I20260811 08:03:47.390921 20058 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.36.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab.
Entry for principal kudu/127.15.36.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab.
I20260811 08:03:47.427906 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.193:0
--local_ip_for_outbound_sockets=127.15.36.193
--webserver_interface=127.15.36.193
--webserver_port=0
--tserver_master_addrs=127.15.36.254:36257
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab
--principal=kudu/127.15.36.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:43737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:03:47.522009 20070 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:03:47.522338 20070 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:03:47.522392 20070 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:03:47.523999 20070 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:03:47.524093 20070 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:03:47.524207 20070 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.193
I20260811 08:03:47.526261 20070 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:43737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab
--principal=kudu/127.15.36.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.36.193
--webserver_port=0
--tserver_master_addrs=127.15.36.254:36257
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20070
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.193
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:03:47.526628 20070 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:03:47.526937 20070 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:03:47.533047 20078 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:47.533033 20076 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:47.533033 20075 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:03:47.533398 20070 server_base.cc:1034] running on GCE node
I20260811 08:03:47.533830 20070 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:03:47.534147 20070 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:03:47.535362 20070 hybrid_clock.cc:648] HybridClock initialized: now 1786435427535337 us; error 50 us; skew 500 ppm
Aug 11 08:03:47 dist-test-slave-2w3w krb5kdc[19952](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435427, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:03:47.538754 20070 init.cc:377] Logged in from keytab as kudu/127.15.36.193@KRBTEST.COM (short username kudu)
I20260811 08:03:47.539412 20070 fs_manager.cc:359] Metadata directory not provided
I20260811 08:03:47.539482 20070 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:03:47.539590 20070 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:03:47.540972 20070 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/minicluster-data/ts-0/data/instance:
uuid: "d6aa4a0f96c341fa828d23136139fa7e"
format_stamp: "Formatted at 2026-08-11 08:03:47 on dist-test-slave-2w3w"
server_key: "9a10ba676e88700eeeecba0cb6910c4e"
server_key_iv: "91bcffd0eb0d924e1c1f75d42f058f18"
server_key_version: "encryptionkey@0"
I20260811 08:03:47.541391 20070 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/minicluster-data/ts-0/wal/instance:
uuid: "d6aa4a0f96c341fa828d23136139fa7e"
format_stamp: "Formatted at 2026-08-11 08:03:47 on dist-test-slave-2w3w"
server_key: "9a10ba676e88700eeeecba0cb6910c4e"
server_key_iv: "91bcffd0eb0d924e1c1f75d42f058f18"
server_key_version: "encryptionkey@0"
I20260811 08:03:47.543388 20070 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260811 08:03:47.544531 20084 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:47.544921 20070 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:03:47.545102 20070 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/minicluster-data/ts-0/wal
uuid: "d6aa4a0f96c341fa828d23136139fa7e"
format_stamp: "Formatted at 2026-08-11 08:03:47 on dist-test-slave-2w3w"
server_key: "9a10ba676e88700eeeecba0cb6910c4e"
server_key_iv: "91bcffd0eb0d924e1c1f75d42f058f18"
server_key_version: "encryptionkey@0"
I20260811 08:03:47.545214 20070 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:03:47.553627 20070 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:03:47.556595 20070 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:03:47.556792 20070 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:03:47.557087 20070 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:03:47.557441 20070 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:03:47.557499 20070 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:47.557544 20070 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:03:47.557577 20070 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:47.563971 20070 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.193:46127
I20260811 08:03:47.564071 20211 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.193:46127 every 8 connection(s)
I20260811 08:03:47.564355 20070 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
I20260811 08:03:47.565644 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 20070
I20260811 08:03:47.565760 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/minicluster-data/ts-0/wal/instance
I20260811 08:03:47.565953 15507 external_mini_cluster.cc:1428] Setting key b03a904d44a25a24c4c690269cbb2664
Aug 11 08:03:47 dist-test-slave-2w3w krb5kdc[19952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435427, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.193@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.15.36.194@KRBTEST.COM; defaulting to no policy
I20260811 08:03:47.576306 20045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:47.565208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:53743 (local address 127.15.36.254:36257)
0811 08:03:47.565276 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:47.565278 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:47.565533 (+ 255us) server_negotiation.cc:407] Connection header received
0811 08:03:47.566203 (+ 670us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:47.566204 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:47.566238 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:47.566320 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:47.567612 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:47.568161 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:47.569526 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:47.569851 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:47.569927 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:47.572622 (+ 2695us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:47.572624 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:47.572625 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:47.572635 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:47.574566 (+ 1931us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:47.575186 (+ 620us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:47.575188 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:47.575188 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:47.575264 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:47.575566 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:47.575567 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:47.575567 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:47.575749 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:47.575822 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:47.576145 (+ 323us) server_negotiation.cc:299] Negotiation successful
0811 08:03:47.576238 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 08:03:47.576435 20214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:47.565142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:36257 (local address 127.15.36.193:53743)
0811 08:03:47.565364 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:47.565410 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:47.566071 (+ 661us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:47.566413 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:47.566417 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:47.566867 (+ 450us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:03:47.567437 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:47.567444 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:47.568273 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:47.568275 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:47.569427 (+ 1152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:47.569431 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:47.569964 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:47.569965 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:47.570165 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:47.570801 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:03:47.570811 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:03:47.572485 (+ 1674us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:03:47.574688 (+ 2203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:47.574701 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:47.574711 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:47.575101 (+ 390us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:47.575343 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:47.575343 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:47.575344 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:47.575482 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:47.575809 (+ 327us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:03:47.575814 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:03:47.575967 (+ 153us) client_negotiation.cc:769] Sending connection context
0811 08:03:47.576059 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 08:03:47.576201 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":86,"threads_started":1}
I20260811 08:03:47.577199 20212 heartbeater.cc:347] Connected to a master server at 127.15.36.254:36257
I20260811 08:03:47.577337 20212 heartbeater.cc:464] Registering TS with master...
I20260811 08:03:47.577544 20212 heartbeater.cc:511] Master 127.15.36.254:36257 requested a full tablet report, sending...
I20260811 08:03:47.578202 20001 ts_manager.cc:194] Registered new tserver with Master: d6aa4a0f96c341fa828d23136139fa7e (127.15.36.193:46127)
I20260811 08:03:47.578907 20001 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.36.193@KRBTEST.COM'} at 127.15.36.193:53743
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab.
Entry for principal kudu/127.15.36.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab.
I20260811 08:03:47.600127 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.194:0
--local_ip_for_outbound_sockets=127.15.36.194
--webserver_interface=127.15.36.194
--webserver_port=0
--tserver_master_addrs=127.15.36.254:36257
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab
--principal=kudu/127.15.36.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:43737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:03:47.693068 20217 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:03:47.693596 20217 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:03:47.693696 20217 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:03:47.695218 20217 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:03:47.695288 20217 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:03:47.695322 20217 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.194
I20260811 08:03:47.697844 20217 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:43737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab
--principal=kudu/127.15.36.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.36.194
--webserver_port=0
--tserver_master_addrs=127.15.36.254:36257
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20217
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.194
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:03:47.698123 20217 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:03:47.698329 20217 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:03:47.704360 20222 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:47.704233 20223 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:47.704409 20225 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:03:47.705578 20217 server_base.cc:1034] running on GCE node
I20260811 08:03:47.705910 20217 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:03:47.706257 20217 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:03:47.707473 20217 hybrid_clock.cc:648] HybridClock initialized: now 1786435427707414 us; error 93 us; skew 500 ppm
Aug 11 08:03:47 dist-test-slave-2w3w krb5kdc[19952](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435427, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:03:47.710644 20217 init.cc:377] Logged in from keytab as kudu/127.15.36.194@KRBTEST.COM (short username kudu)
I20260811 08:03:47.711174 20217 fs_manager.cc:359] Metadata directory not provided
I20260811 08:03:47.711257 20217 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:03:47.711429 20217 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:03:47.712575 20217 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/minicluster-data/ts-1/data/instance:
uuid: "3d4cffb53b8e439fb681064017e38123"
format_stamp: "Formatted at 2026-08-11 08:03:47 on dist-test-slave-2w3w"
server_key: "f2384ffcfc5490ced9c98a57ff893678"
server_key_iv: "01fd3d81630833f7edf35f51cdee8e06"
server_key_version: "encryptionkey@0"
I20260811 08:03:47.712970 20217 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/minicluster-data/ts-1/wal/instance:
uuid: "3d4cffb53b8e439fb681064017e38123"
format_stamp: "Formatted at 2026-08-11 08:03:47 on dist-test-slave-2w3w"
server_key: "f2384ffcfc5490ced9c98a57ff893678"
server_key_iv: "01fd3d81630833f7edf35f51cdee8e06"
server_key_version: "encryptionkey@0"
I20260811 08:03:47.714403 20217 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 08:03:47.715396 20231 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:47.715618 20217 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:03:47.715736 20217 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/minicluster-data/ts-1/wal
uuid: "3d4cffb53b8e439fb681064017e38123"
format_stamp: "Formatted at 2026-08-11 08:03:47 on dist-test-slave-2w3w"
server_key: "f2384ffcfc5490ced9c98a57ff893678"
server_key_iv: "01fd3d81630833f7edf35f51cdee8e06"
server_key_version: "encryptionkey@0"
I20260811 08:03:47.715837 20217 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:03:47.733256 20217 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:03:47.736825 20217 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:03:47.737099 20217 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:03:47.737402 20217 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:03:47.737800 20217 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:03:47.737872 20217 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:47.737910 20217 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:03:47.737967 20217 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:47.745813 20217 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.194:43899
I20260811 08:03:47.745988 20354 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.194:43899 every 8 connection(s)
I20260811 08:03:47.746246 20217 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
I20260811 08:03:47.746863 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 20217
I20260811 08:03:47.746994 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/minicluster-data/ts-1/wal/instance
I20260811 08:03:47.747218 15507 external_mini_cluster.cc:1428] Setting key d81265d6d67ebae4f3e3a07dd5a31c52
Aug 11 08:03:47 dist-test-slave-2w3w krb5kdc[19952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435427, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.194@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.15.36.195@KRBTEST.COM; defaulting to no policy
I20260811 08:03:47.758677 20045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:47.747112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:52661 (local address 127.15.36.254:36257)
0811 08:03:47.747171 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:47.747173 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:47.747496 (+ 323us) server_negotiation.cc:407] Connection header received
0811 08:03:47.748125 (+ 629us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:47.748127 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:47.748141 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:47.748218 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:47.749307 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:47.750039 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:47.751277 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:47.751497 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:47.751582 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:47.754703 (+ 3121us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:47.754705 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:47.754705 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:47.754759 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:47.756417 (+ 1658us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:47.756937 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:47.756938 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:47.756939 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:47.757115 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:47.757710 (+ 595us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:47.757711 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:47.757712 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:47.757880 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:47.757969 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:47.758499 (+ 530us) server_negotiation.cc:299] Negotiation successful
0811 08:03:47.758602 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 08:03:47.759102 20357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:47.747120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:36257 (local address 127.15.36.194:52661)
0811 08:03:47.747368 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:47.747414 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:47.748045 (+ 631us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:47.748281 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:47.748284 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:47.748571 (+ 287us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:03:47.749195 (+ 624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:47.749201 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:47.750159 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:47.750160 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:47.751183 (+ 1023us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:47.751187 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:47.751590 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:47.751591 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:47.751741 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:47.752412 (+ 671us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:03:47.752423 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:03:47.754563 (+ 2140us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:03:47.756552 (+ 1989us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:47.756564 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:47.756568 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:47.756836 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:47.757352 (+ 516us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:47.757354 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:47.757354 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:47.757606 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:47.758017 (+ 411us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:03:47.758027 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:03:47.758192 (+ 165us) client_negotiation.cc:769] Sending connection context
0811 08:03:47.758305 (+ 113us) client_negotiation.cc:240] Negotiation successful
0811 08:03:47.758753 (+ 448us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":113,"threads_started":1}
I20260811 08:03:47.759783 20355 heartbeater.cc:347] Connected to a master server at 127.15.36.254:36257
I20260811 08:03:47.759932 20355 heartbeater.cc:464] Registering TS with master...
I20260811 08:03:47.760139 20355 heartbeater.cc:511] Master 127.15.36.254:36257 requested a full tablet report, sending...
I20260811 08:03:47.760535 20001 ts_manager.cc:194] Registered new tserver with Master: 3d4cffb53b8e439fb681064017e38123 (127.15.36.194:43899)
I20260811 08:03:47.760902 20001 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.36.194@KRBTEST.COM'} at 127.15.36.194:52661
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab.
Entry for principal kudu/127.15.36.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab.
I20260811 08:03:47.783883 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.195:0
--local_ip_for_outbound_sockets=127.15.36.195
--webserver_interface=127.15.36.195
--webserver_port=0
--tserver_master_addrs=127.15.36.254:36257
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab
--principal=kudu/127.15.36.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:43737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:03:47.879236 20360 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:03:47.879485 20360 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:03:47.879515 20360 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:03:47.880924 20360 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:03:47.880986 20360 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:03:47.881018 20360 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.195
I20260811 08:03:47.882721 20360 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:43737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab
--principal=kudu/127.15.36.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.36.195
--webserver_port=0
--tserver_master_addrs=127.15.36.254:36257
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20360
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.195
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:03:47.883036 20360 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:03:47.883348 20360 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:03:47.889107 20366 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:47.889130 20365 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:47.889123 20368 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:03:47.889443 20360 server_base.cc:1034] running on GCE node
I20260811 08:03:47.889683 20360 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:03:47.889999 20360 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:03:47.891139 20360 hybrid_clock.cc:648] HybridClock initialized: now 1786435427891116 us; error 46 us; skew 500 ppm
Aug 11 08:03:47 dist-test-slave-2w3w krb5kdc[19952](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435427, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:03:47.893910 20360 init.cc:377] Logged in from keytab as kudu/127.15.36.195@KRBTEST.COM (short username kudu)
I20260811 08:03:47.894325 20360 fs_manager.cc:359] Metadata directory not provided
I20260811 08:03:47.894412 20360 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:03:47.894598 20360 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:03:47.895906 20360 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/minicluster-data/ts-2/data/instance:
uuid: "df3eab89c1544240ae0bf8704278a132"
format_stamp: "Formatted at 2026-08-11 08:03:47 on dist-test-slave-2w3w"
server_key: "9135b7304746c71b43d37f418a4212bf"
server_key_iv: "5a7a96bcbe7791dd2c284783abb689da"
server_key_version: "encryptionkey@0"
I20260811 08:03:47.896325 20360 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/minicluster-data/ts-2/wal/instance:
uuid: "df3eab89c1544240ae0bf8704278a132"
format_stamp: "Formatted at 2026-08-11 08:03:47 on dist-test-slave-2w3w"
server_key: "9135b7304746c71b43d37f418a4212bf"
server_key_iv: "5a7a96bcbe7791dd2c284783abb689da"
server_key_version: "encryptionkey@0"
I20260811 08:03:47.898241 20360 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20260811 08:03:47.899394 20374 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:47.899633 20360 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260811 08:03:47.899763 20360 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/minicluster-data/ts-2/wal
uuid: "df3eab89c1544240ae0bf8704278a132"
format_stamp: "Formatted at 2026-08-11 08:03:47 on dist-test-slave-2w3w"
server_key: "9135b7304746c71b43d37f418a4212bf"
server_key_iv: "5a7a96bcbe7791dd2c284783abb689da"
server_key_version: "encryptionkey@0"
I20260811 08:03:47.899863 20360 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:03:47.914603 20360 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:03:47.917639 20360 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:03:47.917850 20360 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:03:47.918143 20360 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:03:47.918542 20360 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:03:47.918605 20360 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:47.918671 20360 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:03:47.918713 20360 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:47.925863 20360 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.195:36229
I20260811 08:03:47.925912 20499 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.195:36229 every 8 connection(s)
I20260811 08:03:47.926236 20360 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
I20260811 08:03:47.931246 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 20360
I20260811 08:03:47.931365 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/minicluster-data/ts-2/wal/instance
I20260811 08:03:47.931602 15507 external_mini_cluster.cc:1428] Setting key bb1f9d1a6d6ced3169f9556ba0683895
Aug 11 08:03:47 dist-test-slave-2w3w krb5kdc[19952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435427, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.195@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:03:47.938805 20045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:47.927315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:33451 (local address 127.15.36.254:36257)
0811 08:03:47.927404 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:47.927406 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:47.927551 (+ 145us) server_negotiation.cc:407] Connection header received
0811 08:03:47.928157 (+ 606us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:47.928158 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:47.928171 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:47.928236 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:47.929385 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:47.929960 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:47.931528 (+ 1568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:47.931845 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:47.931924 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:47.935405 (+ 3481us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:47.935407 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:47.935407 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:47.935418 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:47.937077 (+ 1659us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:47.937585 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:47.937586 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:47.937586 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:47.937652 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:47.937932 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:47.937933 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:47.937933 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:47.938155 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:47.938273 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:47.938608 (+ 335us) server_negotiation.cc:299] Negotiation successful
0811 08:03:47.938704 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 08:03:47.939062 20503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:47.927220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:36257 (local address 127.15.36.195:33451)
0811 08:03:47.927406 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:47.927454 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:47.928024 (+ 570us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:47.928306 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:47.928310 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:47.928649 (+ 339us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:03:47.929262 (+ 613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:47.929268 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:47.930118 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:47.930119 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:47.931209 (+ 1090us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:47.931213 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:47.931966 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:47.931967 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:47.932169 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:47.933237 (+ 1068us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:03:47.933296 (+ 59us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:03:47.935248 (+ 1952us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:03:47.937193 (+ 1945us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:47.937207 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:47.937210 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:47.937498 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:47.937726 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:47.937727 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:47.937727 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:47.937860 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:47.938261 (+ 401us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:03:47.938269 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:03:47.938446 (+ 177us) client_negotiation.cc:769] Sending connection context
0811 08:03:47.938568 (+ 122us) client_negotiation.cc:240] Negotiation successful
0811 08:03:47.938759 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":77,"threads_started":1}
I20260811 08:03:47.939661 20501 heartbeater.cc:347] Connected to a master server at 127.15.36.254:36257
I20260811 08:03:47.939754 20501 heartbeater.cc:464] Registering TS with master...
I20260811 08:03:47.939955 20501 heartbeater.cc:511] Master 127.15.36.254:36257 requested a full tablet report, sending...
I20260811 08:03:47.940382 20001 ts_manager.cc:194] Registered new tserver with Master: df3eab89c1544240ae0bf8704278a132 (127.15.36.195:36229)
I20260811 08:03:47.940755 20001 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.36.195@KRBTEST.COM'} at 127.15.36.195:33451
I20260811 08:03:47.944633 15507 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 08:03:47.953501 20045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:47.946111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38814 (local address 127.15.36.254:36257)
0811 08:03:47.946196 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:47.946200 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:47.946263 (+ 63us) server_negotiation.cc:407] Connection header received
0811 08:03:47.946305 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:47.946306 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:47.946316 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:47.946379 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:47.947037 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:47.947547 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:47.948305 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:47.948568 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:47.948626 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:47.950120 (+ 1494us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:47.950122 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:47.950122 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:47.950130 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:47.951764 (+ 1634us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:47.952246 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:47.952247 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:47.952248 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:47.952312 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:47.952751 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:47.952752 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:47.952752 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:47.952989 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:47.953084 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:47.953334 (+ 250us) server_negotiation.cc:299] Negotiation successful
0811 08:03:47.953428 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 08:03:47.956350 20001 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38814:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:03:47.958004 20001 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:03:47.966673 20518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:47.962634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60034 (local address 127.15.36.195:36229)
0811 08:03:47.962896 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:47.962900 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:47.962911 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:03:47.962948 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:47.962951 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:47.962993 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:47.963214 (+ 221us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:03:47.963287 (+ 73us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:47.963972 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:47.965501 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:47.966302 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:47.966390 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:47.966452 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:47.966524 (+ 72us) server_negotiation.cc:299] Negotiation successful
0811 08:03:47.966573 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":220,"thread_start_us":92,"threads_started":1}
I20260811 08:03:47.966607 20515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:47.961822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.193:46127 (local address 127.0.0.1:42918)
0811 08:03:47.962381 (+ 559us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:47.962433 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:47.962516 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:47.963018 (+ 502us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:47.963020 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:47.963023 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:03:47.963100 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:47.963104 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:47.964521 (+ 1417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:47.964522 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:47.965466 (+ 944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:47.965470 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:47.966238 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:47.966239 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:47.966325 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:47.966354 (+ 29us) client_negotiation.cc:769] Sending connection context
0811 08:03:47.966428 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 08:03:47.966500 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":528,"mutex_wait_us":2,"thread_start_us":101,"threads_started":1}
I20260811 08:03:47.966789 20512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:47.961871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.194:43899 (local address 127.0.0.1:51000)
0811 08:03:47.962381 (+ 510us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:47.962433 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:47.962508 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:47.962999 (+ 491us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:47.963003 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:47.963005 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:03:47.963104 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:47.963106 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:47.964492 (+ 1386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:47.964493 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:47.965576 (+ 1083us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:47.965579 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:47.966468 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:47.966469 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:47.966540 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:47.966544 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:03:47.966576 (+ 32us) client_negotiation.cc:240] Negotiation successful
0811 08:03:47.966617 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":479,"mutex_wait_us":5,"thread_start_us":427,"threads_started":1}
I20260811 08:03:47.966607 20516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:47.962089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.195:36229 (local address 127.0.0.1:60034)
0811 08:03:47.962619 (+ 530us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:47.962629 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:47.962666 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:47.963096 (+ 430us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:47.963097 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:47.963098 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:03:47.963139 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:47.963141 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:47.964086 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:47.964088 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:47.965393 (+ 1305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:47.965397 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:47.966385 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:47.966385 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:47.966447 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:47.966450 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:03:47.966509 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 08:03:47.966546 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":513,"thread_start_us":226,"threads_started":1}
I20260811 08:03:47.966933 20517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:47.962339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51000 (local address 127.15.36.194:43899)
0811 08:03:47.962680 (+ 341us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:47.962684 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:47.962695 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:03:47.962737 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:47.962739 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:47.962755 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:47.962848 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:03:47.963194 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:47.964374 (+ 1180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:47.965666 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:47.966369 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:47.966663 (+ 294us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:47.966729 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:47.966757 (+ 28us) server_negotiation.cc:299] Negotiation successful
0811 08:03:47.966811 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":303,"thread_start_us":115,"threads_started":1}
I20260811 08:03:47.967537 20514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:47.961940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42918 (local address 127.15.36.193:46127)
0811 08:03:47.962450 (+ 510us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:47.962455 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:47.962787 (+ 332us) server_negotiation.cc:407] Connection header received
0811 08:03:47.962842 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:47.962844 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:47.962862 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:47.963209 (+ 347us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:03:47.963299 (+ 90us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:47.964379 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:47.965570 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:47.966138 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:47.966238 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:47.966308 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:47.967392 (+ 1084us) server_negotiation.cc:299] Negotiation successful
0811 08:03:47.967448 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":465,"thread_start_us":96,"threads_started":1}
I20260811 08:03:47.967777 20283 tablet_service.cc:1467] Processing CreateTablet for tablet 0c4b34f88679453cb7a85184c86f7467 (DEFAULT_TABLE table=test-table [id=0149d607170f48e7badf6b3c7e3318ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:03:47.967782 20428 tablet_service.cc:1467] Processing CreateTablet for tablet 0c4b34f88679453cb7a85184c86f7467 (DEFAULT_TABLE table=test-table [id=0149d607170f48e7badf6b3c7e3318ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:03:47.968189 20428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0c4b34f88679453cb7a85184c86f7467. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:03:47.968192 20283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0c4b34f88679453cb7a85184c86f7467. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:03:47.968237 20137 tablet_service.cc:1467] Processing CreateTablet for tablet 0c4b34f88679453cb7a85184c86f7467 (DEFAULT_TABLE table=test-table [id=0149d607170f48e7badf6b3c7e3318ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:03:47.968556 20137 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0c4b34f88679453cb7a85184c86f7467. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:03:47.971357 20519 tablet_bootstrap.cc:492] T 0c4b34f88679453cb7a85184c86f7467 P df3eab89c1544240ae0bf8704278a132: Bootstrap starting.
I20260811 08:03:47.972008 20521 tablet_bootstrap.cc:492] T 0c4b34f88679453cb7a85184c86f7467 P 3d4cffb53b8e439fb681064017e38123: Bootstrap starting.
I20260811 08:03:47.972860 20519 tablet_bootstrap.cc:654] T 0c4b34f88679453cb7a85184c86f7467 P df3eab89c1544240ae0bf8704278a132: Neither blocks nor log segments found. Creating new log.
I20260811 08:03:47.973703 20521 tablet_bootstrap.cc:654] T 0c4b34f88679453cb7a85184c86f7467 P 3d4cffb53b8e439fb681064017e38123: Neither blocks nor log segments found. Creating new log.
I20260811 08:03:47.974424 20519 log.cc:824] T 0c4b34f88679453cb7a85184c86f7467 P df3eab89c1544240ae0bf8704278a132: Log is configured to *not* fsync() on all Append() calls
I20260811 08:03:47.975095 20521 log.cc:824] T 0c4b34f88679453cb7a85184c86f7467 P 3d4cffb53b8e439fb681064017e38123: Log is configured to *not* fsync() on all Append() calls
I20260811 08:03:47.975261 20522 tablet_bootstrap.cc:492] T 0c4b34f88679453cb7a85184c86f7467 P d6aa4a0f96c341fa828d23136139fa7e: Bootstrap starting.
I20260811 08:03:47.976065 20522 tablet_bootstrap.cc:654] T 0c4b34f88679453cb7a85184c86f7467 P d6aa4a0f96c341fa828d23136139fa7e: Neither blocks nor log segments found. Creating new log.
I20260811 08:03:47.976419 20519 tablet_bootstrap.cc:492] T 0c4b34f88679453cb7a85184c86f7467 P df3eab89c1544240ae0bf8704278a132: No bootstrap required, opened a new log
I20260811 08:03:47.976449 20521 tablet_bootstrap.cc:492] T 0c4b34f88679453cb7a85184c86f7467 P 3d4cffb53b8e439fb681064017e38123: No bootstrap required, opened a new log
I20260811 08:03:47.976521 20519 ts_tablet_manager.cc:1397] T 0c4b34f88679453cb7a85184c86f7467 P df3eab89c1544240ae0bf8704278a132: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260811 08:03:47.976531 20521 ts_tablet_manager.cc:1397] T 0c4b34f88679453cb7a85184c86f7467 P 3d4cffb53b8e439fb681064017e38123: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.003s
I20260811 08:03:47.977099 20522 log.cc:824] T 0c4b34f88679453cb7a85184c86f7467 P d6aa4a0f96c341fa828d23136139fa7e: Log is configured to *not* fsync() on all Append() calls
I20260811 08:03:47.978441 20522 tablet_bootstrap.cc:492] T 0c4b34f88679453cb7a85184c86f7467 P d6aa4a0f96c341fa828d23136139fa7e: No bootstrap required, opened a new log
I20260811 08:03:47.978518 20522 ts_tablet_manager.cc:1397] T 0c4b34f88679453cb7a85184c86f7467 P d6aa4a0f96c341fa828d23136139fa7e: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 08:03:47.978830 20519 raft_consensus.cc:348] T 0c4b34f88679453cb7a85184c86f7467 P df3eab89c1544240ae0bf8704278a132 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6aa4a0f96c341fa828d23136139fa7e" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 46127 } } peers { permanent_uuid: "df3eab89c1544240ae0bf8704278a132" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 36229 } } peers { permanent_uuid: "3d4cffb53b8e439fb681064017e38123" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 43899 } }
I20260811 08:03:47.978823 20521 raft_consensus.cc:348] T 0c4b34f88679453cb7a85184c86f7467 P 3d4cffb53b8e439fb681064017e38123 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6aa4a0f96c341fa828d23136139fa7e" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 46127 } } peers { permanent_uuid: "df3eab89c1544240ae0bf8704278a132" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 36229 } } peers { permanent_uuid: "3d4cffb53b8e439fb681064017e38123" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 43899 } }
I20260811 08:03:47.979051 20519 raft_consensus.cc:374] T 0c4b34f88679453cb7a85184c86f7467 P df3eab89c1544240ae0bf8704278a132 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:03:47.979058 20521 raft_consensus.cc:374] T 0c4b34f88679453cb7a85184c86f7467 P 3d4cffb53b8e439fb681064017e38123 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:03:47.979082 20519 raft_consensus.cc:729] T 0c4b34f88679453cb7a85184c86f7467 P df3eab89c1544240ae0bf8704278a132 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df3eab89c1544240ae0bf8704278a132, State: Initialized, Role: FOLLOWER
I20260811 08:03:47.979096 20521 raft_consensus.cc:729] T 0c4b34f88679453cb7a85184c86f7467 P 3d4cffb53b8e439fb681064017e38123 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d4cffb53b8e439fb681064017e38123, State: Initialized, Role: FOLLOWER
I20260811 08:03:47.979244 20521 consensus_queue.cc:260] T 0c4b34f88679453cb7a85184c86f7467 P 3d4cffb53b8e439fb681064017e38123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6aa4a0f96c341fa828d23136139fa7e" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 46127 } } peers { permanent_uuid: "df3eab89c1544240ae0bf8704278a132" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 36229 } } peers { permanent_uuid: "3d4cffb53b8e439fb681064017e38123" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 43899 } }
I20260811 08:03:47.979214 20519 consensus_queue.cc:260] T 0c4b34f88679453cb7a85184c86f7467 P df3eab89c1544240ae0bf8704278a132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6aa4a0f96c341fa828d23136139fa7e" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 46127 } } peers { permanent_uuid: "df3eab89c1544240ae0bf8704278a132" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 36229 } } peers { permanent_uuid: "3d4cffb53b8e439fb681064017e38123" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 43899 } }
I20260811 08:03:47.979595 20521 ts_tablet_manager.cc:1428] T 0c4b34f88679453cb7a85184c86f7467 P 3d4cffb53b8e439fb681064017e38123: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 08:03:47.979734 20355 heartbeater.cc:503] Master 127.15.36.254:36257 was elected leader, sending a full tablet report...
I20260811 08:03:47.980424 20522 raft_consensus.cc:348] T 0c4b34f88679453cb7a85184c86f7467 P d6aa4a0f96c341fa828d23136139fa7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6aa4a0f96c341fa828d23136139fa7e" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 46127 } } peers { permanent_uuid: "df3eab89c1544240ae0bf8704278a132" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 36229 } } peers { permanent_uuid: "3d4cffb53b8e439fb681064017e38123" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 43899 } }
I20260811 08:03:47.980558 20522 raft_consensus.cc:374] T 0c4b34f88679453cb7a85184c86f7467 P d6aa4a0f96c341fa828d23136139fa7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:03:47.980631 20522 raft_consensus.cc:729] T 0c4b34f88679453cb7a85184c86f7467 P d6aa4a0f96c341fa828d23136139fa7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6aa4a0f96c341fa828d23136139fa7e, State: Initialized, Role: FOLLOWER
I20260811 08:03:47.980840 20522 consensus_queue.cc:260] T 0c4b34f88679453cb7a85184c86f7467 P d6aa4a0f96c341fa828d23136139fa7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6aa4a0f96c341fa828d23136139fa7e" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 46127 } } peers { permanent_uuid: "df3eab89c1544240ae0bf8704278a132" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 36229 } } peers { permanent_uuid: "3d4cffb53b8e439fb681064017e38123" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 43899 } }
I20260811 08:03:47.980918 20519 ts_tablet_manager.cc:1428] T 0c4b34f88679453cb7a85184c86f7467 P df3eab89c1544240ae0bf8704278a132: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260811 08:03:47.981173 20501 heartbeater.cc:503] Master 127.15.36.254:36257 was elected leader, sending a full tablet report...
I20260811 08:03:47.981238 20522 ts_tablet_manager.cc:1428] T 0c4b34f88679453cb7a85184c86f7467 P d6aa4a0f96c341fa828d23136139fa7e: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 08:03:47.981389 20212 heartbeater.cc:503] Master 127.15.36.254:36257 was elected leader, sending a full tablet report...
W20260811 08:03:47.997255 20356 tablet.cc:2369] T 0c4b34f88679453cb7a85184c86f7467 P 3d4cffb53b8e439fb681064017e38123: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 08:03:48.065325 20213 tablet.cc:2369] T 0c4b34f88679453cb7a85184c86f7467 P d6aa4a0f96c341fa828d23136139fa7e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:03:48.132727 20529 raft_consensus.cc:482] T 0c4b34f88679453cb7a85184c86f7467 P d6aa4a0f96c341fa828d23136139fa7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:03:48.132977 20529 raft_consensus.cc:504] T 0c4b34f88679453cb7a85184c86f7467 P d6aa4a0f96c341fa828d23136139fa7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6aa4a0f96c341fa828d23136139fa7e" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 46127 } } peers { permanent_uuid: "df3eab89c1544240ae0bf8704278a132" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 36229 } } peers { permanent_uuid: "3d4cffb53b8e439fb681064017e38123" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 43899 } }
I20260811 08:03:48.134191 20529 leader_election.cc:288] T 0c4b34f88679453cb7a85184c86f7467 P d6aa4a0f96c341fa828d23136139fa7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df3eab89c1544240ae0bf8704278a132 (127.15.36.195:36229), 3d4cffb53b8e439fb681064017e38123 (127.15.36.194:43899)
I20260811 08:03:48.140609 20517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:48.135015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:44627 (local address 127.15.36.194:43899)
0811 08:03:48.135365 (+ 350us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:48.135367 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:48.135382 (+ 15us) server_negotiation.cc:407] Connection header received
0811 08:03:48.135416 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:48.135417 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:48.135428 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:48.135506 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:03:48.136016 (+ 510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:48.136968 (+ 952us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:48.138932 (+ 1964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:48.139804 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:48.139923 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:48.139936 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:48.140466 (+ 530us) server_negotiation.cc:299] Negotiation successful
0811 08:03:48.140520 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":316}
I20260811 08:03:48.140609 20518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:48.135014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:42039 (local address 127.15.36.195:36229)
0811 08:03:48.135372 (+ 358us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:48.135375 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:48.135383 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:03:48.135417 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:48.135417 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:48.135428 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:48.135505 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:03:48.136043 (+ 538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:48.136919 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:48.138932 (+ 2013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:48.139804 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:48.139944 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:48.139953 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:48.140466 (+ 513us) server_negotiation.cc:299] Negotiation successful
0811 08:03:48.140520 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":329}
I20260811 08:03:48.140800 20532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:48.134536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.195:36229 (local address 127.15.36.193:42039)
0811 08:03:48.134733 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:48.134753 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:48.134794 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:48.135611 (+ 817us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:48.135613 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:48.135615 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:03:48.135778 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:48.135781 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:48.137216 (+ 1435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:48.137218 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:48.138746 (+ 1528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:48.138751 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:48.140137 (+ 1386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:48.140138 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:48.140291 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:48.140303 (+ 12us) client_negotiation.cc:769] Sending connection context
0811 08:03:48.140436 (+ 133us) client_negotiation.cc:240] Negotiation successful
0811 08:03:48.140669 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"mutex_wait_us":171,"spinlock_wait_cycles":16256,"thread_start_us":103,"threads_started":1}
I20260811 08:03:48.140844 20530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:48.134536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.194:43899 (local address 127.15.36.193:44627)
0811 08:03:48.134689 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:48.134703 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:48.134790 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:48.135727 (+ 937us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:48.135728 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:48.135731 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:03:48.135813 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:48.135814 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:48.137225 (+ 1411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:48.137226 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:48.138746 (+ 1520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:48.138751 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:48.140130 (+ 1379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:48.140133 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:48.140291 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:48.140301 (+ 10us) client_negotiation.cc:769] Sending connection context
0811 08:03:48.140425 (+ 124us) client_negotiation.cc:240] Negotiation successful
0811 08:03:48.140546 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"mutex_wait_us":78,"thread_start_us":75,"threads_started":1}
I20260811 08:03:48.141415 20449 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c4b34f88679453cb7a85184c86f7467" candidate_uuid: "d6aa4a0f96c341fa828d23136139fa7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df3eab89c1544240ae0bf8704278a132" is_pre_election: true
I20260811 08:03:48.141466 20305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c4b34f88679453cb7a85184c86f7467" candidate_uuid: "d6aa4a0f96c341fa828d23136139fa7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d4cffb53b8e439fb681064017e38123" is_pre_election: true
I20260811 08:03:48.141634 20305 raft_consensus.cc:2454] T 0c4b34f88679453cb7a85184c86f7467 P 3d4cffb53b8e439fb681064017e38123 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6aa4a0f96c341fa828d23136139fa7e in term 0.
I20260811 08:03:48.141635 20449 raft_consensus.cc:2454] T 0c4b34f88679453cb7a85184c86f7467 P df3eab89c1544240ae0bf8704278a132 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6aa4a0f96c341fa828d23136139fa7e in term 0.
I20260811 08:03:48.141960 20088 leader_election.cc:302] T 0c4b34f88679453cb7a85184c86f7467 P d6aa4a0f96c341fa828d23136139fa7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d4cffb53b8e439fb681064017e38123, d6aa4a0f96c341fa828d23136139fa7e; no voters:
I20260811 08:03:48.142125 20529 raft_consensus.cc:2781] T 0c4b34f88679453cb7a85184c86f7467 P d6aa4a0f96c341fa828d23136139fa7e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:03:48.142187 20529 raft_consensus.cc:482] T 0c4b34f88679453cb7a85184c86f7467 P d6aa4a0f96c341fa828d23136139fa7e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:03:48.142217 20529 raft_consensus.cc:3037] T 0c4b34f88679453cb7a85184c86f7467 P d6aa4a0f96c341fa828d23136139fa7e [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:03:48.143054 20529 raft_consensus.cc:504] T 0c4b34f88679453cb7a85184c86f7467 P d6aa4a0f96c341fa828d23136139fa7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6aa4a0f96c341fa828d23136139fa7e" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 46127 } } peers { permanent_uuid: "df3eab89c1544240ae0bf8704278a132" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 36229 } } peers { permanent_uuid: "3d4cffb53b8e439fb681064017e38123" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 43899 } }
I20260811 08:03:48.143230 20529 leader_election.cc:288] T 0c4b34f88679453cb7a85184c86f7467 P d6aa4a0f96c341fa828d23136139fa7e [CANDIDATE]: Term 1 election: Requested vote from peers df3eab89c1544240ae0bf8704278a132 (127.15.36.195:36229), 3d4cffb53b8e439fb681064017e38123 (127.15.36.194:43899)
I20260811 08:03:48.143414 20449 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c4b34f88679453cb7a85184c86f7467" candidate_uuid: "d6aa4a0f96c341fa828d23136139fa7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df3eab89c1544240ae0bf8704278a132"
I20260811 08:03:48.143455 20305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c4b34f88679453cb7a85184c86f7467" candidate_uuid: "d6aa4a0f96c341fa828d23136139fa7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d4cffb53b8e439fb681064017e38123"
I20260811 08:03:48.143563 20449 raft_consensus.cc:3037] T 0c4b34f88679453cb7a85184c86f7467 P df3eab89c1544240ae0bf8704278a132 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:03:48.143558 20305 raft_consensus.cc:3037] T 0c4b34f88679453cb7a85184c86f7467 P 3d4cffb53b8e439fb681064017e38123 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:03:48.144356 20449 raft_consensus.cc:2454] T 0c4b34f88679453cb7a85184c86f7467 P df3eab89c1544240ae0bf8704278a132 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6aa4a0f96c341fa828d23136139fa7e in term 1.
I20260811 08:03:48.144366 20305 raft_consensus.cc:2454] T 0c4b34f88679453cb7a85184c86f7467 P 3d4cffb53b8e439fb681064017e38123 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6aa4a0f96c341fa828d23136139fa7e in term 1.
I20260811 08:03:48.144579 20088 leader_election.cc:302] T 0c4b34f88679453cb7a85184c86f7467 P d6aa4a0f96c341fa828d23136139fa7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d4cffb53b8e439fb681064017e38123, d6aa4a0f96c341fa828d23136139fa7e; no voters:
I20260811 08:03:48.144686 20529 raft_consensus.cc:2781] T 0c4b34f88679453cb7a85184c86f7467 P d6aa4a0f96c341fa828d23136139fa7e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:03:48.144877 20529 raft_consensus.cc:686] T 0c4b34f88679453cb7a85184c86f7467 P d6aa4a0f96c341fa828d23136139fa7e [term 1 LEADER]: Becoming Leader. State: Replica: d6aa4a0f96c341fa828d23136139fa7e, State: Running, Role: LEADER
I20260811 08:03:48.144966 20529 consensus_queue.cc:237] T 0c4b34f88679453cb7a85184c86f7467 P d6aa4a0f96c341fa828d23136139fa7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6aa4a0f96c341fa828d23136139fa7e" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 46127 } } peers { permanent_uuid: "df3eab89c1544240ae0bf8704278a132" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 36229 } } peers { permanent_uuid: "3d4cffb53b8e439fb681064017e38123" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 43899 } }
I20260811 08:03:48.146068 20000 catalog_manager.cc:5495] T 0c4b34f88679453cb7a85184c86f7467 P d6aa4a0f96c341fa828d23136139fa7e reported cstate change: term changed from 0 to 1, leader changed from <none> to d6aa4a0f96c341fa828d23136139fa7e (127.15.36.193). New cstate: current_term: 1 leader_uuid: "d6aa4a0f96c341fa828d23136139fa7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6aa4a0f96c341fa828d23136139fa7e" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 46127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df3eab89c1544240ae0bf8704278a132" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 36229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d4cffb53b8e439fb681064017e38123" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 43899 } health_report { overall_health: UNKNOWN } } }
I20260811 08:03:48.156530 20514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:48.152944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42934 (local address 127.15.36.193:46127)
0811 08:03:48.153192 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:48.153194 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:48.153205 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:03:48.153272 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:48.153273 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:48.153335 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:48.153435 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:03:48.153622 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:48.154174 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:48.155347 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:48.155693 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:48.155868 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:48.156115 (+ 247us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:03:48.156256 (+ 141us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:03:48.156368 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:48.156395 (+ 27us) server_negotiation.cc:299] Negotiation successful
0811 08:03:48.156423 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149}
I20260811 08:03:48.159179 20305 raft_consensus.cc:1261] T 0c4b34f88679453cb7a85184c86f7467 P 3d4cffb53b8e439fb681064017e38123 [term 1 FOLLOWER]: Refusing update from remote peer d6aa4a0f96c341fa828d23136139fa7e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:03:48.159291 20449 raft_consensus.cc:1261] T 0c4b34f88679453cb7a85184c86f7467 P df3eab89c1544240ae0bf8704278a132 [term 1 FOLLOWER]: Refusing update from remote peer d6aa4a0f96c341fa828d23136139fa7e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:03:48.159679 20533 consensus_queue.cc:1035] T 0c4b34f88679453cb7a85184c86f7467 P d6aa4a0f96c341fa828d23136139fa7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d4cffb53b8e439fb681064017e38123" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 43899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:03:48.159890 20529 consensus_queue.cc:1035] T 0c4b34f88679453cb7a85184c86f7467 P d6aa4a0f96c341fa828d23136139fa7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "df3eab89c1544240ae0bf8704278a132" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 36229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:03:48.163136 20536 mvcc.cc:205] Tried to move back new op lower bound from 7317239513734844416 to 7317239513682739200. Current Snapshot: MvccSnapshot[applied={T|T < 7317239513734844416}]
I20260811 08:03:48.163252 20538 mvcc.cc:205] Tried to move back new op lower bound from 7317239513734844416 to 7317239513682739200. Current Snapshot: MvccSnapshot[applied={T|T < 7317239513734844416}]
I20260811 08:03:48.166824 19999 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38814:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:03:48.167230 19999 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38814:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:03:48.168295 19999 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ed65d0366e34a6e8912f212c4c1dc0d: Sending DeleteTablet for 3 replicas of tablet 0c4b34f88679453cb7a85184c86f7467
I20260811 08:03:48.168730 20283 tablet_service.cc:1514] Processing DeleteTablet for tablet 0c4b34f88679453cb7a85184c86f7467 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:03:48 UTC) from {username='kudu', principal='kudu/127.15.36.254@KRBTEST.COM'} at 127.0.0.1:51000
I20260811 08:03:48.168852 20137 tablet_service.cc:1514] Processing DeleteTablet for tablet 0c4b34f88679453cb7a85184c86f7467 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:03:48 UTC) from {username='kudu', principal='kudu/127.15.36.254@KRBTEST.COM'} at 127.0.0.1:42918
I20260811 08:03:48.169011 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 20070
I20260811 08:03:48.169097 20428 tablet_service.cc:1514] Processing DeleteTablet for tablet 0c4b34f88679453cb7a85184c86f7467 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:03:48 UTC) from {username='kudu', principal='kudu/127.15.36.254@KRBTEST.COM'} at 127.0.0.1:60034
I20260811 08:03:48.172181 20549 tablet_replica.cc:330] T 0c4b34f88679453cb7a85184c86f7467 P df3eab89c1544240ae0bf8704278a132: stopping tablet replica
I20260811 08:03:48.172355 20549 raft_consensus.cc:2229] T 0c4b34f88679453cb7a85184c86f7467 P df3eab89c1544240ae0bf8704278a132 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:03:48.172500 20549 raft_consensus.cc:2258] T 0c4b34f88679453cb7a85184c86f7467 P df3eab89c1544240ae0bf8704278a132 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:03:48.172703 20547 tablet_replica.cc:330] T 0c4b34f88679453cb7a85184c86f7467 P 3d4cffb53b8e439fb681064017e38123: stopping tablet replica
I20260811 08:03:48.172837 20547 raft_consensus.cc:2229] T 0c4b34f88679453cb7a85184c86f7467 P 3d4cffb53b8e439fb681064017e38123 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:03:48.172948 20547 raft_consensus.cc:2258] T 0c4b34f88679453cb7a85184c86f7467 P 3d4cffb53b8e439fb681064017e38123 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:03:48.173832 20549 ts_tablet_manager.cc:1905] T 0c4b34f88679453cb7a85184c86f7467 P df3eab89c1544240ae0bf8704278a132: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:03:48.176048 20549 ts_tablet_manager.cc:1918] T 0c4b34f88679453cb7a85184c86f7467 P df3eab89c1544240ae0bf8704278a132: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:03:48.176137 20549 log.cc:1196] T 0c4b34f88679453cb7a85184c86f7467 P df3eab89c1544240ae0bf8704278a132: Deleting WAL directory at /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786435400844580-15507-0/minicluster-data/ts-2/wal/wals/0c4b34f88679453cb7a85184c86f7467
I20260811 08:03:48.176484 20549 ts_tablet_manager.cc:1939] T 0c4b34f88679453cb7a85184c86f7467 P df3eab89c1544240ae0bf8704278a132: Deleting consensus metadata
I20260811 08:03:48.177175 19986 catalog_manager.cc:4841] TS df3eab89c1544240ae0bf8704278a132 (127.15.36.195:36229): tablet 0c4b34f88679453cb7a85184c86f7467 (table test-table [id=0149d607170f48e7badf6b3c7e3318ce]) successfully deleted
W20260811 08:03:48.177897 19986 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.36.193:46127 (error 108)
I20260811 08:03:48.178465 20547 ts_tablet_manager.cc:1905] T 0c4b34f88679453cb7a85184c86f7467 P 3d4cffb53b8e439fb681064017e38123: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:03:48.178752 20512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:48.178565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.193:46127 (local address 127.0.0.1:42940)
0811 08:03:48.178650 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:48.178701 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.193:46127: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260811 08:03:48.178901 19986 catalog_manager.cc:4584] TS d6aa4a0f96c341fa828d23136139fa7e (127.15.36.193:46127): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0c4b34f88679453cb7a85184c86f7467: Network error: Client connection negotiation failed: client connection to 127.15.36.193:46127: connect: Connection refused (error 111)
I20260811 08:03:48.180234 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 20217
I20260811 08:03:48.192022 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 20360
I20260811 08:03:48.192076 20512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:48.191748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.194:43899 (local address 127.0.0.1:51008)
0811 08:03:48.191937 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:48.192010 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.194:43899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152}
I20260811 08:03:48.199182 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 19965
2026-08-11T08:03:48Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2315 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-11T08:03:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:03:48Z Disabled control of system clock
I20260811 08:03:48.234890 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435400844580-15507-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435400844580-15507-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435400844580-15507-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:37823
--webserver_interface=127.15.36.254
--webserver_port=0
--builtin_ntp_servers=127.15.36.212:44011
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.36.254:37823
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 08:03:48.332983 20554 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:03:48.333241 20554 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:03:48.333266 20554 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:03:48.334617 20554 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:03:48.334685 20554 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:03:48.334699 20554 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:03:48.334728 20554 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:03:48.334741 20554 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:03:48.336361 20554 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:44011
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435400844580-15507-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435400844580-15507-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.36.254:37823
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:37823
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.36.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20554
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435400844580-15507-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:03:48.336683 20554 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:03:48.337049 20554 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:03:48.342584 20563 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:48.342586 20561 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:48.342725 20560 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:03:48.343055 20554 server_base.cc:1034] running on GCE node
I20260811 08:03:48.343369 20554 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:03:48.343698 20554 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:03:48.344931 20554 hybrid_clock.cc:648] HybridClock initialized: now 1786435428344903 us; error 43 us; skew 500 ppm
I20260811 08:03:48.346467 20554 webserver.cc:460] Webserver started at http://127.15.36.254:41259/ using document root <none> and password file <none>
I20260811 08:03:48.346741 20554 fs_manager.cc:359] Metadata directory not provided
I20260811 08:03:48.346822 20554 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:03:48.347036 20554 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:03:48.348232 20554 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435400844580-15507-0/minicluster-data/master-0/data/instance:
uuid: "b3cd3784ef3b45c2a431990af31d2396"
format_stamp: "Formatted at 2026-08-11 08:03:48 on dist-test-slave-2w3w"
server_key: "7394ead48039119d890c3b7c25f5a12d"
server_key_iv: "801c278bdc06a2dd576daa15051b4c68"
server_key_version: "encryptionkey@0"
I20260811 08:03:48.348627 20554 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435400844580-15507-0/minicluster-data/master-0/wal/instance:
uuid: "b3cd3784ef3b45c2a431990af31d2396"
format_stamp: "Formatted at 2026-08-11 08:03:48 on dist-test-slave-2w3w"
server_key: "7394ead48039119d890c3b7c25f5a12d"
server_key_iv: "801c278bdc06a2dd576daa15051b4c68"
server_key_version: "encryptionkey@0"
I20260811 08:03:48.350176 20554 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 08:03:48.351255 20573 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:48.351531 20554 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:03:48.351647 20554 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435400844580-15507-0/minicluster-data/master-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435400844580-15507-0/minicluster-data/master-0/wal
uuid: "b3cd3784ef3b45c2a431990af31d2396"
format_stamp: "Formatted at 2026-08-11 08:03:48 on dist-test-slave-2w3w"
server_key: "7394ead48039119d890c3b7c25f5a12d"
server_key_iv: "801c278bdc06a2dd576daa15051b4c68"
server_key_version: "encryptionkey@0"
I20260811 08:03:48.351737 20554 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435400844580-15507-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435400844580-15507-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435400844580-15507-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:03:48.356465 20554 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:03:48.356812 20554 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:03:48.356992 20554 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:03:48.361822 20554 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.254:37823
I20260811 08:03:48.361912 20630 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.254:37823 every 8 connection(s)
I20260811 08:03:48.362299 20554 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
I20260811 08:03:48.363070 20631 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:03:48.365989 20631 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3cd3784ef3b45c2a431990af31d2396: Bootstrap starting.
I20260811 08:03:48.366601 20631 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b3cd3784ef3b45c2a431990af31d2396: Neither blocks nor log segments found. Creating new log.
I20260811 08:03:48.366871 20631 log.cc:824] T 00000000000000000000000000000000 P b3cd3784ef3b45c2a431990af31d2396: Log is configured to *not* fsync() on all Append() calls
I20260811 08:03:48.367761 20631 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3cd3784ef3b45c2a431990af31d2396: No bootstrap required, opened a new log
I20260811 08:03:48.370011 20631 raft_consensus.cc:348] T 00000000000000000000000000000000 P b3cd3784ef3b45c2a431990af31d2396 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3cd3784ef3b45c2a431990af31d2396" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 37823 } }
I20260811 08:03:48.370182 20631 raft_consensus.cc:374] T 00000000000000000000000000000000 P b3cd3784ef3b45c2a431990af31d2396 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:03:48.370206 20631 raft_consensus.cc:729] T 00000000000000000000000000000000 P b3cd3784ef3b45c2a431990af31d2396 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3cd3784ef3b45c2a431990af31d2396, State: Initialized, Role: FOLLOWER
I20260811 08:03:48.370370 20631 consensus_queue.cc:260] T 00000000000000000000000000000000 P b3cd3784ef3b45c2a431990af31d2396 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3cd3784ef3b45c2a431990af31d2396" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 37823 } }
I20260811 08:03:48.370462 20631 raft_consensus.cc:388] T 00000000000000000000000000000000 P b3cd3784ef3b45c2a431990af31d2396 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:03:48.370488 20631 raft_consensus.cc:482] T 00000000000000000000000000000000 P b3cd3784ef3b45c2a431990af31d2396 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:03:48.370518 20631 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b3cd3784ef3b45c2a431990af31d2396 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:03:48.371276 20631 raft_consensus.cc:504] T 00000000000000000000000000000000 P b3cd3784ef3b45c2a431990af31d2396 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3cd3784ef3b45c2a431990af31d2396" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 37823 } }
I20260811 08:03:48.371392 20631 leader_election.cc:302] T 00000000000000000000000000000000 P b3cd3784ef3b45c2a431990af31d2396 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b3cd3784ef3b45c2a431990af31d2396; no voters:
I20260811 08:03:48.371536 20631 leader_election.cc:288] T 00000000000000000000000000000000 P b3cd3784ef3b45c2a431990af31d2396 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:03:48.371599 20634 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b3cd3784ef3b45c2a431990af31d2396 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:03:48.371856 20634 raft_consensus.cc:686] T 00000000000000000000000000000000 P b3cd3784ef3b45c2a431990af31d2396 [term 1 LEADER]: Becoming Leader. State: Replica: b3cd3784ef3b45c2a431990af31d2396, State: Running, Role: LEADER
I20260811 08:03:48.371860 20631 sys_catalog.cc:564] T 00000000000000000000000000000000 P b3cd3784ef3b45c2a431990af31d2396 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:03:48.372020 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 20554
I20260811 08:03:48.372118 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435400844580-15507-0/minicluster-data/master-0/wal/instance
I20260811 08:03:48.372268 15507 external_mini_cluster.cc:1428] Setting key 59bec0feaa133bb7a32611560fdf8b07
I20260811 08:03:48.373028 20634 consensus_queue.cc:237] T 00000000000000000000000000000000 P b3cd3784ef3b45c2a431990af31d2396 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3cd3784ef3b45c2a431990af31d2396" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 37823 } }
W20260811 08:03:48.374511 20653 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b3cd3784ef3b45c2a431990af31d2396: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260811 08:03:48.374563 20636 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3cd3784ef3b45c2a431990af31d2396 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b3cd3784ef3b45c2a431990af31d2396" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3cd3784ef3b45c2a431990af31d2396" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 37823 } } }
I20260811 08:03:48.374663 20636 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3cd3784ef3b45c2a431990af31d2396 [sys.catalog]: This master's current role is: LEADER
I20260811 08:03:48.375077 20637 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3cd3784ef3b45c2a431990af31d2396 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b3cd3784ef3b45c2a431990af31d2396. Latest consensus state: current_term: 1 leader_uuid: "b3cd3784ef3b45c2a431990af31d2396" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3cd3784ef3b45c2a431990af31d2396" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 37823 } } }
I20260811 08:03:48.375154 20637 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3cd3784ef3b45c2a431990af31d2396 [sys.catalog]: This master's current role is: LEADER
W20260811 08:03:48.374572 20653 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 08:03:48.375321 20645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:48.372797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46930 (local address 127.15.36.254:37823)
0811 08:03:48.373027 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:48.373039 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:48.373077 (+ 38us) server_negotiation.cc:407] Connection header received
0811 08:03:48.373211 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:48.373219 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:48.373267 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:48.373419 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:48.374571 (+ 1152us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:48.374575 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:48.374575 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:03:48.374581 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:48.374630 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:03:48.374646 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:48.374712 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:48.375045 (+ 333us) server_negotiation.cc:299] Negotiation successful
0811 08:03:48.375115 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":91,"threads_started":1}
I20260811 08:03:48.376219 20655 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:03:48.376436 20655 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:03:48.378194 20655 catalog_manager.cc:1347] Generated new cluster ID: dc2caaaef67b40099f3c4d8cf6c5be4f
I20260811 08:03:48.378255 20655 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:03:48.392875 20655 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:03:48.393162 20655 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:03:48.400472 20655 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b3cd3784ef3b45c2a431990af31d2396: Generated new TSK 0
I20260811 08:03:48.400745 20655 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:03:48.403380 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435400844580-15507-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435400844580-15507-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435400844580-15507-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.193:0
--local_ip_for_outbound_sockets=127.15.36.193
--webserver_interface=127.15.36.193
--webserver_port=0
--tserver_master_addrs=127.15.36.254:37823
--builtin_ntp_servers=127.15.36.212:44011
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 08:03:48.509555 20659 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:03:48.509883 20659 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:03:48.509931 20659 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:03:48.511358 20659 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:03:48.511436 20659 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:03:48.511483 20659 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.193
I20260811 08:03:48.513033 20659 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:44011
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435400844580-15507-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435400844580-15507-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.36.193
--webserver_port=0
--tserver_master_addrs=127.15.36.254:37823
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20659
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.193
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435400844580-15507-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:03:48.513353 20659 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:03:48.513705 20659 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:03:48.521544 20666 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:48.521574 20664 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:48.521692 20668 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:03:48.521838 20659 server_base.cc:1034] running on GCE node
I20260811 08:03:48.522168 20659 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:03:48.522491 20659 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:03:48.523674 20659 hybrid_clock.cc:648] HybridClock initialized: now 1786435428523621 us; error 71 us; skew 500 ppm
I20260811 08:03:48.525364 20659 webserver.cc:460] Webserver started at http://127.15.36.193:39109/ using document root <none> and password file <none>
I20260811 08:03:48.525648 20659 fs_manager.cc:359] Metadata directory not provided
I20260811 08:03:48.525717 20659 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:03:48.525869 20659 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:03:48.527530 20659 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435400844580-15507-0/minicluster-data/ts-0/data/instance:
uuid: "eda7bf4222e04f87ac02b7d653d3bbf9"
format_stamp: "Formatted at 2026-08-11 08:03:48 on dist-test-slave-2w3w"
server_key: "f1be82330befccc3e4ccf1a9d21cfdb6"
server_key_iv: "6d5b58e72a06280c4eb921f3a11bc7cf"
server_key_version: "encryptionkey@0"
I20260811 08:03:48.528002 20659 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435400844580-15507-0/minicluster-data/ts-0/wal/instance:
uuid: "eda7bf4222e04f87ac02b7d653d3bbf9"
format_stamp: "Formatted at 2026-08-11 08:03:48 on dist-test-slave-2w3w"
server_key: "f1be82330befccc3e4ccf1a9d21cfdb6"
server_key_iv: "6d5b58e72a06280c4eb921f3a11bc7cf"
server_key_version: "encryptionkey@0"
I20260811 08:03:48.529994 20659 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260811 08:03:48.531301 20674 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:48.531613 20659 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:03:48.531728 20659 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435400844580-15507-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435400844580-15507-0/minicluster-data/ts-0/wal
uuid: "eda7bf4222e04f87ac02b7d653d3bbf9"
format_stamp: "Formatted at 2026-08-11 08:03:48 on dist-test-slave-2w3w"
server_key: "f1be82330befccc3e4ccf1a9d21cfdb6"
server_key_iv: "6d5b58e72a06280c4eb921f3a11bc7cf"
server_key_version: "encryptionkey@0"
I20260811 08:03:48.531817 20659 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435400844580-15507-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435400844580-15507-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435400844580-15507-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:03:48.538825 20659 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:03:48.539288 20659 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:03:48.539444 20659 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:03:48.539723 20659 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:03:48.540210 20659 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:03:48.540273 20659 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:48.540308 20659 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:03:48.540326 20659 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:48.548091 20659 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.193:45813
I20260811 08:03:48.548151 20801 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.193:45813 every 8 connection(s)
I20260811 08:03:48.548630 20659 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
I20260811 08:03:48.550738 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 20659
I20260811 08:03:48.550927 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435400844580-15507-0/minicluster-data/ts-0/wal/instance
I20260811 08:03:48.551210 15507 external_mini_cluster.cc:1428] Setting key db94a81921c5e6e9cee6db83f836d79c
I20260811 08:03:48.552426 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435400844580-15507-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435400844580-15507-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435400844580-15507-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.194:0
--local_ip_for_outbound_sockets=127.15.36.194
--webserver_interface=127.15.36.194
--webserver_port=0
--tserver_master_addrs=127.15.36.254:37823
--builtin_ntp_servers=127.15.36.212:44011
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260811 08:03:48.552829 20645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:48.549924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:55127 (local address 127.15.36.254:37823)
0811 08:03:48.550022 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:48.550025 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:48.550205 (+ 180us) server_negotiation.cc:407] Connection header received
0811 08:03:48.550694 (+ 489us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:48.550695 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:48.550704 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:48.550761 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:48.552465 (+ 1704us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:48.552466 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:48.552467 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:03:48.552472 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:48.552491 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:03:48.552496 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:48.552584 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:48.552732 (+ 148us) server_negotiation.cc:299] Negotiation successful
0811 08:03:48.552757 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 08:03:48.553094 20804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:48.549806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:37823 (local address 127.15.36.193:55127)
0811 08:03:48.550017 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:48.550058 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:48.550573 (+ 515us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:48.550843 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:48.550847 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:48.550876 (+ 29us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:03:48.552295 (+ 1419us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 08:03:48.552296 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:03:48.552331 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 08:03:48.552365 (+ 34us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:03:48.552653 (+ 288us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:03:48.552660 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:03:48.552664 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:03:48.552746 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 08:03:48.552820 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":87,"threads_started":1}
I20260811 08:03:48.553568 20802 heartbeater.cc:347] Connected to a master server at 127.15.36.254:37823
I20260811 08:03:48.553666 20802 heartbeater.cc:464] Registering TS with master...
I20260811 08:03:48.553853 20802 heartbeater.cc:511] Master 127.15.36.254:37823 requested a full tablet report, sending...
I20260811 08:03:48.554702 20592 ts_manager.cc:194] Registered new tserver with Master: eda7bf4222e04f87ac02b7d653d3bbf9 (127.15.36.193:45813)
W20260811 08:03:48.654908 20805 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:03:48.655258 20805 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:03:48.655306 20805 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:03:48.656818 20805 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:03:48.656898 20805 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:03:48.656951 20805 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.194
I20260811 08:03:48.658560 20805 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:44011
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435400844580-15507-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435400844580-15507-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.36.194
--webserver_port=0
--tserver_master_addrs=127.15.36.254:37823
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20805
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.194
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435400844580-15507-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:03:48.658898 20805 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:03:48.659307 20805 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:03:48.665032 20812 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:48.665052 20811 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:48.665125 20814 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:03:48.665468 20805 server_base.cc:1034] running on GCE node
I20260811 08:03:48.665725 20805 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:03:48.666008 20805 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:03:48.667173 20805 hybrid_clock.cc:648] HybridClock initialized: now 1786435428667161 us; error 44 us; skew 500 ppm
I20260811 08:03:48.668671 20805 webserver.cc:460] Webserver started at http://127.15.36.194:35683/ using document root <none> and password file <none>
I20260811 08:03:48.669082 20805 fs_manager.cc:359] Metadata directory not provided
I20260811 08:03:48.669160 20805 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:03:48.669327 20805 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:03:48.670451 20805 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435400844580-15507-0/minicluster-data/ts-1/data/instance:
uuid: "7383e4bd3fff46159e6130eae7228bec"
format_stamp: "Formatted at 2026-08-11 08:03:48 on dist-test-slave-2w3w"
server_key: "94a522903593208458c428d5ab01f44d"
server_key_iv: "502dba05b78fe8665938a3cdc7292841"
server_key_version: "encryptionkey@0"
I20260811 08:03:48.670778 20805 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435400844580-15507-0/minicluster-data/ts-1/wal/instance:
uuid: "7383e4bd3fff46159e6130eae7228bec"
format_stamp: "Formatted at 2026-08-11 08:03:48 on dist-test-slave-2w3w"
server_key: "94a522903593208458c428d5ab01f44d"
server_key_iv: "502dba05b78fe8665938a3cdc7292841"
server_key_version: "encryptionkey@0"
I20260811 08:03:48.673193 20805 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260811 08:03:48.674407 20820 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:48.674702 20805 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:03:48.674908 20805 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435400844580-15507-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435400844580-15507-0/minicluster-data/ts-1/wal
uuid: "7383e4bd3fff46159e6130eae7228bec"
format_stamp: "Formatted at 2026-08-11 08:03:48 on dist-test-slave-2w3w"
server_key: "94a522903593208458c428d5ab01f44d"
server_key_iv: "502dba05b78fe8665938a3cdc7292841"
server_key_version: "encryptionkey@0"
I20260811 08:03:48.675074 20805 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435400844580-15507-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435400844580-15507-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435400844580-15507-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:03:48.679347 20805 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:03:48.679725 20805 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:03:48.679921 20805 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:03:48.680186 20805 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:03:48.680570 20805 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:03:48.680634 20805 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:48.680681 20805 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:03:48.680711 20805 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:48.688347 20805 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.194:40551
I20260811 08:03:48.688419 20948 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.194:40551 every 8 connection(s)
I20260811 08:03:48.688805 20805 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
I20260811 08:03:48.689682 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 20805
I20260811 08:03:48.689777 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435400844580-15507-0/minicluster-data/ts-1/wal/instance
I20260811 08:03:48.689992 15507 external_mini_cluster.cc:1428] Setting key be8f08ba1fb90aae72ee02ff812bde67
I20260811 08:03:48.691699 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435400844580-15507-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435400844580-15507-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435400844580-15507-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.195:0
--local_ip_for_outbound_sockets=127.15.36.195
--webserver_interface=127.15.36.195
--webserver_port=0
--tserver_master_addrs=127.15.36.254:37823
--builtin_ntp_servers=127.15.36.212:44011
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260811 08:03:48.694375 20645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:48.690142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:45727 (local address 127.15.36.254:37823)
0811 08:03:48.690249 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:48.690257 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:48.690644 (+ 387us) server_negotiation.cc:407] Connection header received
0811 08:03:48.691804 (+ 1160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:48.691806 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:48.691819 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:48.691929 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:48.693840 (+ 1911us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:48.693842 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:48.693843 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:03:48.693850 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:48.693874 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:03:48.693881 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:48.693963 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:48.694251 (+ 288us) server_negotiation.cc:299] Negotiation successful
0811 08:03:48.694270 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 08:03:48.694691 20951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:48.690163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:37823 (local address 127.15.36.194:45727)
0811 08:03:48.690456 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:48.690518 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:48.691368 (+ 850us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:48.692128 (+ 760us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:48.692135 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:48.692152 (+ 17us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:03:48.693618 (+ 1466us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 08:03:48.693619 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:03:48.693659 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 08:03:48.693700 (+ 41us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:03:48.693969 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:03:48.693974 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:03:48.694114 (+ 140us) client_negotiation.cc:769] Sending connection context
0811 08:03:48.694238 (+ 124us) client_negotiation.cc:240] Negotiation successful
0811 08:03:48.694387 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":163,"threads_started":1}
I20260811 08:03:48.695362 20949 heartbeater.cc:347] Connected to a master server at 127.15.36.254:37823
I20260811 08:03:48.695475 20949 heartbeater.cc:464] Registering TS with master...
I20260811 08:03:48.695670 20949 heartbeater.cc:511] Master 127.15.36.254:37823 requested a full tablet report, sending...
I20260811 08:03:48.696226 20592 ts_manager.cc:194] Registered new tserver with Master: 7383e4bd3fff46159e6130eae7228bec (127.15.36.194:40551)
W20260811 08:03:48.788565 20952 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:03:48.788837 20952 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:03:48.788879 20952 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:03:48.790207 20952 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:03:48.790290 20952 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:03:48.790341 20952 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.195
I20260811 08:03:48.792502 20952 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:44011
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435400844580-15507-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435400844580-15507-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.36.195
--webserver_port=0
--tserver_master_addrs=127.15.36.254:37823
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20952
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.195
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435400844580-15507-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:03:48.792958 20952 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:03:48.793435 20952 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:03:48.799809 20957 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:48.799925 20960 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:03:48.800300 20952 server_base.cc:1034] running on GCE node
W20260811 08:03:48.800535 20958 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:03:48.800943 20952 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:03:48.801240 20952 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:03:48.802465 20952 hybrid_clock.cc:648] HybridClock initialized: now 1786435428802453 us; error 38 us; skew 500 ppm
I20260811 08:03:48.804605 20952 webserver.cc:460] Webserver started at http://127.15.36.195:43549/ using document root <none> and password file <none>
I20260811 08:03:48.805044 20952 fs_manager.cc:359] Metadata directory not provided
I20260811 08:03:48.805132 20952 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:03:48.805297 20952 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:03:48.806473 20952 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435400844580-15507-0/minicluster-data/ts-2/data/instance:
uuid: "ea868aa4937d4f518089f5ea3967ac61"
format_stamp: "Formatted at 2026-08-11 08:03:48 on dist-test-slave-2w3w"
server_key: "b68cbc7e72eea9b84a5521c53d66183a"
server_key_iv: "a662596bfe028a6645dc38282c8c9ec4"
server_key_version: "encryptionkey@0"
I20260811 08:03:48.806877 20952 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435400844580-15507-0/minicluster-data/ts-2/wal/instance:
uuid: "ea868aa4937d4f518089f5ea3967ac61"
format_stamp: "Formatted at 2026-08-11 08:03:48 on dist-test-slave-2w3w"
server_key: "b68cbc7e72eea9b84a5521c53d66183a"
server_key_iv: "a662596bfe028a6645dc38282c8c9ec4"
server_key_version: "encryptionkey@0"
I20260811 08:03:48.808522 20952 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:03:48.809576 20967 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:48.809947 20952 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:03:48.810164 20952 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435400844580-15507-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435400844580-15507-0/minicluster-data/ts-2/wal
uuid: "ea868aa4937d4f518089f5ea3967ac61"
format_stamp: "Formatted at 2026-08-11 08:03:48 on dist-test-slave-2w3w"
server_key: "b68cbc7e72eea9b84a5521c53d66183a"
server_key_iv: "a662596bfe028a6645dc38282c8c9ec4"
server_key_version: "encryptionkey@0"
I20260811 08:03:48.810253 20952 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435400844580-15507-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435400844580-15507-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435400844580-15507-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:03:48.814499 20952 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:03:48.814831 20952 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:03:48.815049 20952 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:03:48.815284 20952 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:03:48.815647 20952 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:03:48.815704 20952 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:48.815748 20952 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:03:48.815776 20952 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:48.822158 20952 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.195:42799
I20260811 08:03:48.822212 21089 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.195:42799 every 8 connection(s)
I20260811 08:03:48.822633 20952 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
I20260811 08:03:48.825945 20645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:48.823656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:34581 (local address 127.15.36.254:37823)
0811 08:03:48.823732 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:48.823734 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:48.823885 (+ 151us) server_negotiation.cc:407] Connection header received
0811 08:03:48.824363 (+ 478us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:48.824364 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:48.824370 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:48.824441 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:48.825700 (+ 1259us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:48.825701 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:48.825702 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:03:48.825705 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:48.825720 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:03:48.825725 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:48.825780 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:48.825869 (+ 89us) server_negotiation.cc:299] Negotiation successful
0811 08:03:48.825883 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 08:03:48.826184 21092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:48.823517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:37823 (local address 127.15.36.195:34581)
0811 08:03:48.823761 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:48.823799 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:48.824272 (+ 473us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:48.824503 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:48.824507 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:48.824515 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:03:48.825523 (+ 1008us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 08:03:48.825524 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:03:48.825555 (+ 31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 08:03:48.825584 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:03:48.825793 (+ 209us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:03:48.825799 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:03:48.825801 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 08:03:48.825863 (+ 62us) client_negotiation.cc:240] Negotiation successful
0811 08:03:48.825917 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":108,"threads_started":1}
I20260811 08:03:48.826896 21090 heartbeater.cc:347] Connected to a master server at 127.15.36.254:37823
I20260811 08:03:48.827204 21090 heartbeater.cc:464] Registering TS with master...
I20260811 08:03:48.827399 21090 heartbeater.cc:511] Master 127.15.36.254:37823 requested a full tablet report, sending...
I20260811 08:03:48.827875 20592 ts_manager.cc:194] Registered new tserver with Master: ea868aa4937d4f518089f5ea3967ac61 (127.15.36.195:42799)
I20260811 08:03:48.829099 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 20952
I20260811 08:03:48.829191 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435400844580-15507-0/minicluster-data/ts-2/wal/instance
I20260811 08:03:48.829378 15507 external_mini_cluster.cc:1428] Setting key 9ca6965458c48392607f0bef174c3210
I20260811 08:03:48.830271 15507 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 08:03:48.834735 20645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:48.832718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46938 (local address 127.15.36.254:37823)
0811 08:03:48.832811 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:48.832813 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:48.833182 (+ 369us) server_negotiation.cc:407] Connection header received
0811 08:03:48.833216 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:48.833217 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:48.833223 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:48.833276 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:48.834305 (+ 1029us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:48.834306 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:48.834306 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:03:48.834311 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:48.834364 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:03:48.834369 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:48.834434 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:48.834549 (+ 115us) server_negotiation.cc:299] Negotiation successful
0811 08:03:48.834563 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 08:03:48.837415 20592 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46938:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:03:48.839915 20592 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:03:48.845013 21098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:48.842847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.194:40551 (local address 127.0.0.1:55172)
0811 08:03:48.843097 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:48.843110 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:48.843175 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:48.843752 (+ 577us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:48.843759 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:48.843767 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:03:48.844368 (+ 601us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 08:03:48.844369 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:03:48.844389 (+ 20us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 08:03:48.844417 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:03:48.844809 (+ 392us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:03:48.844818 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:03:48.844821 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:03:48.844910 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 08:03:48.844927 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":64,"threads_started":1}
I20260811 08:03:48.845032 21102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:48.843051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55172 (local address 127.15.36.194:40551)
0811 08:03:48.843239 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:48.843245 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:48.843256 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:03:48.843284 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:48.843286 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:48.843297 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:48.843381 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:48.844660 (+ 1279us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:48.844674 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:48.844674 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:03:48.844683 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:48.844716 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:03:48.844736 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:48.844815 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:48.844936 (+ 121us) server_negotiation.cc:299] Negotiation successful
0811 08:03:48.844953 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":96,"threads_started":1}
I20260811 08:03:48.845405 21104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:48.843470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39238 (local address 127.15.36.193:45813)
0811 08:03:48.843673 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:48.843678 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:48.843793 (+ 115us) server_negotiation.cc:407] Connection header received
0811 08:03:48.843822 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:48.843825 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:48.843836 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:48.843917 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:48.844698 (+ 781us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:48.844707 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:48.844707 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:03:48.844712 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:48.844751 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:03:48.844775 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:48.844844 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:48.845301 (+ 457us) server_negotiation.cc:299] Negotiation successful
0811 08:03:48.845319 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":93,"threads_started":1}
I20260811 08:03:48.845217 21103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:48.843309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.193:45813 (local address 127.0.0.1:39238)
0811 08:03:48.843460 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:48.843470 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:48.843514 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:48.844037 (+ 523us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:48.844039 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:48.844041 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:03:48.844526 (+ 485us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 08:03:48.844527 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:03:48.844536 (+ 9us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 08:03:48.844552 (+ 16us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:03:48.844877 (+ 325us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:03:48.844878 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:03:48.844879 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 08:03:48.845023 (+ 144us) client_negotiation.cc:240] Negotiation successful
0811 08:03:48.845038 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":93,"threads_started":1}
I20260811 08:03:48.846094 21100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:48.842847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.195:42799 (local address 127.0.0.1:57124)
0811 08:03:48.843061 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:48.843108 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:48.843174 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:48.843979 (+ 805us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:48.843980 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:48.843983 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:03:48.845260 (+ 1277us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 08:03:48.845261 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:03:48.845267 (+ 6us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 08:03:48.845278 (+ 11us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:03:48.845966 (+ 688us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:03:48.845967 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:03:48.845967 (+ 0us) client_negotiation.cc:769] Sending connection context
0811 08:03:48.846012 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 08:03:48.846026 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":150,"threads_started":1}
I20260811 08:03:48.846350 21101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:48.842988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57124 (local address 127.15.36.195:42799)
0811 08:03:48.843643 (+ 655us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:48.843648 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:48.843658 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:03:48.843686 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:48.843688 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:48.843698 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:48.843801 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:48.845368 (+ 1567us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:48.845380 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:48.845380 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:03:48.845386 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:48.845820 (+ 434us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:03:48.845870 (+ 50us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:48.845936 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:48.846241 (+ 305us) server_negotiation.cc:299] Negotiation successful
0811 08:03:48.846259 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":614,"thread_start_us":93,"threads_started":1}
I20260811 08:03:48.846297 20874 tablet_service.cc:1467] Processing CreateTablet for tablet 7cd7275032fa412bb18cc0315dd113bd (DEFAULT_TABLE table=test-table [id=081660e238784e3d90a96d76e6a8b8c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:03:48.846338 20728 tablet_service.cc:1467] Processing CreateTablet for tablet 7cd7275032fa412bb18cc0315dd113bd (DEFAULT_TABLE table=test-table [id=081660e238784e3d90a96d76e6a8b8c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:03:48.846725 20874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7cd7275032fa412bb18cc0315dd113bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:03:48.846727 20728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7cd7275032fa412bb18cc0315dd113bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:03:48.847085 21019 tablet_service.cc:1467] Processing CreateTablet for tablet 7cd7275032fa412bb18cc0315dd113bd (DEFAULT_TABLE table=test-table [id=081660e238784e3d90a96d76e6a8b8c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:03:48.847425 21019 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7cd7275032fa412bb18cc0315dd113bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:03:48.849831 21105 tablet_bootstrap.cc:492] T 7cd7275032fa412bb18cc0315dd113bd P 7383e4bd3fff46159e6130eae7228bec: Bootstrap starting.
I20260811 08:03:48.850288 21106 tablet_bootstrap.cc:492] T 7cd7275032fa412bb18cc0315dd113bd P eda7bf4222e04f87ac02b7d653d3bbf9: Bootstrap starting.
I20260811 08:03:48.850718 21105 tablet_bootstrap.cc:654] T 7cd7275032fa412bb18cc0315dd113bd P 7383e4bd3fff46159e6130eae7228bec: Neither blocks nor log segments found. Creating new log.
I20260811 08:03:48.850896 21107 tablet_bootstrap.cc:492] T 7cd7275032fa412bb18cc0315dd113bd P ea868aa4937d4f518089f5ea3967ac61: Bootstrap starting.
I20260811 08:03:48.851234 21106 tablet_bootstrap.cc:654] T 7cd7275032fa412bb18cc0315dd113bd P eda7bf4222e04f87ac02b7d653d3bbf9: Neither blocks nor log segments found. Creating new log.
I20260811 08:03:48.851649 21105 log.cc:824] T 7cd7275032fa412bb18cc0315dd113bd P 7383e4bd3fff46159e6130eae7228bec: Log is configured to *not* fsync() on all Append() calls
I20260811 08:03:48.851647 21106 log.cc:824] T 7cd7275032fa412bb18cc0315dd113bd P eda7bf4222e04f87ac02b7d653d3bbf9: Log is configured to *not* fsync() on all Append() calls
I20260811 08:03:48.851976 21107 tablet_bootstrap.cc:654] T 7cd7275032fa412bb18cc0315dd113bd P ea868aa4937d4f518089f5ea3967ac61: Neither blocks nor log segments found. Creating new log.
I20260811 08:03:48.852378 21107 log.cc:824] T 7cd7275032fa412bb18cc0315dd113bd P ea868aa4937d4f518089f5ea3967ac61: Log is configured to *not* fsync() on all Append() calls
I20260811 08:03:48.852612 21106 tablet_bootstrap.cc:492] T 7cd7275032fa412bb18cc0315dd113bd P eda7bf4222e04f87ac02b7d653d3bbf9: No bootstrap required, opened a new log
I20260811 08:03:48.852705 21106 ts_tablet_manager.cc:1397] T 7cd7275032fa412bb18cc0315dd113bd P eda7bf4222e04f87ac02b7d653d3bbf9: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260811 08:03:48.853189 21107 tablet_bootstrap.cc:492] T 7cd7275032fa412bb18cc0315dd113bd P ea868aa4937d4f518089f5ea3967ac61: No bootstrap required, opened a new log
I20260811 08:03:48.853253 21107 ts_tablet_manager.cc:1397] T 7cd7275032fa412bb18cc0315dd113bd P ea868aa4937d4f518089f5ea3967ac61: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260811 08:03:48.854843 21106 raft_consensus.cc:348] T 7cd7275032fa412bb18cc0315dd113bd P eda7bf4222e04f87ac02b7d653d3bbf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7383e4bd3fff46159e6130eae7228bec" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 40551 } } peers { permanent_uuid: "ea868aa4937d4f518089f5ea3967ac61" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42799 } } peers { permanent_uuid: "eda7bf4222e04f87ac02b7d653d3bbf9" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 45813 } }
I20260811 08:03:48.855230 21106 raft_consensus.cc:374] T 7cd7275032fa412bb18cc0315dd113bd P eda7bf4222e04f87ac02b7d653d3bbf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:03:48.855302 21106 raft_consensus.cc:729] T 7cd7275032fa412bb18cc0315dd113bd P eda7bf4222e04f87ac02b7d653d3bbf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eda7bf4222e04f87ac02b7d653d3bbf9, State: Initialized, Role: FOLLOWER
I20260811 08:03:48.855448 21106 consensus_queue.cc:260] T 7cd7275032fa412bb18cc0315dd113bd P eda7bf4222e04f87ac02b7d653d3bbf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7383e4bd3fff46159e6130eae7228bec" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 40551 } } peers { permanent_uuid: "ea868aa4937d4f518089f5ea3967ac61" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42799 } } peers { permanent_uuid: "eda7bf4222e04f87ac02b7d653d3bbf9" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 45813 } }
I20260811 08:03:48.855840 20802 heartbeater.cc:503] Master 127.15.36.254:37823 was elected leader, sending a full tablet report...
I20260811 08:03:48.855875 21107 raft_consensus.cc:348] T 7cd7275032fa412bb18cc0315dd113bd P ea868aa4937d4f518089f5ea3967ac61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7383e4bd3fff46159e6130eae7228bec" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 40551 } } peers { permanent_uuid: "ea868aa4937d4f518089f5ea3967ac61" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42799 } } peers { permanent_uuid: "eda7bf4222e04f87ac02b7d653d3bbf9" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 45813 } }
I20260811 08:03:48.856052 21107 raft_consensus.cc:374] T 7cd7275032fa412bb18cc0315dd113bd P ea868aa4937d4f518089f5ea3967ac61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:03:48.855873 21106 ts_tablet_manager.cc:1428] T 7cd7275032fa412bb18cc0315dd113bd P eda7bf4222e04f87ac02b7d653d3bbf9: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260811 08:03:48.856086 21107 raft_consensus.cc:729] T 7cd7275032fa412bb18cc0315dd113bd P ea868aa4937d4f518089f5ea3967ac61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea868aa4937d4f518089f5ea3967ac61, State: Initialized, Role: FOLLOWER
I20260811 08:03:48.856236 21107 consensus_queue.cc:260] T 7cd7275032fa412bb18cc0315dd113bd P ea868aa4937d4f518089f5ea3967ac61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7383e4bd3fff46159e6130eae7228bec" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 40551 } } peers { permanent_uuid: "ea868aa4937d4f518089f5ea3967ac61" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42799 } } peers { permanent_uuid: "eda7bf4222e04f87ac02b7d653d3bbf9" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 45813 } }
I20260811 08:03:48.856549 21107 ts_tablet_manager.cc:1428] T 7cd7275032fa412bb18cc0315dd113bd P ea868aa4937d4f518089f5ea3967ac61: Time spent starting tablet: real 0.003s user 0.003s sys 0.001s
I20260811 08:03:48.856600 21090 heartbeater.cc:503] Master 127.15.36.254:37823 was elected leader, sending a full tablet report...
I20260811 08:03:48.856878 21105 tablet_bootstrap.cc:492] T 7cd7275032fa412bb18cc0315dd113bd P 7383e4bd3fff46159e6130eae7228bec: No bootstrap required, opened a new log
I20260811 08:03:48.856958 21105 ts_tablet_manager.cc:1397] T 7cd7275032fa412bb18cc0315dd113bd P 7383e4bd3fff46159e6130eae7228bec: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260811 08:03:48.859386 21105 raft_consensus.cc:348] T 7cd7275032fa412bb18cc0315dd113bd P 7383e4bd3fff46159e6130eae7228bec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7383e4bd3fff46159e6130eae7228bec" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 40551 } } peers { permanent_uuid: "ea868aa4937d4f518089f5ea3967ac61" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42799 } } peers { permanent_uuid: "eda7bf4222e04f87ac02b7d653d3bbf9" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 45813 } }
I20260811 08:03:48.859597 21105 raft_consensus.cc:374] T 7cd7275032fa412bb18cc0315dd113bd P 7383e4bd3fff46159e6130eae7228bec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:03:48.859635 21105 raft_consensus.cc:729] T 7cd7275032fa412bb18cc0315dd113bd P 7383e4bd3fff46159e6130eae7228bec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7383e4bd3fff46159e6130eae7228bec, State: Initialized, Role: FOLLOWER
I20260811 08:03:48.859781 21105 consensus_queue.cc:260] T 7cd7275032fa412bb18cc0315dd113bd P 7383e4bd3fff46159e6130eae7228bec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7383e4bd3fff46159e6130eae7228bec" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 40551 } } peers { permanent_uuid: "ea868aa4937d4f518089f5ea3967ac61" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42799 } } peers { permanent_uuid: "eda7bf4222e04f87ac02b7d653d3bbf9" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 45813 } }
I20260811 08:03:48.860076 21105 ts_tablet_manager.cc:1428] T 7cd7275032fa412bb18cc0315dd113bd P 7383e4bd3fff46159e6130eae7228bec: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 08:03:48.860154 20949 heartbeater.cc:503] Master 127.15.36.254:37823 was elected leader, sending a full tablet report...
W20260811 08:03:48.939473 20950 tablet.cc:2369] T 7cd7275032fa412bb18cc0315dd113bd P 7383e4bd3fff46159e6130eae7228bec: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 08:03:49.049635 20803 tablet.cc:2369] T 7cd7275032fa412bb18cc0315dd113bd P eda7bf4222e04f87ac02b7d653d3bbf9: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 08:03:49.073342 21091 tablet.cc:2369] T 7cd7275032fa412bb18cc0315dd113bd P ea868aa4937d4f518089f5ea3967ac61: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:03:49.110512 21113 raft_consensus.cc:482] T 7cd7275032fa412bb18cc0315dd113bd P 7383e4bd3fff46159e6130eae7228bec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:03:49.110651 21113 raft_consensus.cc:504] T 7cd7275032fa412bb18cc0315dd113bd P 7383e4bd3fff46159e6130eae7228bec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7383e4bd3fff46159e6130eae7228bec" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 40551 } } peers { permanent_uuid: "ea868aa4937d4f518089f5ea3967ac61" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42799 } } peers { permanent_uuid: "eda7bf4222e04f87ac02b7d653d3bbf9" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 45813 } }
I20260811 08:03:49.111747 21113 leader_election.cc:288] T 7cd7275032fa412bb18cc0315dd113bd P 7383e4bd3fff46159e6130eae7228bec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea868aa4937d4f518089f5ea3967ac61 (127.15.36.195:42799), eda7bf4222e04f87ac02b7d653d3bbf9 (127.15.36.193:45813)
I20260811 08:03:49.113859 21101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:49.112277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:40707 (local address 127.15.36.195:42799)
0811 08:03:49.112333 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:49.112335 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:49.112343 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:03:49.112373 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:49.112374 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:49.112382 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:49.112465 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:49.113281 (+ 816us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:49.113283 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:49.113283 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:03:49.113288 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:49.113309 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:03:49.113316 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:49.113602 (+ 286us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:49.113738 (+ 136us) server_negotiation.cc:299] Negotiation successful
0811 08:03:49.113782 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 08:03:49.113842 20951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:49.111975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.195:42799 (local address 127.15.36.194:40707)
0811 08:03:49.112042 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:49.112057 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:49.112103 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:49.112472 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:49.112473 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:49.112476 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:03:49.113116 (+ 640us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 08:03:49.113116 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:03:49.113126 (+ 10us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 08:03:49.113144 (+ 18us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:03:49.113603 (+ 459us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:03:49.113604 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:03:49.113605 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 08:03:49.113687 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 08:03:49.113705 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46}
I20260811 08:03:49.114126 21114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:49.112017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.193:45813 (local address 127.15.36.194:47541)
0811 08:03:49.112209 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:49.112219 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:49.112256 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:49.112521 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:49.112535 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:49.112538 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:03:49.113681 (+ 1143us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 08:03:49.113681 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:03:49.113691 (+ 10us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 08:03:49.113706 (+ 15us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:03:49.113920 (+ 214us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:03:49.113921 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:03:49.113922 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 08:03:49.114025 (+ 103us) client_negotiation.cc:240] Negotiation successful
0811 08:03:49.114040 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":102,"threads_started":1}
I20260811 08:03:49.114300 21042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7cd7275032fa412bb18cc0315dd113bd" candidate_uuid: "7383e4bd3fff46159e6130eae7228bec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea868aa4937d4f518089f5ea3967ac61" is_pre_election: true
I20260811 08:03:49.114498 21104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:49.112311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:47541 (local address 127.15.36.193:45813)
0811 08:03:49.112371 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:49.112373 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:49.112385 (+ 12us) server_negotiation.cc:407] Connection header received
0811 08:03:49.112415 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:49.112416 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:49.112424 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:49.112512 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:49.113804 (+ 1292us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:49.113806 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:49.113807 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:03:49.113812 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:49.113830 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:03:49.113836 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:49.113905 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:49.114355 (+ 450us) server_negotiation.cc:299] Negotiation successful
0811 08:03:49.114401 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 08:03:49.114503 21042 raft_consensus.cc:2454] T 7cd7275032fa412bb18cc0315dd113bd P ea868aa4937d4f518089f5ea3967ac61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7383e4bd3fff46159e6130eae7228bec in term 0.
I20260811 08:03:49.114807 20822 leader_election.cc:302] T 7cd7275032fa412bb18cc0315dd113bd P 7383e4bd3fff46159e6130eae7228bec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7383e4bd3fff46159e6130eae7228bec, ea868aa4937d4f518089f5ea3967ac61; no voters:
I20260811 08:03:49.114809 20749 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7cd7275032fa412bb18cc0315dd113bd" candidate_uuid: "7383e4bd3fff46159e6130eae7228bec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eda7bf4222e04f87ac02b7d653d3bbf9" is_pre_election: true
I20260811 08:03:49.114956 20749 raft_consensus.cc:2454] T 7cd7275032fa412bb18cc0315dd113bd P eda7bf4222e04f87ac02b7d653d3bbf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7383e4bd3fff46159e6130eae7228bec in term 0.
I20260811 08:03:49.114948 21113 raft_consensus.cc:2781] T 7cd7275032fa412bb18cc0315dd113bd P 7383e4bd3fff46159e6130eae7228bec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:03:49.115038 21113 raft_consensus.cc:482] T 7cd7275032fa412bb18cc0315dd113bd P 7383e4bd3fff46159e6130eae7228bec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:03:49.115082 21113 raft_consensus.cc:3037] T 7cd7275032fa412bb18cc0315dd113bd P 7383e4bd3fff46159e6130eae7228bec [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:03:49.115989 21113 raft_consensus.cc:504] T 7cd7275032fa412bb18cc0315dd113bd P 7383e4bd3fff46159e6130eae7228bec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7383e4bd3fff46159e6130eae7228bec" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 40551 } } peers { permanent_uuid: "ea868aa4937d4f518089f5ea3967ac61" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42799 } } peers { permanent_uuid: "eda7bf4222e04f87ac02b7d653d3bbf9" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 45813 } }
I20260811 08:03:49.116181 21113 leader_election.cc:288] T 7cd7275032fa412bb18cc0315dd113bd P 7383e4bd3fff46159e6130eae7228bec [CANDIDATE]: Term 1 election: Requested vote from peers ea868aa4937d4f518089f5ea3967ac61 (127.15.36.195:42799), eda7bf4222e04f87ac02b7d653d3bbf9 (127.15.36.193:45813)
I20260811 08:03:49.116468 20749 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7cd7275032fa412bb18cc0315dd113bd" candidate_uuid: "7383e4bd3fff46159e6130eae7228bec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eda7bf4222e04f87ac02b7d653d3bbf9"
I20260811 08:03:49.116585 20749 raft_consensus.cc:3037] T 7cd7275032fa412bb18cc0315dd113bd P eda7bf4222e04f87ac02b7d653d3bbf9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:03:49.116858 21042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7cd7275032fa412bb18cc0315dd113bd" candidate_uuid: "7383e4bd3fff46159e6130eae7228bec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea868aa4937d4f518089f5ea3967ac61"
I20260811 08:03:49.116950 21042 raft_consensus.cc:3037] T 7cd7275032fa412bb18cc0315dd113bd P ea868aa4937d4f518089f5ea3967ac61 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:03:49.117903 20749 raft_consensus.cc:2454] T 7cd7275032fa412bb18cc0315dd113bd P eda7bf4222e04f87ac02b7d653d3bbf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7383e4bd3fff46159e6130eae7228bec in term 1.
I20260811 08:03:49.118145 20824 leader_election.cc:302] T 7cd7275032fa412bb18cc0315dd113bd P 7383e4bd3fff46159e6130eae7228bec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7383e4bd3fff46159e6130eae7228bec, eda7bf4222e04f87ac02b7d653d3bbf9; no voters:
I20260811 08:03:49.118314 21113 raft_consensus.cc:2781] T 7cd7275032fa412bb18cc0315dd113bd P 7383e4bd3fff46159e6130eae7228bec [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:03:49.118337 21042 raft_consensus.cc:2454] T 7cd7275032fa412bb18cc0315dd113bd P ea868aa4937d4f518089f5ea3967ac61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7383e4bd3fff46159e6130eae7228bec in term 1.
I20260811 08:03:49.118512 21113 raft_consensus.cc:686] T 7cd7275032fa412bb18cc0315dd113bd P 7383e4bd3fff46159e6130eae7228bec [term 1 LEADER]: Becoming Leader. State: Replica: 7383e4bd3fff46159e6130eae7228bec, State: Running, Role: LEADER
I20260811 08:03:49.118623 21113 consensus_queue.cc:237] T 7cd7275032fa412bb18cc0315dd113bd P 7383e4bd3fff46159e6130eae7228bec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7383e4bd3fff46159e6130eae7228bec" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 40551 } } peers { permanent_uuid: "ea868aa4937d4f518089f5ea3967ac61" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42799 } } peers { permanent_uuid: "eda7bf4222e04f87ac02b7d653d3bbf9" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 45813 } }
I20260811 08:03:49.119783 20592 catalog_manager.cc:5495] T 7cd7275032fa412bb18cc0315dd113bd P 7383e4bd3fff46159e6130eae7228bec reported cstate change: term changed from 0 to 1, leader changed from <none> to 7383e4bd3fff46159e6130eae7228bec (127.15.36.194). New cstate: current_term: 1 leader_uuid: "7383e4bd3fff46159e6130eae7228bec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7383e4bd3fff46159e6130eae7228bec" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea868aa4937d4f518089f5ea3967ac61" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eda7bf4222e04f87ac02b7d653d3bbf9" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 45813 } health_report { overall_health: UNKNOWN } } }
I20260811 08:03:49.134738 21102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:49.133584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55174 (local address 127.15.36.194:40551)
0811 08:03:49.133664 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:49.133666 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:49.133672 (+ 6us) server_negotiation.cc:407] Connection header received
0811 08:03:49.133711 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:49.133712 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:49.133725 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:49.133774 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:49.134471 (+ 697us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:49.134473 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:49.134473 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:03:49.134478 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:49.134495 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:03:49.134499 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:49.134570 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:49.134627 (+ 57us) server_negotiation.cc:299] Negotiation successful
0811 08:03:49.134643 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 08:03:49.137416 21042 raft_consensus.cc:1261] T 7cd7275032fa412bb18cc0315dd113bd P ea868aa4937d4f518089f5ea3967ac61 [term 1 FOLLOWER]: Refusing update from remote peer 7383e4bd3fff46159e6130eae7228bec: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:03:49.137450 20749 raft_consensus.cc:1261] T 7cd7275032fa412bb18cc0315dd113bd P eda7bf4222e04f87ac02b7d653d3bbf9 [term 1 FOLLOWER]: Refusing update from remote peer 7383e4bd3fff46159e6130eae7228bec: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:03:49.137893 21115 consensus_queue.cc:1035] T 7cd7275032fa412bb18cc0315dd113bd P 7383e4bd3fff46159e6130eae7228bec [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea868aa4937d4f518089f5ea3967ac61" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:03:49.138309 21113 consensus_queue.cc:1035] T 7cd7275032fa412bb18cc0315dd113bd P 7383e4bd3fff46159e6130eae7228bec [LEADER]: Connected to new peer: Peer: permanent_uuid: "eda7bf4222e04f87ac02b7d653d3bbf9" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 45813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:03:49.142117 21120 mvcc.cc:205] Tried to move back new op lower bound from 7317239517742329856 to 7317239517670486016. Current Snapshot: MvccSnapshot[applied={T|T < 7317239517742329856}]
I20260811 08:03:49.145817 20592 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46938:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:03:49.145965 20592 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46938:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:03:49.147046 20592 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b3cd3784ef3b45c2a431990af31d2396: Sending DeleteTablet for 3 replicas of tablet 7cd7275032fa412bb18cc0315dd113bd
I20260811 08:03:49.147538 20874 tablet_service.cc:1514] Processing DeleteTablet for tablet 7cd7275032fa412bb18cc0315dd113bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:03:49 UTC) from {username='slave'} at 127.0.0.1:55172
I20260811 08:03:49.147558 21019 tablet_service.cc:1514] Processing DeleteTablet for tablet 7cd7275032fa412bb18cc0315dd113bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:03:49 UTC) from {username='slave'} at 127.0.0.1:57124
I20260811 08:03:49.147557 20728 tablet_service.cc:1514] Processing DeleteTablet for tablet 7cd7275032fa412bb18cc0315dd113bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:03:49 UTC) from {username='slave'} at 127.0.0.1:39238
I20260811 08:03:49.148057 21131 tablet_replica.cc:330] T 7cd7275032fa412bb18cc0315dd113bd P eda7bf4222e04f87ac02b7d653d3bbf9: stopping tablet replica
I20260811 08:03:49.148206 21131 raft_consensus.cc:2229] T 7cd7275032fa412bb18cc0315dd113bd P eda7bf4222e04f87ac02b7d653d3bbf9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:03:49.148200 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 20659
I20260811 08:03:49.148345 21131 raft_consensus.cc:2258] T 7cd7275032fa412bb18cc0315dd113bd P eda7bf4222e04f87ac02b7d653d3bbf9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:03:49.148228 21130 tablet_replica.cc:330] T 7cd7275032fa412bb18cc0315dd113bd P ea868aa4937d4f518089f5ea3967ac61: stopping tablet replica
I20260811 08:03:49.151415 21130 raft_consensus.cc:2229] T 7cd7275032fa412bb18cc0315dd113bd P ea868aa4937d4f518089f5ea3967ac61 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:03:49.151638 21130 raft_consensus.cc:2258] T 7cd7275032fa412bb18cc0315dd113bd P ea868aa4937d4f518089f5ea3967ac61 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:03:49.155508 21129 tablet_replica.cc:330] T 7cd7275032fa412bb18cc0315dd113bd P 7383e4bd3fff46159e6130eae7228bec: stopping tablet replica
I20260811 08:03:49.155679 21129 raft_consensus.cc:2229] T 7cd7275032fa412bb18cc0315dd113bd P 7383e4bd3fff46159e6130eae7228bec [term 1 LEADER]: Raft consensus shutting down.
I20260811 08:03:49.155844 21129 raft_consensus.cc:2258] T 7cd7275032fa412bb18cc0315dd113bd P 7383e4bd3fff46159e6130eae7228bec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:03:49.156466 21129 ts_tablet_manager.cc:1905] T 7cd7275032fa412bb18cc0315dd113bd P 7383e4bd3fff46159e6130eae7228bec: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:03:49.156482 21130 ts_tablet_manager.cc:1905] T 7cd7275032fa412bb18cc0315dd113bd P ea868aa4937d4f518089f5ea3967ac61: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:03:49.158675 21129 ts_tablet_manager.cc:1918] T 7cd7275032fa412bb18cc0315dd113bd P 7383e4bd3fff46159e6130eae7228bec: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:03:49.158763 21129 log.cc:1196] T 7cd7275032fa412bb18cc0315dd113bd P 7383e4bd3fff46159e6130eae7228bec: Deleting WAL directory at /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435400844580-15507-0/minicluster-data/ts-1/wal/wals/7cd7275032fa412bb18cc0315dd113bd
I20260811 08:03:49.159093 21129 ts_tablet_manager.cc:1939] T 7cd7275032fa412bb18cc0315dd113bd P 7383e4bd3fff46159e6130eae7228bec: Deleting consensus metadata
I20260811 08:03:49.159612 20577 catalog_manager.cc:4841] TS 7383e4bd3fff46159e6130eae7228bec (127.15.36.194:40551): tablet 7cd7275032fa412bb18cc0315dd113bd (table test-table [id=081660e238784e3d90a96d76e6a8b8c2]) successfully deleted
I20260811 08:03:49.160485 21130 ts_tablet_manager.cc:1918] T 7cd7275032fa412bb18cc0315dd113bd P ea868aa4937d4f518089f5ea3967ac61: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:03:49.160625 21130 log.cc:1196] T 7cd7275032fa412bb18cc0315dd113bd P ea868aa4937d4f518089f5ea3967ac61: Deleting WAL directory at /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786435400844580-15507-0/minicluster-data/ts-2/wal/wals/7cd7275032fa412bb18cc0315dd113bd
I20260811 08:03:49.160929 21130 ts_tablet_manager.cc:1939] T 7cd7275032fa412bb18cc0315dd113bd P ea868aa4937d4f518089f5ea3967ac61: Deleting consensus metadata
I20260811 08:03:49.161729 20575 catalog_manager.cc:4841] TS ea868aa4937d4f518089f5ea3967ac61 (127.15.36.195:42799): tablet 7cd7275032fa412bb18cc0315dd113bd (table test-table [id=081660e238784e3d90a96d76e6a8b8c2]) successfully deleted
W20260811 08:03:49.162467 20577 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.36.193:45813 (error 108)
I20260811 08:03:49.163067 21100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:49.162891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.193:45813 (local address 127.0.0.1:39246)
0811 08:03:49.162952 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:49.163024 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.193:45813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260811 08:03:49.163115 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 20805
W20260811 08:03:49.165064 20577 catalog_manager.cc:4584] TS eda7bf4222e04f87ac02b7d653d3bbf9 (127.15.36.193:45813): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7cd7275032fa412bb18cc0315dd113bd: Network error: Client connection negotiation failed: client connection to 127.15.36.193:45813: connect: Connection refused (error 111)
I20260811 08:03:49.169927 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 20952
I20260811 08:03:49.177498 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 20554
2026-08-11T08:03:49Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (977 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260811 08:03:49.202365 15507 mini_oidc.cc:152] Starting JWKS server
I20260811 08:03:49.203773 15507 webserver.cc:460] Webserver started at https://127.0.0.1:37757/ using document root <none> and password file <none>
I20260811 08:03:49.203922 15507 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 08:03:49.204159 15507 webserver.cc:460] Webserver started at http://127.0.0.1:35603/ using document root <none> and password file <none>
2026-08-11T08:03:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:03:49Z Disabled control of system clock
I20260811 08:03:49.214892 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786435400844580-15507-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786435400844580-15507-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786435400844580-15507-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:45065
--webserver_interface=127.15.36.254
--webserver_port=0
--builtin_ntp_servers=127.15.36.212:43195
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.36.254:45065
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37757/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786435400844580-15507-0/testchainca.cert with env {}
W20260811 08:03:49.313681 21138 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:03:49.313963 21138 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:03:49.313989 21138 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:03:49.315579 21138 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:03:49.315659 21138 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:03:49.315673 21138 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:03:49.315686 21138 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:03:49.315699 21138 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 08:03:49.315712 21138 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 08:03:49.315724 21138 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:37757/jwks.json
I20260811 08:03:49.318398 21138 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:43195
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786435400844580-15507-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786435400844580-15507-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.36.254:45065
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:45065
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37757/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.36.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786435400844580-15507-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21138
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786435400844580-15507-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:03:49.318688 21138 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:03:49.318882 21138 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:03:49.327842 21145 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:49.327816 21147 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:03:49.327858 21138 server_base.cc:1034] running on GCE node
W20260811 08:03:49.327816 21144 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:03:49.329367 21138 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:03:49.330029 21138 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:03:49.331580 21138 hybrid_clock.cc:648] HybridClock initialized: now 1786435429331536 us; error 67 us; skew 500 ppm
I20260811 08:03:49.333443 21138 webserver.cc:460] Webserver started at http://127.15.36.254:44605/ using document root <none> and password file <none>
I20260811 08:03:49.333846 21138 fs_manager.cc:359] Metadata directory not provided
I20260811 08:03:49.333902 21138 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:03:49.334054 21138 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:03:49.335316 21138 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786435400844580-15507-0/minicluster-data/master-0/data/instance:
uuid: "26975c5c44314605abc3bfc40bbf47c3"
format_stamp: "Formatted at 2026-08-11 08:03:49 on dist-test-slave-2w3w"
server_key: "3309434181322dfd570cc2d4e25edac4"
server_key_iv: "09777d060390a5a28f8e4f8720fe7d42"
server_key_version: "encryptionkey@0"
I20260811 08:03:49.335721 21138 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786435400844580-15507-0/minicluster-data/master-0/wal/instance:
uuid: "26975c5c44314605abc3bfc40bbf47c3"
format_stamp: "Formatted at 2026-08-11 08:03:49 on dist-test-slave-2w3w"
server_key: "3309434181322dfd570cc2d4e25edac4"
server_key_iv: "09777d060390a5a28f8e4f8720fe7d42"
server_key_version: "encryptionkey@0"
I20260811 08:03:49.337387 21138 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 08:03:49.339341 21154 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:49.339797 21138 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:03:49.340381 21138 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786435400844580-15507-0/minicluster-data/master-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786435400844580-15507-0/minicluster-data/master-0/wal
uuid: "26975c5c44314605abc3bfc40bbf47c3"
format_stamp: "Formatted at 2026-08-11 08:03:49 on dist-test-slave-2w3w"
server_key: "3309434181322dfd570cc2d4e25edac4"
server_key_iv: "09777d060390a5a28f8e4f8720fe7d42"
server_key_version: "encryptionkey@0"
I20260811 08:03:49.340507 21138 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786435400844580-15507-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786435400844580-15507-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786435400844580-15507-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:03:49.351300 21138 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:03:49.351709 21138 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:03:49.351904 21138 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:03:49.357148 21138 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.254:45065
I20260811 08:03:49.357254 21209 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.254:45065 every 8 connection(s)
I20260811 08:03:49.357695 21138 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
I20260811 08:03:49.359025 21210 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:03:49.362330 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 21138
I20260811 08:03:49.362610 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786435400844580-15507-0/minicluster-data/master-0/wal/instance
I20260811 08:03:49.362533 21210 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 26975c5c44314605abc3bfc40bbf47c3: Bootstrap starting.
I20260811 08:03:49.363037 15507 external_mini_cluster.cc:1428] Setting key 1923696bab1807d77d26e8fec874f0ee
I20260811 08:03:49.363477 21210 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 26975c5c44314605abc3bfc40bbf47c3: Neither blocks nor log segments found. Creating new log.
I20260811 08:03:49.363905 21210 log.cc:824] T 00000000000000000000000000000000 P 26975c5c44314605abc3bfc40bbf47c3: Log is configured to *not* fsync() on all Append() calls
I20260811 08:03:49.364810 21210 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 26975c5c44314605abc3bfc40bbf47c3: No bootstrap required, opened a new log
I20260811 08:03:49.367347 21210 raft_consensus.cc:348] T 00000000000000000000000000000000 P 26975c5c44314605abc3bfc40bbf47c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26975c5c44314605abc3bfc40bbf47c3" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 45065 } }
I20260811 08:03:49.367592 21210 raft_consensus.cc:374] T 00000000000000000000000000000000 P 26975c5c44314605abc3bfc40bbf47c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:03:49.367627 21210 raft_consensus.cc:729] T 00000000000000000000000000000000 P 26975c5c44314605abc3bfc40bbf47c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26975c5c44314605abc3bfc40bbf47c3, State: Initialized, Role: FOLLOWER
I20260811 08:03:49.367789 21210 consensus_queue.cc:260] T 00000000000000000000000000000000 P 26975c5c44314605abc3bfc40bbf47c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26975c5c44314605abc3bfc40bbf47c3" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 45065 } }
I20260811 08:03:49.367878 21210 raft_consensus.cc:388] T 00000000000000000000000000000000 P 26975c5c44314605abc3bfc40bbf47c3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:03:49.367944 21210 raft_consensus.cc:482] T 00000000000000000000000000000000 P 26975c5c44314605abc3bfc40bbf47c3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:03:49.368000 21210 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 26975c5c44314605abc3bfc40bbf47c3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:03:49.368956 21210 raft_consensus.cc:504] T 00000000000000000000000000000000 P 26975c5c44314605abc3bfc40bbf47c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26975c5c44314605abc3bfc40bbf47c3" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 45065 } }
I20260811 08:03:49.369125 21210 leader_election.cc:302] T 00000000000000000000000000000000 P 26975c5c44314605abc3bfc40bbf47c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 26975c5c44314605abc3bfc40bbf47c3; no voters:
I20260811 08:03:49.369585 21210 leader_election.cc:288] T 00000000000000000000000000000000 P 26975c5c44314605abc3bfc40bbf47c3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:03:49.369621 21215 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 26975c5c44314605abc3bfc40bbf47c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:03:49.369758 21215 raft_consensus.cc:686] T 00000000000000000000000000000000 P 26975c5c44314605abc3bfc40bbf47c3 [term 1 LEADER]: Becoming Leader. State: Replica: 26975c5c44314605abc3bfc40bbf47c3, State: Running, Role: LEADER
I20260811 08:03:49.369879 21215 consensus_queue.cc:237] T 00000000000000000000000000000000 P 26975c5c44314605abc3bfc40bbf47c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26975c5c44314605abc3bfc40bbf47c3" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 45065 } }
I20260811 08:03:49.369956 21210 sys_catalog.cc:564] T 00000000000000000000000000000000 P 26975c5c44314605abc3bfc40bbf47c3 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:03:49.370270 21215 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26975c5c44314605abc3bfc40bbf47c3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "26975c5c44314605abc3bfc40bbf47c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26975c5c44314605abc3bfc40bbf47c3" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 45065 } } }
I20260811 08:03:49.370339 21215 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26975c5c44314605abc3bfc40bbf47c3 [sys.catalog]: This master's current role is: LEADER
I20260811 08:03:49.370522 21215 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26975c5c44314605abc3bfc40bbf47c3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 26975c5c44314605abc3bfc40bbf47c3. Latest consensus state: current_term: 1 leader_uuid: "26975c5c44314605abc3bfc40bbf47c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26975c5c44314605abc3bfc40bbf47c3" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 45065 } } }
I20260811 08:03:49.370609 21215 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26975c5c44314605abc3bfc40bbf47c3 [sys.catalog]: This master's current role is: LEADER
I20260811 08:03:49.371351 21219 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:03:49.371755 21213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:49.363716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48920 (local address 127.15.36.254:45065)
0811 08:03:49.364133 (+ 417us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:49.364141 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:49.364170 (+ 29us) server_negotiation.cc:407] Connection header received
0811 08:03:49.364680 (+ 510us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:49.364688 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:49.364757 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:49.364945 (+ 188us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:49.365212 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:49.366153 (+ 941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:49.367520 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:49.368297 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:49.368430 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:49.369667 (+ 1237us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:49.369672 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:49.369673 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:03:49.370252 (+ 579us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:49.370307 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:03:49.370325 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:49.370748 (+ 423us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:49.370786 (+ 38us) server_negotiation.cc:299] Negotiation successful
0811 08:03:49.371136 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":334,"thread_start_us":243,"threads_started":1}
I20260811 08:03:49.372541 21219 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:03:49.373450 15507 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:03:49.375252 21219 catalog_manager.cc:1347] Generated new cluster ID: 2996c5d1122f44d99e6212bc0dd41975
I20260811 08:03:49.375329 21219 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:03:49.423730 21219 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:03:49.424510 21219 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:03:49.429186 21219 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 26975c5c44314605abc3bfc40bbf47c3: Generated new TSK 0
I20260811 08:03:49.429436 21219 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260811 08:03:49.459996 21244 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260811 08:03:49.460186 21244 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260811 08:03:49.460362 21213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:49.441436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48924 (local address 127.15.36.254:45065)
0811 08:03:49.441497 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:49.441500 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:49.441574 (+ 74us) server_negotiation.cc:407] Connection header received
0811 08:03:49.441721 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:49.441722 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:49.441736 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:49.441835 (+ 99us) server_negotiation.cc:226] Negotiated authn=JWT
0811 08:03:49.442010 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:49.442905 (+ 895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:49.444150 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:49.444576 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:49.444674 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:49.445146 (+ 472us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 08:03:49.460077 (+ 14931us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37757/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0811 08:03:49.460267 (+ 190us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:48924: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37757/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":35}
W20260811 08:03:49.460458 21213 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:48924: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37757/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260811 08:03:49.461006 21243 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:03:49.441289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:45065 (local address 127.0.0.1:48924)
0811 08:03:49.441498 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:49.441510 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:49.441588 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:49.441850 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:49.441850 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:49.441852 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0811 08:03:49.441930 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:49.441932 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:49.443212 (+ 1280us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:49.443214 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:49.443957 (+ 743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:49.443960 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:49.444803 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:49.444806 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:49.444950 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:49.444985 (+ 35us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 08:03:49.460397 (+ 15412us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37757/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0811 08:03:49.460610 (+ 213us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.15.36.254:45065: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37757/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":159,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.15.36.254:45065: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37757/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260811 08:03:49.461555 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 21138
2026-08-11T08:03:49Z chronyd exiting
I20260811 08:03:49.499948 15507 test_util.cc:175] -----------------------------------------------
I20260811 08:03:49.500162 15507 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786435400844580-15507-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (299 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260811 08:03:49.501226 15507 mini_oidc.cc:152] Starting JWKS server
I20260811 08:03:49.502046 15507 webserver.cc:460] Webserver started at https://127.0.0.1:36857/ using document root <none> and password file <none>
I20260811 08:03:49.502126 15507 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 08:03:49.502318 15507 webserver.cc:460] Webserver started at http://127.0.0.1:42807/ using document root <none> and password file <none>
2026-08-11T08:03:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:03:49Z Disabled control of system clock
I20260811 08:03:49.513136 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786435400844580-15507-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786435400844580-15507-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786435400844580-15507-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:39673
--webserver_interface=127.15.36.254
--webserver_port=0
--builtin_ntp_servers=127.15.36.212:35655
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.36.254:39673
--enable_jwt_token_auth=true
--jwks_url=https://localhost:36857/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786435400844580-15507-0/testchainca.cert with env {}
W20260811 08:03:49.616102 21251 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:03:49.616358 21251 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:03:49.616384 21251 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:03:49.617784 21251 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:03:49.617895 21251 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:03:49.617910 21251 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:03:49.617924 21251 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:03:49.617937 21251 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 08:03:49.617951 21251 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 08:03:49.618155 21251 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:36857/jwks.json
I20260811 08:03:49.620342 21251 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:35655
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786435400844580-15507-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786435400844580-15507-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.36.254:39673
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:39673
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:36857/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.36.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786435400844580-15507-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21251
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786435400844580-15507-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:03:49.620700 21251 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:03:49.621169 21251 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:03:49.626848 21260 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:49.626919 21258 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:49.626848 21257 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:03:49.627935 21251 server_base.cc:1034] running on GCE node
I20260811 08:03:49.628340 21251 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:03:49.628718 21251 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:03:49.629915 21251 hybrid_clock.cc:648] HybridClock initialized: now 1786435429629890 us; error 47 us; skew 500 ppm
I20260811 08:03:49.631675 21251 webserver.cc:460] Webserver started at http://127.15.36.254:45271/ using document root <none> and password file <none>
I20260811 08:03:49.631983 21251 fs_manager.cc:359] Metadata directory not provided
I20260811 08:03:49.632062 21251 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:03:49.632223 21251 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:03:49.633626 21251 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786435400844580-15507-0/minicluster-data/master-0/data/instance:
uuid: "42e5c9dbfe3a420787624f7b7c41b9d9"
format_stamp: "Formatted at 2026-08-11 08:03:49 on dist-test-slave-2w3w"
server_key: "a0d4940c8cad0dbabaab008692d29b8f"
server_key_iv: "ee288b3bb9d25054367e290c213bc98e"
server_key_version: "encryptionkey@0"
I20260811 08:03:49.634122 21251 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786435400844580-15507-0/minicluster-data/master-0/wal/instance:
uuid: "42e5c9dbfe3a420787624f7b7c41b9d9"
format_stamp: "Formatted at 2026-08-11 08:03:49 on dist-test-slave-2w3w"
server_key: "a0d4940c8cad0dbabaab008692d29b8f"
server_key_iv: "ee288b3bb9d25054367e290c213bc98e"
server_key_version: "encryptionkey@0"
I20260811 08:03:49.635855 21251 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260811 08:03:49.637403 21266 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:49.638032 21251 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 08:03:49.638175 21251 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786435400844580-15507-0/minicluster-data/master-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786435400844580-15507-0/minicluster-data/master-0/wal
uuid: "42e5c9dbfe3a420787624f7b7c41b9d9"
format_stamp: "Formatted at 2026-08-11 08:03:49 on dist-test-slave-2w3w"
server_key: "a0d4940c8cad0dbabaab008692d29b8f"
server_key_iv: "ee288b3bb9d25054367e290c213bc98e"
server_key_version: "encryptionkey@0"
I20260811 08:03:49.638281 21251 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786435400844580-15507-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786435400844580-15507-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786435400844580-15507-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:03:49.664778 21251 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:03:49.665203 21251 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:03:49.665547 21251 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:03:49.670346 21251 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.254:39673
I20260811 08:03:49.670655 21324 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.254:39673 every 8 connection(s)
I20260811 08:03:49.670849 21251 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
I20260811 08:03:49.671885 21325 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:03:49.675559 21325 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 42e5c9dbfe3a420787624f7b7c41b9d9: Bootstrap starting.
I20260811 08:03:49.676299 21325 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 42e5c9dbfe3a420787624f7b7c41b9d9: Neither blocks nor log segments found. Creating new log.
I20260811 08:03:49.676651 21325 log.cc:824] T 00000000000000000000000000000000 P 42e5c9dbfe3a420787624f7b7c41b9d9: Log is configured to *not* fsync() on all Append() calls
I20260811 08:03:49.677681 21325 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 42e5c9dbfe3a420787624f7b7c41b9d9: No bootstrap required, opened a new log
I20260811 08:03:49.680423 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 21251
I20260811 08:03:49.680589 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786435400844580-15507-0/minicluster-data/master-0/wal/instance
I20260811 08:03:49.680430 21325 raft_consensus.cc:348] T 00000000000000000000000000000000 P 42e5c9dbfe3a420787624f7b7c41b9d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42e5c9dbfe3a420787624f7b7c41b9d9" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 39673 } }
I20260811 08:03:49.680639 21325 raft_consensus.cc:374] T 00000000000000000000000000000000 P 42e5c9dbfe3a420787624f7b7c41b9d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:03:49.680694 21325 raft_consensus.cc:729] T 00000000000000000000000000000000 P 42e5c9dbfe3a420787624f7b7c41b9d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42e5c9dbfe3a420787624f7b7c41b9d9, State: Initialized, Role: FOLLOWER
I20260811 08:03:49.680822 15507 external_mini_cluster.cc:1428] Setting key 8afebe26a687279090812aacb8f8b1a5
I20260811 08:03:49.680917 21325 consensus_queue.cc:260] T 00000000000000000000000000000000 P 42e5c9dbfe3a420787624f7b7c41b9d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42e5c9dbfe3a420787624f7b7c41b9d9" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 39673 } }
I20260811 08:03:49.681030 21325 raft_consensus.cc:388] T 00000000000000000000000000000000 P 42e5c9dbfe3a420787624f7b7c41b9d9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:03:49.681083 21325 raft_consensus.cc:482] T 00000000000000000000000000000000 P 42e5c9dbfe3a420787624f7b7c41b9d9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:03:49.681134 21325 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 42e5c9dbfe3a420787624f7b7c41b9d9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:03:49.682017 21325 raft_consensus.cc:504] T 00000000000000000000000000000000 P 42e5c9dbfe3a420787624f7b7c41b9d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42e5c9dbfe3a420787624f7b7c41b9d9" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 39673 } }
I20260811 08:03:49.682126 21325 leader_election.cc:302] T 00000000000000000000000000000000 P 42e5c9dbfe3a420787624f7b7c41b9d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 42e5c9dbfe3a420787624f7b7c41b9d9; no voters:
I20260811 08:03:49.682334 21325 leader_election.cc:288] T 00000000000000000000000000000000 P 42e5c9dbfe3a420787624f7b7c41b9d9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:03:49.682394 21331 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 42e5c9dbfe3a420787624f7b7c41b9d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:03:49.682569 21331 raft_consensus.cc:686] T 00000000000000000000000000000000 P 42e5c9dbfe3a420787624f7b7c41b9d9 [term 1 LEADER]: Becoming Leader. State: Replica: 42e5c9dbfe3a420787624f7b7c41b9d9, State: Running, Role: LEADER
I20260811 08:03:49.682662 21325 sys_catalog.cc:564] T 00000000000000000000000000000000 P 42e5c9dbfe3a420787624f7b7c41b9d9 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:03:49.682682 21331 consensus_queue.cc:237] T 00000000000000000000000000000000 P 42e5c9dbfe3a420787624f7b7c41b9d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42e5c9dbfe3a420787624f7b7c41b9d9" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 39673 } }
I20260811 08:03:49.683146 21331 sys_catalog.cc:455] T 00000000000000000000000000000000 P 42e5c9dbfe3a420787624f7b7c41b9d9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 42e5c9dbfe3a420787624f7b7c41b9d9. Latest consensus state: current_term: 1 leader_uuid: "42e5c9dbfe3a420787624f7b7c41b9d9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42e5c9dbfe3a420787624f7b7c41b9d9" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 39673 } } }
I20260811 08:03:49.683254 21331 sys_catalog.cc:458] T 00000000000000000000000000000000 P 42e5c9dbfe3a420787624f7b7c41b9d9 [sys.catalog]: This master's current role is: LEADER
I20260811 08:03:49.683177 21333 sys_catalog.cc:455] T 00000000000000000000000000000000 P 42e5c9dbfe3a420787624f7b7c41b9d9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "42e5c9dbfe3a420787624f7b7c41b9d9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42e5c9dbfe3a420787624f7b7c41b9d9" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 39673 } } }
I20260811 08:03:49.683461 21333 sys_catalog.cc:458] T 00000000000000000000000000000000 P 42e5c9dbfe3a420787624f7b7c41b9d9 [sys.catalog]: This master's current role is: LEADER
W20260811 08:03:49.685050 21347 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 42e5c9dbfe3a420787624f7b7c41b9d9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 08:03:49.685125 21347 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 08:03:49.685186 21339 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:03:49.685389 21339 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:03:49.687418 21339 catalog_manager.cc:1347] Generated new cluster ID: bab6ad29e112456d87ea3b3bc29ccf2a
I20260811 08:03:49.687496 21339 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:03:49.688565 21330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:49.681451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49340 (local address 127.15.36.254:39673)
0811 08:03:49.681736 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:49.681747 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:49.681787 (+ 40us) server_negotiation.cc:407] Connection header received
0811 08:03:49.681953 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:49.681959 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:49.682037 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:49.682235 (+ 198us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:49.682663 (+ 428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:49.684807 (+ 2144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:49.685942 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:49.686619 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:49.686778 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:49.687806 (+ 1028us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:49.687810 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:49.687810 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:03:49.688022 (+ 212us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:49.688064 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:03:49.688092 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:49.688189 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:49.688275 (+ 86us) server_negotiation.cc:299] Negotiation successful
0811 08:03:49.688366 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":189,"thread_start_us":113,"threads_started":1}
I20260811 08:03:49.689783 15507 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:03:49.709827 21339 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:03:49.710486 21339 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:03:49.714258 21339 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 42e5c9dbfe3a420787624f7b7c41b9d9: Generated new TSK 0
I20260811 08:03:49.714638 21339 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260811 08:03:49.739362 21356 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260811 08:03:49.739471 21356 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260811 08:03:49.739842 21330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:49.723719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49356 (local address 127.15.36.254:39673)
0811 08:03:49.723790 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:49.723792 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:49.723958 (+ 166us) server_negotiation.cc:407] Connection header received
0811 08:03:49.724018 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:49.724019 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:49.724034 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:49.724123 (+ 89us) server_negotiation.cc:226] Negotiated authn=JWT
0811 08:03:49.724300 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:49.724937 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:49.726266 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:49.726517 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:49.726591 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:49.726863 (+ 272us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 08:03:49.739635 (+ 12772us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36857/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0811 08:03:49.739783 (+ 148us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:49356: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36857/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":40}
W20260811 08:03:49.739919 21330 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:49356: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36857/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260811 08:03:49.740068 21355 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:03:49.723632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:39673 (local address 127.0.0.1:49356)
0811 08:03:49.723826 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:49.723843 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:49.723937 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:49.724151 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:49.724152 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:49.724154 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0811 08:03:49.724224 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:49.724227 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:49.725036 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:49.725037 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:49.726121 (+ 1084us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:49.726125 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:49.726623 (+ 498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:49.726624 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:49.726703 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:49.726710 (+ 7us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 08:03:49.739779 (+ 13069us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36857/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0811 08:03:49.739955 (+ 176us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.15.36.254:39673: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36857/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":114,"threads_started":1}
I20260811 08:03:49.740538 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 21251
2026-08-11T08:03:49Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (281 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260811 08:03:49.783130 15507 mini_oidc.cc:152] Starting JWKS server
I20260811 08:03:49.783958 15507 webserver.cc:460] Webserver started at https://127.0.0.1:45803/ using document root <none> and password file <none>
I20260811 08:03:49.784008 15507 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 08:03:49.784215 15507 webserver.cc:460] Webserver started at http://127.0.0.1:43777/ using document root <none> and password file <none>
2026-08-11T08:03:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:03:49Z Disabled control of system clock
I20260811 08:03:49.795742 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786435400844580-15507-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786435400844580-15507-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786435400844580-15507-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:43133
--webserver_interface=127.15.36.254
--webserver_port=0
--builtin_ntp_servers=127.15.36.212:35217
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.36.254:43133
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45803/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260811 08:03:49.893559 21362 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:03:49.893901 21362 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:03:49.893963 21362 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:03:49.895605 21362 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:03:49.895701 21362 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:03:49.895740 21362 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:03:49.895774 21362 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:03:49.895812 21362 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 08:03:49.895841 21362 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 08:03:49.895872 21362 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:45803/jwks.json
I20260811 08:03:49.897727 21362 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:35217
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786435400844580-15507-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786435400844580-15507-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.36.254:43133
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:43133
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45803/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.36.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21362
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786435400844580-15507-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:03:49.898087 21362 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:03:49.898468 21362 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:03:49.904392 21368 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:49.904395 21372 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:03:49.904458 21362 server_base.cc:1034] running on GCE node
W20260811 08:03:49.904392 21369 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:03:49.905043 21362 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:03:49.905385 21362 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:03:49.906561 21362 hybrid_clock.cc:648] HybridClock initialized: now 1786435429906535 us; error 42 us; skew 500 ppm
I20260811 08:03:49.908322 21362 webserver.cc:460] Webserver started at http://127.15.36.254:36495/ using document root <none> and password file <none>
I20260811 08:03:49.908654 21362 fs_manager.cc:359] Metadata directory not provided
I20260811 08:03:49.908751 21362 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:03:49.908933 21362 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:03:49.910272 21362 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786435400844580-15507-0/minicluster-data/master-0/data/instance:
uuid: "deb9484a92c2497da8bd8e1d62d6aeaf"
format_stamp: "Formatted at 2026-08-11 08:03:49 on dist-test-slave-2w3w"
server_key: "2508d0d3956bf929afaf39fb8f1f5127"
server_key_iv: "373b9f55cd598e2a6f919e650cf83adc"
server_key_version: "encryptionkey@0"
I20260811 08:03:49.910722 21362 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786435400844580-15507-0/minicluster-data/master-0/wal/instance:
uuid: "deb9484a92c2497da8bd8e1d62d6aeaf"
format_stamp: "Formatted at 2026-08-11 08:03:49 on dist-test-slave-2w3w"
server_key: "2508d0d3956bf929afaf39fb8f1f5127"
server_key_iv: "373b9f55cd598e2a6f919e650cf83adc"
server_key_version: "encryptionkey@0"
I20260811 08:03:49.912536 21362 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260811 08:03:49.913643 21378 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:49.913941 21362 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:03:49.914072 21362 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786435400844580-15507-0/minicluster-data/master-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786435400844580-15507-0/minicluster-data/master-0/wal
uuid: "deb9484a92c2497da8bd8e1d62d6aeaf"
format_stamp: "Formatted at 2026-08-11 08:03:49 on dist-test-slave-2w3w"
server_key: "2508d0d3956bf929afaf39fb8f1f5127"
server_key_iv: "373b9f55cd598e2a6f919e650cf83adc"
server_key_version: "encryptionkey@0"
I20260811 08:03:49.914167 21362 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786435400844580-15507-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786435400844580-15507-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786435400844580-15507-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:03:49.928381 21362 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:03:49.928777 21362 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:03:49.928969 21362 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:03:49.933993 21362 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.254:43133
I20260811 08:03:49.934041 21439 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.254:43133 every 8 connection(s)
I20260811 08:03:49.934504 21362 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
I20260811 08:03:49.935627 21440 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:03:49.938639 21440 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P deb9484a92c2497da8bd8e1d62d6aeaf: Bootstrap starting.
I20260811 08:03:49.939366 21440 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P deb9484a92c2497da8bd8e1d62d6aeaf: Neither blocks nor log segments found. Creating new log.
I20260811 08:03:49.939618 21440 log.cc:824] T 00000000000000000000000000000000 P deb9484a92c2497da8bd8e1d62d6aeaf: Log is configured to *not* fsync() on all Append() calls
I20260811 08:03:49.940483 21440 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P deb9484a92c2497da8bd8e1d62d6aeaf: No bootstrap required, opened a new log
I20260811 08:03:49.942401 21440 raft_consensus.cc:348] T 00000000000000000000000000000000 P deb9484a92c2497da8bd8e1d62d6aeaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "deb9484a92c2497da8bd8e1d62d6aeaf" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 43133 } }
I20260811 08:03:49.942584 21440 raft_consensus.cc:374] T 00000000000000000000000000000000 P deb9484a92c2497da8bd8e1d62d6aeaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:03:49.942612 21440 raft_consensus.cc:729] T 00000000000000000000000000000000 P deb9484a92c2497da8bd8e1d62d6aeaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: deb9484a92c2497da8bd8e1d62d6aeaf, State: Initialized, Role: FOLLOWER
I20260811 08:03:49.942998 21440 consensus_queue.cc:260] T 00000000000000000000000000000000 P deb9484a92c2497da8bd8e1d62d6aeaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "deb9484a92c2497da8bd8e1d62d6aeaf" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 43133 } }
I20260811 08:03:49.943113 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 21362
I20260811 08:03:49.943158 21440 raft_consensus.cc:388] T 00000000000000000000000000000000 P deb9484a92c2497da8bd8e1d62d6aeaf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:03:49.943207 21440 raft_consensus.cc:482] T 00000000000000000000000000000000 P deb9484a92c2497da8bd8e1d62d6aeaf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:03:49.943216 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786435400844580-15507-0/minicluster-data/master-0/wal/instance
I20260811 08:03:49.943264 21440 raft_consensus.cc:3037] T 00000000000000000000000000000000 P deb9484a92c2497da8bd8e1d62d6aeaf [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:03:49.943423 15507 external_mini_cluster.cc:1428] Setting key 0f22faf9bf41d303858513d1a5357b0d
I20260811 08:03:49.944262 21440 raft_consensus.cc:504] T 00000000000000000000000000000000 P deb9484a92c2497da8bd8e1d62d6aeaf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "deb9484a92c2497da8bd8e1d62d6aeaf" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 43133 } }
I20260811 08:03:49.944415 21440 leader_election.cc:302] T 00000000000000000000000000000000 P deb9484a92c2497da8bd8e1d62d6aeaf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: deb9484a92c2497da8bd8e1d62d6aeaf; no voters:
I20260811 08:03:49.944576 21440 leader_election.cc:288] T 00000000000000000000000000000000 P deb9484a92c2497da8bd8e1d62d6aeaf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:03:49.944638 21445 raft_consensus.cc:2781] T 00000000000000000000000000000000 P deb9484a92c2497da8bd8e1d62d6aeaf [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:03:49.944821 21445 raft_consensus.cc:686] T 00000000000000000000000000000000 P deb9484a92c2497da8bd8e1d62d6aeaf [term 1 LEADER]: Becoming Leader. State: Replica: deb9484a92c2497da8bd8e1d62d6aeaf, State: Running, Role: LEADER
I20260811 08:03:49.944862 21440 sys_catalog.cc:564] T 00000000000000000000000000000000 P deb9484a92c2497da8bd8e1d62d6aeaf [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:03:49.944921 21445 consensus_queue.cc:237] T 00000000000000000000000000000000 P deb9484a92c2497da8bd8e1d62d6aeaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "deb9484a92c2497da8bd8e1d62d6aeaf" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 43133 } }
I20260811 08:03:49.945300 21445 sys_catalog.cc:455] T 00000000000000000000000000000000 P deb9484a92c2497da8bd8e1d62d6aeaf [sys.catalog]: SysCatalogTable state changed. Reason: New leader deb9484a92c2497da8bd8e1d62d6aeaf. Latest consensus state: current_term: 1 leader_uuid: "deb9484a92c2497da8bd8e1d62d6aeaf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "deb9484a92c2497da8bd8e1d62d6aeaf" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 43133 } } }
I20260811 08:03:49.945396 21445 sys_catalog.cc:458] T 00000000000000000000000000000000 P deb9484a92c2497da8bd8e1d62d6aeaf [sys.catalog]: This master's current role is: LEADER
I20260811 08:03:49.945307 21446 sys_catalog.cc:455] T 00000000000000000000000000000000 P deb9484a92c2497da8bd8e1d62d6aeaf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "deb9484a92c2497da8bd8e1d62d6aeaf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "deb9484a92c2497da8bd8e1d62d6aeaf" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 43133 } } }
I20260811 08:03:49.945559 21446 sys_catalog.cc:458] T 00000000000000000000000000000000 P deb9484a92c2497da8bd8e1d62d6aeaf [sys.catalog]: This master's current role is: LEADER
I20260811 08:03:49.945617 21450 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:03:49.946162 21450 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:03:49.948030 21450 catalog_manager.cc:1347] Generated new cluster ID: 6a921609aae64b6ca988aa9fb19e5418
I20260811 08:03:49.948096 21450 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:03:49.950850 21444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:49.944303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38548 (local address 127.15.36.254:43133)
0811 08:03:49.944577 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:49.944588 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:49.944626 (+ 38us) server_negotiation.cc:407] Connection header received
0811 08:03:49.944766 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:49.944774 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:49.944858 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:49.945322 (+ 464us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:49.945442 (+ 120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:49.947582 (+ 2140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:49.948623 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:49.949150 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:49.949308 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:49.950096 (+ 788us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:49.950100 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:49.950101 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:03:49.950300 (+ 199us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:49.950336 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:03:49.950351 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:49.950435 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:49.950517 (+ 82us) server_negotiation.cc:299] Negotiation successful
0811 08:03:49.950610 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":96,"threads_started":1}
I20260811 08:03:49.952299 15507 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:03:49.953709 21450 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:03:49.954504 21450 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:03:49.969473 21450 catalog_manager.cc:5868] T 00000000000000000000000000000000 P deb9484a92c2497da8bd8e1d62d6aeaf: Generated new TSK 0
I20260811 08:03:49.969736 21450 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:03:49.990006 21444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:49.984550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38554 (local address 127.15.36.254:43133)
0811 08:03:49.984628 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:49.984631 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:49.984813 (+ 182us) server_negotiation.cc:407] Connection header received
0811 08:03:49.985075 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:49.985076 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:49.985102 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:49.985176 (+ 74us) server_negotiation.cc:226] Negotiated authn=JWT
0811 08:03:49.985389 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:49.986034 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:49.987538 (+ 1504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:49.987961 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:49.988045 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:49.988351 (+ 306us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 08:03:49.989733 (+ 1382us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45803/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0811 08:03:49.989908 (+ 175us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:38554: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45803/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":45}
W20260811 08:03:49.990089 21444 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:38554: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45803/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260811 08:03:49.990121 21471 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:03:49.984476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:43133 (local address 127.0.0.1:38554)
0811 08:03:49.984695 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:49.984710 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:49.984885 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:49.985194 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:49.985195 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:49.985198 (+ 3us) client_negotiation.cc:189] Negotiated authn=JWT
0811 08:03:49.985268 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:49.985271 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:49.986151 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:49.986152 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:49.987284 (+ 1132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:49.987289 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:49.988078 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:49.988079 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:49.988153 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:49.988161 (+ 8us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 08:03:49.989881 (+ 1720us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45803/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0811 08:03:49.990013 (+ 132us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.15.36.254:43133: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45803/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":172,"threads_started":1}
I20260811 08:03:49.990420 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 21362
E20260811 08:03:50.013077 21472 webserver.cc:533] Webserver: sslize failed:
E20260811 08:03:50.013195 21472 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-11T08:03:50Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (256 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-11T08:03:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:03:50Z Disabled control of system clock
I20260811 08:03:50.050203 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786435400844580-15507-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786435400844580-15507-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786435400844580-15507-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:46223
--webserver_interface=127.15.36.254
--webserver_port=0
--builtin_ntp_servers=127.15.36.212:39099
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.36.254:46223
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786435400844580-15507-0/testchainca.cert with env {}
W20260811 08:03:50.142673 21477 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:03:50.142937 21477 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:03:50.142997 21477 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:03:50.144265 21477 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:03:50.144315 21477 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:03:50.144330 21477 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:03:50.144341 21477 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:03:50.144353 21477 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 08:03:50.144366 21477 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 08:03:50.144378 21477 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260811 08:03:50.146023 21477 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:39099
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786435400844580-15507-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786435400844580-15507-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.36.254:46223
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:46223
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.36.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786435400844580-15507-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21477
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786435400844580-15507-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:03:50.146338 21477 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:03:50.146536 21477 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:03:50.152186 21485 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:50.152189 21483 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:50.152189 21482 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:03:50.152617 21477 server_base.cc:1034] running on GCE node
I20260811 08:03:50.152957 21477 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:03:50.153301 21477 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:03:50.154493 21477 hybrid_clock.cc:648] HybridClock initialized: now 1786435430154471 us; error 53 us; skew 500 ppm
I20260811 08:03:50.156190 21477 webserver.cc:460] Webserver started at http://127.15.36.254:38275/ using document root <none> and password file <none>
I20260811 08:03:50.156493 21477 fs_manager.cc:359] Metadata directory not provided
I20260811 08:03:50.156570 21477 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:03:50.156730 21477 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:03:50.158432 21477 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786435400844580-15507-0/minicluster-data/master-0/data/instance:
uuid: "0c1f5c4afe584e21a319c5345f94dd74"
format_stamp: "Formatted at 2026-08-11 08:03:50 on dist-test-slave-2w3w"
server_key: "b1b57169eecea07bedec228f86d90be1"
server_key_iv: "49cac986da5440d9781d0feff3a5b767"
server_key_version: "encryptionkey@0"
I20260811 08:03:50.158897 21477 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786435400844580-15507-0/minicluster-data/master-0/wal/instance:
uuid: "0c1f5c4afe584e21a319c5345f94dd74"
format_stamp: "Formatted at 2026-08-11 08:03:50 on dist-test-slave-2w3w"
server_key: "b1b57169eecea07bedec228f86d90be1"
server_key_iv: "49cac986da5440d9781d0feff3a5b767"
server_key_version: "encryptionkey@0"
I20260811 08:03:50.160665 21477 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:03:50.161624 21491 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:50.161866 21477 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:03:50.161986 21477 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786435400844580-15507-0/minicluster-data/master-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786435400844580-15507-0/minicluster-data/master-0/wal
uuid: "0c1f5c4afe584e21a319c5345f94dd74"
format_stamp: "Formatted at 2026-08-11 08:03:50 on dist-test-slave-2w3w"
server_key: "b1b57169eecea07bedec228f86d90be1"
server_key_iv: "49cac986da5440d9781d0feff3a5b767"
server_key_version: "encryptionkey@0"
I20260811 08:03:50.162071 21477 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786435400844580-15507-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786435400844580-15507-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786435400844580-15507-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:03:50.185169 21477 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:03:50.185690 21477 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:03:50.186115 21477 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:03:50.191923 21477 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.254:46223
I20260811 08:03:50.191951 21551 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.254:46223 every 8 connection(s)
I20260811 08:03:50.192433 21477 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
I20260811 08:03:50.193583 21552 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:03:50.197286 21552 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c1f5c4afe584e21a319c5345f94dd74: Bootstrap starting.
I20260811 08:03:50.197314 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 21477
I20260811 08:03:50.197422 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786435400844580-15507-0/minicluster-data/master-0/wal/instance
I20260811 08:03:50.197611 15507 external_mini_cluster.cc:1428] Setting key 9b9f5b43c4e48a51c7c608a5acf321cb
I20260811 08:03:50.198216 21552 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0c1f5c4afe584e21a319c5345f94dd74: Neither blocks nor log segments found. Creating new log.
I20260811 08:03:50.198629 21552 log.cc:824] T 00000000000000000000000000000000 P 0c1f5c4afe584e21a319c5345f94dd74: Log is configured to *not* fsync() on all Append() calls
I20260811 08:03:50.199445 21552 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c1f5c4afe584e21a319c5345f94dd74: No bootstrap required, opened a new log
I20260811 08:03:50.201700 21552 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0c1f5c4afe584e21a319c5345f94dd74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c1f5c4afe584e21a319c5345f94dd74" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 46223 } }
I20260811 08:03:50.201932 21552 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0c1f5c4afe584e21a319c5345f94dd74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:03:50.201965 21552 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0c1f5c4afe584e21a319c5345f94dd74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c1f5c4afe584e21a319c5345f94dd74, State: Initialized, Role: FOLLOWER
I20260811 08:03:50.202106 21552 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0c1f5c4afe584e21a319c5345f94dd74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c1f5c4afe584e21a319c5345f94dd74" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 46223 } }
I20260811 08:03:50.202203 21552 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0c1f5c4afe584e21a319c5345f94dd74 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:03:50.202229 21552 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0c1f5c4afe584e21a319c5345f94dd74 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:03:50.202299 21552 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0c1f5c4afe584e21a319c5345f94dd74 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:03:50.203140 21552 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0c1f5c4afe584e21a319c5345f94dd74 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c1f5c4afe584e21a319c5345f94dd74" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 46223 } }
I20260811 08:03:50.203265 21552 leader_election.cc:302] T 00000000000000000000000000000000 P 0c1f5c4afe584e21a319c5345f94dd74 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0c1f5c4afe584e21a319c5345f94dd74; no voters:
I20260811 08:03:50.203508 21552 leader_election.cc:288] T 00000000000000000000000000000000 P 0c1f5c4afe584e21a319c5345f94dd74 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:03:50.203533 21558 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0c1f5c4afe584e21a319c5345f94dd74 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:03:50.203646 21558 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0c1f5c4afe584e21a319c5345f94dd74 [term 1 LEADER]: Becoming Leader. State: Replica: 0c1f5c4afe584e21a319c5345f94dd74, State: Running, Role: LEADER
I20260811 08:03:50.203738 21558 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0c1f5c4afe584e21a319c5345f94dd74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c1f5c4afe584e21a319c5345f94dd74" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 46223 } }
I20260811 08:03:50.203809 21552 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0c1f5c4afe584e21a319c5345f94dd74 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:03:50.204311 21558 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c1f5c4afe584e21a319c5345f94dd74 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0c1f5c4afe584e21a319c5345f94dd74" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c1f5c4afe584e21a319c5345f94dd74" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 46223 } } }
I20260811 08:03:50.204527 21558 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c1f5c4afe584e21a319c5345f94dd74 [sys.catalog]: This master's current role is: LEADER
I20260811 08:03:50.204670 21558 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c1f5c4afe584e21a319c5345f94dd74 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0c1f5c4afe584e21a319c5345f94dd74. Latest consensus state: current_term: 1 leader_uuid: "0c1f5c4afe584e21a319c5345f94dd74" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c1f5c4afe584e21a319c5345f94dd74" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 46223 } } }
I20260811 08:03:50.204737 21558 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c1f5c4afe584e21a319c5345f94dd74 [sys.catalog]: This master's current role is: LEADER
I20260811 08:03:50.204375 21556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:50.198216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46918 (local address 127.15.36.254:46223)
0811 08:03:50.198510 (+ 294us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:50.198518 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:50.198542 (+ 24us) server_negotiation.cc:407] Connection header received
0811 08:03:50.199303 (+ 761us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:50.199311 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:50.199375 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:50.199497 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:50.199823 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:50.200699 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:50.201895 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:50.202610 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:50.202716 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:50.203605 (+ 889us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:50.203610 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:50.203610 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:03:50.203860 (+ 250us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:50.203911 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:03:50.203926 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:50.203988 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:50.204068 (+ 80us) server_negotiation.cc:299] Negotiation successful
0811 08:03:50.204195 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":207,"thread_start_us":164,"threads_started":1}
I20260811 08:03:50.205199 21567 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:03:50.205780 15507 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:03:50.205916 21567 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:03:50.208014 21567 catalog_manager.cc:1347] Generated new cluster ID: f9f412481a09442987bba6512e024bf0
I20260811 08:03:50.208091 21567 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:03:50.216332 21567 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:03:50.217088 21567 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:03:50.226538 21567 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0c1f5c4afe584e21a319c5345f94dd74: Generated new TSK 0
I20260811 08:03:50.226784 21567 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:03:50.338613 21556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:50.232826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46924 (local address 127.15.36.254:46223)
0811 08:03:50.232911 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:50.232914 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:50.233051 (+ 137us) server_negotiation.cc:407] Connection header received
0811 08:03:50.233108 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:50.233109 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:50.233122 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:50.233214 (+ 92us) server_negotiation.cc:226] Negotiated authn=JWT
0811 08:03:50.233443 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:50.234270 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:50.235522 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:50.235848 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:50.235929 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:50.236168 (+ 239us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 08:03:50.338302 (+102134us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0811 08:03:50.338507 (+ 205us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:46924: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":57}
W20260811 08:03:50.338703 21556 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:46924: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260811 08:03:50.338809 21585 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:03:50.232691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:46223 (local address 127.0.0.1:46924)
0811 08:03:50.232857 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:50.232965 (+ 108us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:50.233047 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:50.233264 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:50.233265 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:50.233268 (+ 3us) client_negotiation.cc:189] Negotiated authn=JWT
0811 08:03:50.233356 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:50.233358 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:50.234438 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:50.234439 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:50.235408 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:50.235412 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:50.235956 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:50.235957 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:50.236031 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:50.236037 (+ 6us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 08:03:50.338481 (+102444us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0811 08:03:50.338684 (+ 203us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.15.36.254:46223: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":92,"threads_started":1}
I20260811 08:03:50.339069 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 21477
2026-08-11T08:03:50Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (323 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (105 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (107 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:03:50 dist-test-slave-2w3w krb5kdc[21597](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:03:50 dist-test-slave-2w3w krb5kdc[21597](info): set up 2 sockets
Aug 11 08:03:50 dist-test-slave-2w3w krb5kdc[21597](info): commencing operation
krb5kdc: starting...
W20260811 08:03:51.786535 15507 mini_kdc.cc:121] Time spent starting KDC: real 1.211s user 0.002s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Aug 11 08:03:51 dist-test-slave-2w3w krb5kdc[21597](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435431, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:03:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:03:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.36.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab.
Entry for principal kudu/127.15.36.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab.
I20260811 08:03:51.936228 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:42721
--webserver_interface=127.15.36.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=kudu/127.15.36.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:43465
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.36.254:42721
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:03:52.026232 21611 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:03:52.026501 21611 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:03:52.026528 21611 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:03:52.028213 21611 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:03:52.028679 21611 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:03:52.028738 21611 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:03:52.028754 21611 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:03:52.028769 21611 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:03:52.030758 21611 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:43465
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.36.254:42721
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=kudu/127.15.36.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:42721
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.36.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21611
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:03:52.031476 21611 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:03:52.031780 21611 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:03:52.037343 21620 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:52.037348 21618 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:52.037350 21617 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:03:52.037662 21611 server_base.cc:1034] running on GCE node
I20260811 08:03:52.038012 21611 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:03:52.038358 21611 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:03:52.039558 21611 hybrid_clock.cc:648] HybridClock initialized: now 1786435432039548 us; error 48 us; skew 500 ppm
Aug 11 08:03:52 dist-test-slave-2w3w krb5kdc[21597](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435432, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:03:52.042702 21611 init.cc:377] Logged in from keytab as kudu/127.15.36.254@KRBTEST.COM (short username kudu)
I20260811 08:03:52.043346 21611 webserver.cc:460] Webserver started at http://127.15.36.254:43657/ using document root <none> and password file <none>
I20260811 08:03:52.043617 21611 fs_manager.cc:359] Metadata directory not provided
I20260811 08:03:52.043691 21611 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:03:52.043912 21611 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:03:52.045178 21611 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/minicluster-data/master-0/data/instance:
uuid: "e7e0c47f074d4ed7b8abdd513e40564b"
format_stamp: "Formatted at 2026-08-11 08:03:52 on dist-test-slave-2w3w"
server_key: "d450333cd1c2dbcd8c04d4e76af89880"
server_key_iv: "be098af87adecf5591f56a84be098ede"
server_key_version: "encryptionkey@0"
I20260811 08:03:52.045583 21611 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/minicluster-data/master-0/wal/instance:
uuid: "e7e0c47f074d4ed7b8abdd513e40564b"
format_stamp: "Formatted at 2026-08-11 08:03:52 on dist-test-slave-2w3w"
server_key: "d450333cd1c2dbcd8c04d4e76af89880"
server_key_iv: "be098af87adecf5591f56a84be098ede"
server_key_version: "encryptionkey@0"
I20260811 08:03:52.047227 21611 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 08:03:52.048173 21629 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:52.048419 21611 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:03:52.048543 21611 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/minicluster-data/master-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/minicluster-data/master-0/wal
uuid: "e7e0c47f074d4ed7b8abdd513e40564b"
format_stamp: "Formatted at 2026-08-11 08:03:52 on dist-test-slave-2w3w"
server_key: "d450333cd1c2dbcd8c04d4e76af89880"
server_key_iv: "be098af87adecf5591f56a84be098ede"
server_key_version: "encryptionkey@0"
I20260811 08:03:52.048632 21611 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:03:52.061957 21611 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:03:52.065346 21611 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:03:52.065574 21611 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:03:52.070079 21611 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.254:42721
I20260811 08:03:52.070170 21684 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.254:42721 every 8 connection(s)
I20260811 08:03:52.070566 21611 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
I20260811 08:03:52.071659 21685 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:03:52.072685 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 21611
I20260811 08:03:52.072827 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/minicluster-data/master-0/wal/instance
I20260811 08:03:52.073211 15507 external_mini_cluster.cc:1428] Setting key fe7a1916fbe8f1e7a62efecd40d2b2aa
I20260811 08:03:52.074609 21685 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e7e0c47f074d4ed7b8abdd513e40564b: Bootstrap starting.
I20260811 08:03:52.075444 21685 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e7e0c47f074d4ed7b8abdd513e40564b: Neither blocks nor log segments found. Creating new log.
I20260811 08:03:52.075764 21685 log.cc:824] T 00000000000000000000000000000000 P e7e0c47f074d4ed7b8abdd513e40564b: Log is configured to *not* fsync() on all Append() calls
I20260811 08:03:52.076545 21685 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e7e0c47f074d4ed7b8abdd513e40564b: No bootstrap required, opened a new log
I20260811 08:03:52.078406 21685 raft_consensus.cc:348] T 00000000000000000000000000000000 P e7e0c47f074d4ed7b8abdd513e40564b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7e0c47f074d4ed7b8abdd513e40564b" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 42721 } }
I20260811 08:03:52.078586 21685 raft_consensus.cc:374] T 00000000000000000000000000000000 P e7e0c47f074d4ed7b8abdd513e40564b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:03:52.078636 21685 raft_consensus.cc:729] T 00000000000000000000000000000000 P e7e0c47f074d4ed7b8abdd513e40564b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7e0c47f074d4ed7b8abdd513e40564b, State: Initialized, Role: FOLLOWER
I20260811 08:03:52.078804 21685 consensus_queue.cc:260] T 00000000000000000000000000000000 P e7e0c47f074d4ed7b8abdd513e40564b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7e0c47f074d4ed7b8abdd513e40564b" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 42721 } }
I20260811 08:03:52.078902 21685 raft_consensus.cc:388] T 00000000000000000000000000000000 P e7e0c47f074d4ed7b8abdd513e40564b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:03:52.078939 21685 raft_consensus.cc:482] T 00000000000000000000000000000000 P e7e0c47f074d4ed7b8abdd513e40564b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:03:52.079030 21685 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e7e0c47f074d4ed7b8abdd513e40564b [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:03:52.080577 21685 raft_consensus.cc:504] T 00000000000000000000000000000000 P e7e0c47f074d4ed7b8abdd513e40564b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7e0c47f074d4ed7b8abdd513e40564b" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 42721 } }
I20260811 08:03:52.080991 21685 leader_election.cc:302] T 00000000000000000000000000000000 P e7e0c47f074d4ed7b8abdd513e40564b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e7e0c47f074d4ed7b8abdd513e40564b; no voters:
I20260811 08:03:52.081496 21685 leader_election.cc:288] T 00000000000000000000000000000000 P e7e0c47f074d4ed7b8abdd513e40564b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:03:52.081594 21691 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e7e0c47f074d4ed7b8abdd513e40564b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:03:52.082006 21691 raft_consensus.cc:686] T 00000000000000000000000000000000 P e7e0c47f074d4ed7b8abdd513e40564b [term 1 LEADER]: Becoming Leader. State: Replica: e7e0c47f074d4ed7b8abdd513e40564b, State: Running, Role: LEADER
I20260811 08:03:52.082229 21685 sys_catalog.cc:564] T 00000000000000000000000000000000 P e7e0c47f074d4ed7b8abdd513e40564b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:03:52.082231 21691 consensus_queue.cc:237] T 00000000000000000000000000000000 P e7e0c47f074d4ed7b8abdd513e40564b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7e0c47f074d4ed7b8abdd513e40564b" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 42721 } }
Aug 11 08:03:52 dist-test-slave-2w3w krb5kdc[21597](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435431, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:03:52.083082 21694 sys_catalog.cc:455] T 00000000000000000000000000000000 P e7e0c47f074d4ed7b8abdd513e40564b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e7e0c47f074d4ed7b8abdd513e40564b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7e0c47f074d4ed7b8abdd513e40564b" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 42721 } } }
I20260811 08:03:52.083217 21694 sys_catalog.cc:458] T 00000000000000000000000000000000 P e7e0c47f074d4ed7b8abdd513e40564b [sys.catalog]: This master's current role is: LEADER
I20260811 08:03:52.083101 21693 sys_catalog.cc:455] T 00000000000000000000000000000000 P e7e0c47f074d4ed7b8abdd513e40564b [sys.catalog]: SysCatalogTable state changed. Reason: New leader e7e0c47f074d4ed7b8abdd513e40564b. Latest consensus state: current_term: 1 leader_uuid: "e7e0c47f074d4ed7b8abdd513e40564b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7e0c47f074d4ed7b8abdd513e40564b" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 42721 } } }
I20260811 08:03:52.083456 21693 sys_catalog.cc:458] T 00000000000000000000000000000000 P e7e0c47f074d4ed7b8abdd513e40564b [sys.catalog]: This master's current role is: LEADER
I20260811 08:03:52.083595 21703 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:03:52.084182 21703 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:03:52.086028 21714 mvcc.cc:205] Tried to move back new op lower bound from 7317239529821704192 to 7317239529809981440. Current Snapshot: MvccSnapshot[applied={T|T < 7317239529821704192}]
I20260811 08:03:52.086479 21703 catalog_manager.cc:1347] Generated new cluster ID: 7626fead95574434adbdc517f47dfc60
I20260811 08:03:52.086540 21703 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:03:52.087684 21689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:52.073968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52934 (local address 127.15.36.254:42721)
0811 08:03:52.074312 (+ 344us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:52.074323 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:52.074358 (+ 35us) server_negotiation.cc:407] Connection header received
0811 08:03:52.075001 (+ 643us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:52.075013 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:52.075088 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:52.075251 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:52.076071 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:52.077149 (+ 1078us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:52.078170 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:52.078682 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:52.078829 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:52.083599 (+ 4770us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:52.083604 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:52.083605 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:52.083619 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:52.085707 (+ 2088us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:52.086243 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:52.086247 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:52.086248 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:52.086369 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:52.086601 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:52.086602 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:52.086602 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:52.086948 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:52.087157 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:52.087295 (+ 138us) server_negotiation.cc:299] Negotiation successful
0811 08:03:52.087456 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":189,"thread_start_us":161,"threads_started":1}
I20260811 08:03:52.092869 21703 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:03:52.093487 21703 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:03:52.102254 21703 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e7e0c47f074d4ed7b8abdd513e40564b: Generated new TSK 0
I20260811 08:03:52.102509 21703 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.36.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab.
Entry for principal kudu/127.15.36.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab.
I20260811 08:03:52.145009 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.193:0
--local_ip_for_outbound_sockets=127.15.36.193
--webserver_interface=127.15.36.193
--webserver_port=0
--tserver_master_addrs=127.15.36.254:42721
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab
--principal=kudu/127.15.36.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:43465
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:03:52.235276 21718 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:03:52.235523 21718 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:03:52.235553 21718 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:03:52.236905 21718 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:03:52.236967 21718 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:03:52.236999 21718 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.193
I20260811 08:03:52.239192 21718 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:43465
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab
--principal=kudu/127.15.36.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.36.193
--webserver_port=0
--tserver_master_addrs=127.15.36.254:42721
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21718
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.193
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:03:52.239516 21718 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:03:52.239795 21718 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 08:03:52.248202 21718 server_base.cc:1034] running on GCE node
W20260811 08:03:52.248178 21727 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:52.248176 21725 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:52.248183 21724 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:03:52.248649 21718 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:03:52.248963 21718 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:03:52.250166 21718 hybrid_clock.cc:648] HybridClock initialized: now 1786435432250128 us; error 91 us; skew 500 ppm
Aug 11 08:03:52 dist-test-slave-2w3w krb5kdc[21597](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435432, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:03:52.253661 21718 init.cc:377] Logged in from keytab as kudu/127.15.36.193@KRBTEST.COM (short username kudu)
I20260811 08:03:52.254195 21718 webserver.cc:460] Webserver started at http://127.15.36.193:41661/ using document root <none> and password file <none>
I20260811 08:03:52.254451 21718 fs_manager.cc:359] Metadata directory not provided
I20260811 08:03:52.254503 21718 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:03:52.254644 21718 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:03:52.255929 21718 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/minicluster-data/ts-0/data/instance:
uuid: "a24a3fccaa9e467982c462bfc081625b"
format_stamp: "Formatted at 2026-08-11 08:03:52 on dist-test-slave-2w3w"
server_key: "75ee0b0002515bba8fbc96302f717ad2"
server_key_iv: "f7477785aab5481d529554b01327d6e5"
server_key_version: "encryptionkey@0"
I20260811 08:03:52.256317 21718 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/minicluster-data/ts-0/wal/instance:
uuid: "a24a3fccaa9e467982c462bfc081625b"
format_stamp: "Formatted at 2026-08-11 08:03:52 on dist-test-slave-2w3w"
server_key: "75ee0b0002515bba8fbc96302f717ad2"
server_key_iv: "f7477785aab5481d529554b01327d6e5"
server_key_version: "encryptionkey@0"
I20260811 08:03:52.257836 21718 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 08:03:52.258896 21734 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:52.259646 21718 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:03:52.259755 21718 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/minicluster-data/ts-0/wal
uuid: "a24a3fccaa9e467982c462bfc081625b"
format_stamp: "Formatted at 2026-08-11 08:03:52 on dist-test-slave-2w3w"
server_key: "75ee0b0002515bba8fbc96302f717ad2"
server_key_iv: "f7477785aab5481d529554b01327d6e5"
server_key_version: "encryptionkey@0"
I20260811 08:03:52.259822 21718 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:03:52.270273 21718 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:03:52.273305 21718 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:03:52.273458 21718 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:03:52.273685 21718 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:03:52.274187 21718 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:03:52.274236 21718 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:52.274266 21718 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:03:52.274309 21718 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:52.281651 21718 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.193:40473
I20260811 08:03:52.281690 21856 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.193:40473 every 8 connection(s)
I20260811 08:03:52.282140 21718 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
Aug 11 08:03:52 dist-test-slave-2w3w krb5kdc[21597](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435432, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.193@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:03:52.292274 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 21718
I20260811 08:03:52.292431 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/minicluster-data/ts-0/wal/instance
I20260811 08:03:52.292670 15507 external_mini_cluster.cc:1428] Setting key 5fc4212a287b7190a596bc1a055b50f8
I20260811 08:03:52.294358 21689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:52.283384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:35445 (local address 127.15.36.254:42721)
0811 08:03:52.283561 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:52.283564 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:52.283660 (+ 96us) server_negotiation.cc:407] Connection header received
0811 08:03:52.284869 (+ 1209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:52.284870 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:52.284884 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:52.284954 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:52.285659 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:52.286213 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:52.287430 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:52.287652 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:52.287723 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:52.290447 (+ 2724us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:52.290449 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:52.290449 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:52.290457 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:52.292264 (+ 1807us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:52.292964 (+ 700us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:52.292966 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:52.292966 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:52.293047 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:52.293540 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:52.293541 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:52.293542 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:52.293721 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:52.293800 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:52.294099 (+ 299us) server_negotiation.cc:299] Negotiation successful
0811 08:03:52.294209 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145}
I20260811 08:03:52.294445 21860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:52.283323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:42721 (local address 127.15.36.193:35445)
0811 08:03:52.283518 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:52.283564 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:52.284748 (+ 1184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:52.285036 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:52.285040 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:52.285333 (+ 293us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:03:52.285548 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:52.285553 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:52.286337 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:52.286338 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:52.287314 (+ 976us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:52.287318 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:52.287766 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:52.287767 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:52.287950 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:52.288644 (+ 694us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:03:52.288653 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:03:52.290304 (+ 1651us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:03:52.292397 (+ 2093us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:52.292412 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:52.292415 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:52.292804 (+ 389us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:52.293244 (+ 440us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:52.293245 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:52.293245 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:52.293438 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:52.293799 (+ 361us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:03:52.293805 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:03:52.293950 (+ 145us) client_negotiation.cc:769] Sending connection context
0811 08:03:52.294048 (+ 98us) client_negotiation.cc:240] Negotiation successful
0811 08:03:52.294203 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":111,"threads_started":1}
I20260811 08:03:52.295050 21857 heartbeater.cc:347] Connected to a master server at 127.15.36.254:42721
I20260811 08:03:52.295174 21857 heartbeater.cc:464] Registering TS with master...
I20260811 08:03:52.295383 21857 heartbeater.cc:511] Master 127.15.36.254:42721 requested a full tablet report, sending...
I20260811 08:03:52.296083 21647 ts_manager.cc:194] Registered new tserver with Master: a24a3fccaa9e467982c462bfc081625b (127.15.36.193:40473)
I20260811 08:03:52.296769 21647 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.36.193@KRBTEST.COM'} at 127.15.36.193:35445
WARNING: no policy specified for kudu/127.15.36.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab.
Entry for principal kudu/127.15.36.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab.
I20260811 08:03:52.332628 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.194:0
--local_ip_for_outbound_sockets=127.15.36.194
--webserver_interface=127.15.36.194
--webserver_port=0
--tserver_master_addrs=127.15.36.254:42721
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab
--principal=kudu/127.15.36.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:43465
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:03:52.427213 21864 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:03:52.427490 21864 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:03:52.427521 21864 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:03:52.429035 21864 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:03:52.429095 21864 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:03:52.429129 21864 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.194
I20260811 08:03:52.431313 21864 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:43465
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab
--principal=kudu/127.15.36.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.36.194
--webserver_port=0
--tserver_master_addrs=127.15.36.254:42721
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21864
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.194
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:03:52.431656 21864 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:03:52.431948 21864 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:03:52.438275 21869 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:52.438268 21872 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:52.438275 21870 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:03:52.438484 21864 server_base.cc:1034] running on GCE node
I20260811 08:03:52.438843 21864 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:03:52.439153 21864 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:03:52.440380 21864 hybrid_clock.cc:648] HybridClock initialized: now 1786435432440374 us; error 40 us; skew 500 ppm
Aug 11 08:03:52 dist-test-slave-2w3w krb5kdc[21597](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435432, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:03:52.446707 21864 init.cc:377] Logged in from keytab as kudu/127.15.36.194@KRBTEST.COM (short username kudu)
I20260811 08:03:52.447293 21864 webserver.cc:460] Webserver started at http://127.15.36.194:37735/ using document root <none> and password file <none>
I20260811 08:03:52.447523 21864 fs_manager.cc:359] Metadata directory not provided
I20260811 08:03:52.447570 21864 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:03:52.447674 21864 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:03:52.448823 21864 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/minicluster-data/ts-1/data/instance:
uuid: "be9efd1231c643269ad1eb1fc6c49594"
format_stamp: "Formatted at 2026-08-11 08:03:52 on dist-test-slave-2w3w"
server_key: "374a68b1edbd24e1f872e87231f8f87c"
server_key_iv: "3f67bbebefa67b801c5dd2deefee1fd3"
server_key_version: "encryptionkey@0"
I20260811 08:03:52.449172 21864 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/minicluster-data/ts-1/wal/instance:
uuid: "be9efd1231c643269ad1eb1fc6c49594"
format_stamp: "Formatted at 2026-08-11 08:03:52 on dist-test-slave-2w3w"
server_key: "374a68b1edbd24e1f872e87231f8f87c"
server_key_iv: "3f67bbebefa67b801c5dd2deefee1fd3"
server_key_version: "encryptionkey@0"
I20260811 08:03:52.450718 21864 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 08:03:52.451792 21879 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:52.452275 21864 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:03:52.452389 21864 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/minicluster-data/ts-1/wal
uuid: "be9efd1231c643269ad1eb1fc6c49594"
format_stamp: "Formatted at 2026-08-11 08:03:52 on dist-test-slave-2w3w"
server_key: "374a68b1edbd24e1f872e87231f8f87c"
server_key_iv: "3f67bbebefa67b801c5dd2deefee1fd3"
server_key_version: "encryptionkey@0"
I20260811 08:03:52.452507 21864 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:03:52.465363 21864 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:03:52.468225 21864 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:03:52.468410 21864 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:03:52.468705 21864 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:03:52.469050 21864 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:03:52.469084 21864 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:52.469108 21864 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:03:52.469152 21864 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:52.476322 21864 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.194:44103
I20260811 08:03:52.476426 22003 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.194:44103 every 8 connection(s)
I20260811 08:03:52.476760 21864 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
I20260811 08:03:52.479363 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 21864
I20260811 08:03:52.479496 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/minicluster-data/ts-1/wal/instance
I20260811 08:03:52.479761 15507 external_mini_cluster.cc:1428] Setting key 1d60429bc7970ecbd258c2581bd2d256
Aug 11 08:03:52 dist-test-slave-2w3w krb5kdc[21597](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435432, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.194@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:03:52.490558 21689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:52.477735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:57719 (local address 127.15.36.254:42721)
0811 08:03:52.477806 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:52.477809 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:52.478059 (+ 250us) server_negotiation.cc:407] Connection header received
0811 08:03:52.479108 (+ 1049us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:52.479109 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:52.479136 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:52.479190 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:52.480151 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:52.480781 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:52.482418 (+ 1637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:52.482703 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:52.482774 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:52.485977 (+ 3203us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:52.485979 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:52.485979 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:52.485989 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:52.488675 (+ 2686us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:52.489256 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:52.489258 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:52.489259 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:52.489348 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:52.489674 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:52.489675 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:52.489675 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:52.489924 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:52.490013 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:52.490330 (+ 317us) server_negotiation.cc:299] Negotiation successful
0811 08:03:52.490433 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 08:03:52.490710 22006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:52.477725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:42721 (local address 127.15.36.194:57719)
0811 08:03:52.477889 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:52.477929 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:52.478911 (+ 982us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:52.479274 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:52.479280 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:52.479738 (+ 458us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:03:52.480045 (+ 307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:52.480051 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:52.480914 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:52.480915 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:52.482288 (+ 1373us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:52.482293 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:52.482818 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:52.482819 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:52.483101 (+ 282us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:52.483952 (+ 851us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:03:52.483965 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:03:52.485843 (+ 1878us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:03:52.488804 (+ 2961us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:52.488817 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:52.488819 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:52.489149 (+ 330us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:52.489454 (+ 305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:52.489455 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:52.489455 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:52.489586 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:52.490019 (+ 433us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:03:52.490025 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:03:52.490177 (+ 152us) client_negotiation.cc:769] Sending connection context
0811 08:03:52.490276 (+ 99us) client_negotiation.cc:240] Negotiation successful
0811 08:03:52.490470 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":99,"threads_started":1}
I20260811 08:03:52.491444 22004 heartbeater.cc:347] Connected to a master server at 127.15.36.254:42721
I20260811 08:03:52.491569 22004 heartbeater.cc:464] Registering TS with master...
I20260811 08:03:52.491789 22004 heartbeater.cc:511] Master 127.15.36.254:42721 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.15.36.195@KRBTEST.COM; defaulting to no policy
I20260811 08:03:52.492236 21647 ts_manager.cc:194] Registered new tserver with Master: be9efd1231c643269ad1eb1fc6c49594 (127.15.36.194:44103)
I20260811 08:03:52.492637 21647 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.36.194@KRBTEST.COM'} at 127.15.36.194:57719
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab.
Entry for principal kudu/127.15.36.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab.
I20260811 08:03:52.523968 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.195:0
--local_ip_for_outbound_sockets=127.15.36.195
--webserver_interface=127.15.36.195
--webserver_port=0
--tserver_master_addrs=127.15.36.254:42721
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab
--principal=kudu/127.15.36.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:43465
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:03:52.619556 22013 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:03:52.619812 22013 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:03:52.619839 22013 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:03:52.621196 22013 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:03:52.621261 22013 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:03:52.621292 22013 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.195
I20260811 08:03:52.623246 22013 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:43465
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab
--principal=kudu/127.15.36.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.36.195
--webserver_port=0
--tserver_master_addrs=127.15.36.254:42721
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22013
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.195
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:03:52.623515 22013 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:03:52.623751 22013 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:03:52.629772 22019 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:52.629807 22021 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:52.629809 22018 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:03:52.630173 22013 server_base.cc:1034] running on GCE node
I20260811 08:03:52.630421 22013 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:03:52.630728 22013 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:03:52.631896 22013 hybrid_clock.cc:648] HybridClock initialized: now 1786435432631880 us; error 37 us; skew 500 ppm
Aug 11 08:03:52 dist-test-slave-2w3w krb5kdc[21597](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435432, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:03:52.635038 22013 init.cc:377] Logged in from keytab as kudu/127.15.36.195@KRBTEST.COM (short username kudu)
I20260811 08:03:52.635557 22013 webserver.cc:460] Webserver started at http://127.15.36.195:35061/ using document root <none> and password file <none>
I20260811 08:03:52.635826 22013 fs_manager.cc:359] Metadata directory not provided
I20260811 08:03:52.635901 22013 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:03:52.636062 22013 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:03:52.637188 22013 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/minicluster-data/ts-2/data/instance:
uuid: "309e6195e2124234b8b4338f90c17785"
format_stamp: "Formatted at 2026-08-11 08:03:52 on dist-test-slave-2w3w"
server_key: "d73b7af2a061549740b9773fc1c6a09a"
server_key_iv: "2e3a20cadd36853638d21b3b6ecbca7f"
server_key_version: "encryptionkey@0"
I20260811 08:03:52.637579 22013 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/minicluster-data/ts-2/wal/instance:
uuid: "309e6195e2124234b8b4338f90c17785"
format_stamp: "Formatted at 2026-08-11 08:03:52 on dist-test-slave-2w3w"
server_key: "d73b7af2a061549740b9773fc1c6a09a"
server_key_iv: "2e3a20cadd36853638d21b3b6ecbca7f"
server_key_version: "encryptionkey@0"
I20260811 08:03:52.639184 22013 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 08:03:52.640290 22028 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:52.640653 22013 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:03:52.640784 22013 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/minicluster-data/ts-2/wal
uuid: "309e6195e2124234b8b4338f90c17785"
format_stamp: "Formatted at 2026-08-11 08:03:52 on dist-test-slave-2w3w"
server_key: "d73b7af2a061549740b9773fc1c6a09a"
server_key_iv: "2e3a20cadd36853638d21b3b6ecbca7f"
server_key_version: "encryptionkey@0"
I20260811 08:03:52.640900 22013 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:03:52.656200 22013 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:03:52.658766 22013 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:03:52.658999 22013 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:03:52.659293 22013 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:03:52.659641 22013 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:03:52.659696 22013 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:52.659742 22013 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:03:52.659768 22013 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:52.666263 22013 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.195:40659
I20260811 08:03:52.666364 22155 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.195:40659 every 8 connection(s)
I20260811 08:03:52.666708 22013 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
I20260811 08:03:52.671542 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 22013
I20260811 08:03:52.671659 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/minicluster-data/ts-2/wal/instance
I20260811 08:03:52.671901 15507 external_mini_cluster.cc:1428] Setting key fd1150d88a4b7ebd6a935d15ebec8ab0
Aug 11 08:03:52 dist-test-slave-2w3w krb5kdc[21597](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435432, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.195@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:03:52.679003 21689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:52.667633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:43727 (local address 127.15.36.254:42721)
0811 08:03:52.667710 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:52.667712 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:52.667967 (+ 255us) server_negotiation.cc:407] Connection header received
0811 08:03:52.668967 (+ 1000us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:52.668969 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:52.668986 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:52.669053 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:52.670019 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:52.670593 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:52.672625 (+ 2032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:52.672973 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:52.673060 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:52.675814 (+ 2754us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:52.675816 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:52.675817 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:52.675827 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:52.677312 (+ 1485us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:52.677832 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:52.677834 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:52.677834 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:52.677905 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:52.678226 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:52.678227 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:52.678227 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:52.678369 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:52.678454 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:52.678766 (+ 312us) server_negotiation.cc:299] Negotiation successful
0811 08:03:52.678862 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 08:03:52.679374 22160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:52.667597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:42721 (local address 127.15.36.195:43727)
0811 08:03:52.667812 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:52.667852 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:52.668830 (+ 978us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:52.669248 (+ 418us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:52.669252 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:52.669583 (+ 331us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:03:52.669828 (+ 245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:52.669837 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:52.670758 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:52.670759 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:52.672474 (+ 1715us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:52.672478 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:52.673083 (+ 605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:52.673084 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:52.673272 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:52.673919 (+ 647us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:03:52.673928 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:03:52.675677 (+ 1749us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:03:52.677445 (+ 1768us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:52.677456 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:52.677459 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:52.677740 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:52.678028 (+ 288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:52.678034 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:52.678034 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:52.678155 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:52.678442 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:03:52.678450 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:03:52.678619 (+ 169us) client_negotiation.cc:769] Sending connection context
0811 08:03:52.678742 (+ 123us) client_negotiation.cc:240] Negotiation successful
0811 08:03:52.678933 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":102,"threads_started":1}
I20260811 08:03:52.679943 22156 heartbeater.cc:347] Connected to a master server at 127.15.36.254:42721
I20260811 08:03:52.680250 22156 heartbeater.cc:464] Registering TS with master...
I20260811 08:03:52.680449 22156 heartbeater.cc:511] Master 127.15.36.254:42721 requested a full tablet report, sending...
I20260811 08:03:52.680948 21647 ts_manager.cc:194] Registered new tserver with Master: 309e6195e2124234b8b4338f90c17785 (127.15.36.195:40659)
I20260811 08:03:52.681450 21647 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.36.195@KRBTEST.COM'} at 127.15.36.195:43727
I20260811 08:03:52.684788 15507 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/krb5kdc/test-admin.keytab.
Aug 11 08:03:52 dist-test-slave-2w3w krb5kdc[21597](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435432, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:03:52.709024 15507 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260811 08:03:52.711681 22166 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:03:52.710260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45672 (local address 127.15.36.193:40473)
0811 08:03:52.710475 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:52.710479 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:52.710491 (+ 12us) server_negotiation.cc:407] Connection header received
0811 08:03:52.710518 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:52.710520 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:52.710535 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:52.710755 (+ 220us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:52.711563 (+ 808us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45672: BlockingRecv error: recv got EOF from 127.0.0.1:45672 (error 108)
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":90,"threads_started":1}
W20260811 08:03:52.711793 15507 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/krb5kdc/krb5cc' of type FILE
Aug 11 08:03:52 dist-test-slave-2w3w krb5kdc[21597](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435432, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:03:52.713085 15507 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 08:03:52 dist-test-slave-2w3w krb5kdc[21597](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435432, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:03:52.714226 15507 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 08:03:52 dist-test-slave-2w3w krb5kdc[21597](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435432, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.36.193@KRBTEST.COM
I20260811 08:03:52.723555 22166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:52.714937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45684 (local address 127.15.36.193:40473)
0811 08:03:52.715115 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:52.715117 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:52.715127 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:03:52.715152 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:52.715153 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:52.715164 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:52.715227 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:52.715715 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:52.716534 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:52.717377 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:52.717718 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:52.717783 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:52.720398 (+ 2615us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:52.720411 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:52.720412 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:52.720423 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:52.722152 (+ 1729us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:52.722537 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:52.722540 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:52.722540 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:52.722602 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:52.722777 (+ 175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:52.722777 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:52.722778 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:52.723023 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:52.723163 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:52.723323 (+ 160us) server_negotiation.cc:299] Negotiation successful
0811 08:03:52.723401 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140}
W20260811 08:03:52.725672 22166 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:03:52.725043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45698 (local address 127.15.36.193:40473)
0811 08:03:52.725130 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:52.725132 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:52.725162 (+ 30us) server_negotiation.cc:407] Connection header received
0811 08:03:52.725181 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:52.725182 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:52.725195 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:52.725240 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:52.725615 (+ 375us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45698: BlockingRecv error: recv got EOF from 127.0.0.1:45698 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
W20260811 08:03:52.725724 15507 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/krb5kdc/krb5cc' of type FILE
Aug 11 08:03:52 dist-test-slave-2w3w krb5kdc[21597](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435432, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:03:52.727162 15507 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 08:03:52 dist-test-slave-2w3w krb5kdc[21597](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435432, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:03:52.728559 15507 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 08:03:52 dist-test-slave-2w3w krb5kdc[21597](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435432, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.36.193@KRBTEST.COM
I20260811 08:03:52.737859 22166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:52.729453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45710 (local address 127.15.36.193:40473)
0811 08:03:52.729574 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:52.729576 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:52.729661 (+ 85us) server_negotiation.cc:407] Connection header received
0811 08:03:52.729772 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:52.729773 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:52.729786 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:52.729839 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:52.730492 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:52.731196 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:52.731975 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:52.732194 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:52.732287 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:52.734797 (+ 2510us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:52.734799 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:52.734799 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:52.734810 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:52.736599 (+ 1789us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:52.737024 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:52.737025 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:52.737025 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:52.737092 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:52.737317 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:52.737318 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:52.737318 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:52.737440 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:52.737552 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:52.737659 (+ 107us) server_negotiation.cc:299] Negotiation successful
0811 08:03:52.737754 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
W20260811 08:03:52.740167 22166 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:03:52.739439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45718 (local address 127.15.36.193:40473)
0811 08:03:52.739503 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:52.739505 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:52.739539 (+ 34us) server_negotiation.cc:407] Connection header received
0811 08:03:52.739616 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:52.739616 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:52.739626 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:52.739675 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:52.740111 (+ 436us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45718: BlockingRecv error: recv got EOF from 127.0.0.1:45718 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
W20260811 08:03:52.740477 15507 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786435400844580-15507-0/krb5kdc/krb5cc' of type FILE
Aug 11 08:03:52 dist-test-slave-2w3w krb5kdc[21597](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435432, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:03:52.741708 15507 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 08:03:52 dist-test-slave-2w3w krb5kdc[21597](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435432, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:03:52.742884 15507 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 08:03:52 dist-test-slave-2w3w krb5kdc[21597](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435432, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.36.193@KRBTEST.COM
I20260811 08:03:52.751673 22166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:52.743679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45722 (local address 127.15.36.193:40473)
0811 08:03:52.743753 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:52.743755 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:52.743769 (+ 14us) server_negotiation.cc:407] Connection header received
0811 08:03:52.743835 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:52.743836 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:52.743846 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:52.743945 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:52.744434 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:52.745020 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:52.745897 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:52.746100 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:52.746166 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:52.748604 (+ 2438us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:52.748606 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:52.748607 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:52.748615 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:52.750462 (+ 1847us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:52.750856 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:52.750857 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:52.750857 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:52.750914 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:52.751219 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:52.751220 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:52.751220 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:52.751332 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:52.751412 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:52.751529 (+ 117us) server_negotiation.cc:299] Negotiation successful
0811 08:03:52.751599 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 08:03:52.753610 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 21718
I20260811 08:03:52.762400 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 21864
I20260811 08:03:52.773469 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 22013
I20260811 08:03:52.781461 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 21611
2026-08-11T08:03:52Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2231 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:03:52 dist-test-slave-2w3w krb5kdc[22180](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:03:52 dist-test-slave-2w3w krb5kdc[22180](info): set up 2 sockets
Aug 11 08:03:52 dist-test-slave-2w3w krb5kdc[22180](info): commencing operation
krb5kdc: starting...
W20260811 08:03:53.988499 15507 mini_kdc.cc:121] Time spent starting KDC: real 1.182s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Aug 11 08:03:54 dist-test-slave-2w3w krb5kdc[22180](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435434, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:03:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:03:54Z Disabled control of system clock
WARNING: no policy specified for oryx/127.15.36.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.36.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.36.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/krb5kdc/oryx_127.15.36.254.keytab.
Entry for principal oryx/127.15.36.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/krb5kdc/oryx_127.15.36.254.keytab.
I20260811 08:03:54.174307 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:38213
--webserver_interface=127.15.36.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/krb5kdc/oryx_127.15.36.254.keytab
--principal=oryx/127.15.36.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:42827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.36.254:38213
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:03:54.268522 22194 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:03:54.268790 22194 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:03:54.268818 22194 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:03:54.270169 22194 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:03:54.270234 22194 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:03:54.270251 22194 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:03:54.270264 22194 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:03:54.270277 22194 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:03:54.272122 22194 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:42827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.36.254:38213
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/krb5kdc/oryx_127.15.36.254.keytab
--principal=oryx/127.15.36.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:38213
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.36.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22194
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:03:54.272439 22194 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:03:54.272703 22194 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 08:03:54.278731 22194 server_base.cc:1034] running on GCE node
W20260811 08:03:54.278676 22203 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:54.278676 22200 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:54.278676 22201 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:03:54.279431 22194 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:03:54.279765 22194 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:03:54.280968 22194 hybrid_clock.cc:648] HybridClock initialized: now 1786435434280955 us; error 49 us; skew 500 ppm
Aug 11 08:03:54 dist-test-slave-2w3w krb5kdc[22180](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435434, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.36.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:03:54.284262 22194 init.cc:377] Logged in from keytab as oryx/127.15.36.254@KRBTEST.COM (short username oryx)
I20260811 08:03:54.284811 22194 webserver.cc:460] Webserver started at http://127.15.36.254:36587/ using document root <none> and password file <none>
I20260811 08:03:54.285043 22194 fs_manager.cc:359] Metadata directory not provided
I20260811 08:03:54.285087 22194 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:03:54.285188 22194 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:03:54.286455 22194 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/master-0/data/instance:
uuid: "d27dfc74df774f2f8f479ece768c55ae"
format_stamp: "Formatted at 2026-08-11 08:03:54 on dist-test-slave-2w3w"
server_key: "3751bca951bd8557d0014f233e2754b5"
server_key_iv: "e15b4aef3f12f5872596cf225772d530"
server_key_version: "encryptionkey@0"
I20260811 08:03:54.286800 22194 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/master-0/wal/instance:
uuid: "d27dfc74df774f2f8f479ece768c55ae"
format_stamp: "Formatted at 2026-08-11 08:03:54 on dist-test-slave-2w3w"
server_key: "3751bca951bd8557d0014f233e2754b5"
server_key_iv: "e15b4aef3f12f5872596cf225772d530"
server_key_version: "encryptionkey@0"
I20260811 08:03:54.288537 22194 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260811 08:03:54.289502 22211 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:54.289767 22194 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:03:54.289891 22194 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/master-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/master-0/wal
uuid: "d27dfc74df774f2f8f479ece768c55ae"
format_stamp: "Formatted at 2026-08-11 08:03:54 on dist-test-slave-2w3w"
server_key: "3751bca951bd8557d0014f233e2754b5"
server_key_iv: "e15b4aef3f12f5872596cf225772d530"
server_key_version: "encryptionkey@0"
I20260811 08:03:54.290167 22194 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:03:54.304054 22194 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:03:54.307571 22194 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:03:54.307802 22194 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:03:54.314558 22194 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.254:38213
I20260811 08:03:54.314679 22270 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.254:38213 every 8 connection(s)
I20260811 08:03:54.315152 22194 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
I20260811 08:03:54.316512 22271 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:03:54.319132 22271 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d27dfc74df774f2f8f479ece768c55ae: Bootstrap starting.
I20260811 08:03:54.319849 22271 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d27dfc74df774f2f8f479ece768c55ae: Neither blocks nor log segments found. Creating new log.
I20260811 08:03:54.320161 22271 log.cc:824] T 00000000000000000000000000000000 P d27dfc74df774f2f8f479ece768c55ae: Log is configured to *not* fsync() on all Append() calls
I20260811 08:03:54.321197 22271 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d27dfc74df774f2f8f479ece768c55ae: No bootstrap required, opened a new log
I20260811 08:03:54.322158 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 22194
I20260811 08:03:54.322424 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/master-0/wal/instance
I20260811 08:03:54.322654 15507 external_mini_cluster.cc:1428] Setting key 1d7b96837b97af7dfa2b6509140d7e9f
I20260811 08:03:54.325071 22271 raft_consensus.cc:348] T 00000000000000000000000000000000 P d27dfc74df774f2f8f479ece768c55ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d27dfc74df774f2f8f479ece768c55ae" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38213 } }
I20260811 08:03:54.325266 22271 raft_consensus.cc:374] T 00000000000000000000000000000000 P d27dfc74df774f2f8f479ece768c55ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:03:54.325290 22271 raft_consensus.cc:729] T 00000000000000000000000000000000 P d27dfc74df774f2f8f479ece768c55ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d27dfc74df774f2f8f479ece768c55ae, State: Initialized, Role: FOLLOWER
I20260811 08:03:54.325448 22271 consensus_queue.cc:260] T 00000000000000000000000000000000 P d27dfc74df774f2f8f479ece768c55ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d27dfc74df774f2f8f479ece768c55ae" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38213 } }
I20260811 08:03:54.325532 22271 raft_consensus.cc:388] T 00000000000000000000000000000000 P d27dfc74df774f2f8f479ece768c55ae [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:03:54.325567 22271 raft_consensus.cc:482] T 00000000000000000000000000000000 P d27dfc74df774f2f8f479ece768c55ae [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:03:54.325656 22271 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d27dfc74df774f2f8f479ece768c55ae [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:03:54.326635 22271 raft_consensus.cc:504] T 00000000000000000000000000000000 P d27dfc74df774f2f8f479ece768c55ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d27dfc74df774f2f8f479ece768c55ae" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38213 } }
I20260811 08:03:54.326745 22271 leader_election.cc:302] T 00000000000000000000000000000000 P d27dfc74df774f2f8f479ece768c55ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d27dfc74df774f2f8f479ece768c55ae; no voters:
I20260811 08:03:54.327064 22271 leader_election.cc:288] T 00000000000000000000000000000000 P d27dfc74df774f2f8f479ece768c55ae [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:03:54.327108 22276 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d27dfc74df774f2f8f479ece768c55ae [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:03:54.327236 22276 raft_consensus.cc:686] T 00000000000000000000000000000000 P d27dfc74df774f2f8f479ece768c55ae [term 1 LEADER]: Becoming Leader. State: Replica: d27dfc74df774f2f8f479ece768c55ae, State: Running, Role: LEADER
I20260811 08:03:54.327401 22271 sys_catalog.cc:564] T 00000000000000000000000000000000 P d27dfc74df774f2f8f479ece768c55ae [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:03:54.327405 22276 consensus_queue.cc:237] T 00000000000000000000000000000000 P d27dfc74df774f2f8f479ece768c55ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d27dfc74df774f2f8f479ece768c55ae" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38213 } }
I20260811 08:03:54.328117 22278 sys_catalog.cc:455] T 00000000000000000000000000000000 P d27dfc74df774f2f8f479ece768c55ae [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d27dfc74df774f2f8f479ece768c55ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d27dfc74df774f2f8f479ece768c55ae" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38213 } } }
I20260811 08:03:54.328329 22278 sys_catalog.cc:458] T 00000000000000000000000000000000 P d27dfc74df774f2f8f479ece768c55ae [sys.catalog]: This master's current role is: LEADER
I20260811 08:03:54.328383 22280 sys_catalog.cc:455] T 00000000000000000000000000000000 P d27dfc74df774f2f8f479ece768c55ae [sys.catalog]: SysCatalogTable state changed. Reason: New leader d27dfc74df774f2f8f479ece768c55ae. Latest consensus state: current_term: 1 leader_uuid: "d27dfc74df774f2f8f479ece768c55ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d27dfc74df774f2f8f479ece768c55ae" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38213 } } }
I20260811 08:03:54.328545 22280 sys_catalog.cc:458] T 00000000000000000000000000000000 P d27dfc74df774f2f8f479ece768c55ae [sys.catalog]: This master's current role is: LEADER
W20260811 08:03:54.329977 22296 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d27dfc74df774f2f8f479ece768c55ae: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 08:03:54.330049 22296 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 08:03:54.330098 22284 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:03:54.330287 22284 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:03:54.332084 22284 catalog_manager.cc:1347] Generated new cluster ID: db71382509734f74afa8ec085bf13168
I20260811 08:03:54.332144 22284 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 08:03:54 dist-test-slave-2w3w krb5kdc[22180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435434, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM
I20260811 08:03:54.338320 22284 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:03:54.339075 22284 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:03:54.339697 22275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:54.323536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54284 (local address 127.15.36.254:38213)
0811 08:03:54.323781 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:54.323791 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:54.323829 (+ 38us) server_negotiation.cc:407] Connection header received
0811 08:03:54.325162 (+ 1333us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:54.325177 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:54.325250 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:54.325490 (+ 240us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:54.326542 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:54.328379 (+ 1837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:54.329543 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:54.330188 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:54.330326 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:54.333775 (+ 3449us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:54.333781 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:54.333781 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:54.333797 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:54.336195 (+ 2398us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:54.336684 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:54.336688 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:54.336688 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:54.336823 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:54.337158 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:54.337159 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:54.337159 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:54.337714 (+ 555us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:54.339187 (+ 1473us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:54.339279 (+ 92us) server_negotiation.cc:299] Negotiation successful
0811 08:03:54.339471 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":184,"thread_start_us":110,"threads_started":1}
I20260811 08:03:54.344918 22284 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d27dfc74df774f2f8f479ece768c55ae: Generated new TSK 0
I20260811 08:03:54.345165 22284 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.15.36.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.36.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.36.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/krb5kdc/oryx_127.15.36.193.keytab.
Entry for principal oryx/127.15.36.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/krb5kdc/oryx_127.15.36.193.keytab.
I20260811 08:03:54.399497 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.193:0
--local_ip_for_outbound_sockets=127.15.36.193
--webserver_interface=127.15.36.193
--webserver_port=0
--tserver_master_addrs=127.15.36.254:38213
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/krb5kdc/oryx_127.15.36.193.keytab
--principal=oryx/127.15.36.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:42827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:03:54.495541 22302 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:03:54.495795 22302 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:03:54.495826 22302 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:03:54.497223 22302 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:03:54.497282 22302 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:03:54.497316 22302 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.193
I20260811 08:03:54.498934 22302 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:42827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/krb5kdc/oryx_127.15.36.193.keytab
--principal=oryx/127.15.36.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.36.193
--webserver_port=0
--tserver_master_addrs=127.15.36.254:38213
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22302
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.193
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:03:54.499205 22302 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:03:54.499431 22302 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:03:54.505566 22308 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:54.505568 22313 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:54.505568 22309 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:03:54.505861 22302 server_base.cc:1034] running on GCE node
I20260811 08:03:54.506345 22302 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:03:54.506767 22302 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:03:54.508069 22302 hybrid_clock.cc:648] HybridClock initialized: now 1786435434508026 us; error 46 us; skew 500 ppm
Aug 11 08:03:54 dist-test-slave-2w3w krb5kdc[22180](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435434, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.36.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:03:54.511422 22302 init.cc:377] Logged in from keytab as oryx/127.15.36.193@KRBTEST.COM (short username oryx)
I20260811 08:03:54.511973 22302 webserver.cc:460] Webserver started at http://127.15.36.193:41233/ using document root <none> and password file <none>
I20260811 08:03:54.512487 22302 fs_manager.cc:359] Metadata directory not provided
I20260811 08:03:54.512727 22302 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:03:54.512876 22302 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:03:54.514317 22302 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-0/data/instance:
uuid: "cd701cdf69504752aa640a88a90093d6"
format_stamp: "Formatted at 2026-08-11 08:03:54 on dist-test-slave-2w3w"
server_key: "9a71ca3be861f92f95ee9aca6bf22c60"
server_key_iv: "3a5a0d8b2c609a5b4e8a867b4443096d"
server_key_version: "encryptionkey@0"
I20260811 08:03:54.514662 22302 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-0/wal/instance:
uuid: "cd701cdf69504752aa640a88a90093d6"
format_stamp: "Formatted at 2026-08-11 08:03:54 on dist-test-slave-2w3w"
server_key: "9a71ca3be861f92f95ee9aca6bf22c60"
server_key_iv: "3a5a0d8b2c609a5b4e8a867b4443096d"
server_key_version: "encryptionkey@0"
I20260811 08:03:54.517114 22302 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260811 08:03:54.518235 22320 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:54.518491 22302 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:03:54.518586 22302 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-0/wal
uuid: "cd701cdf69504752aa640a88a90093d6"
format_stamp: "Formatted at 2026-08-11 08:03:54 on dist-test-slave-2w3w"
server_key: "9a71ca3be861f92f95ee9aca6bf22c60"
server_key_iv: "3a5a0d8b2c609a5b4e8a867b4443096d"
server_key_version: "encryptionkey@0"
I20260811 08:03:54.518659 22302 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:03:54.527508 22302 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:03:54.530496 22302 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:03:54.530642 22302 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:03:54.530885 22302 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:03:54.531297 22302 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:03:54.531337 22302 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:54.531386 22302 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:03:54.531416 22302 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:54.538868 22302 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.193:38419
I20260811 08:03:54.538910 22449 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.193:38419 every 8 connection(s)
I20260811 08:03:54.539372 22302 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
I20260811 08:03:54.548460 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 22302
I20260811 08:03:54.548589 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-0/wal/instance
Aug 11 08:03:54 dist-test-slave-2w3w krb5kdc[22180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435434, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.36.193@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM
I20260811 08:03:54.548945 15507 external_mini_cluster.cc:1428] Setting key b05be011c24bd305bfc4b0e041d8064a
I20260811 08:03:54.554020 22275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:54.540553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:57469 (local address 127.15.36.254:38213)
0811 08:03:54.540623 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:54.540625 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:54.540887 (+ 262us) server_negotiation.cc:407] Connection header received
0811 08:03:54.541424 (+ 537us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:54.541426 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:54.541438 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:54.541537 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:54.542679 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:54.543360 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:54.545048 (+ 1688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:54.545293 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:54.545385 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:54.549992 (+ 4607us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:54.549994 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:54.549995 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:54.550007 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:54.551974 (+ 1967us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:54.552696 (+ 722us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:54.552697 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:54.552698 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:54.552789 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:54.553137 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:54.553138 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:54.553139 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:54.553317 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:54.553408 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:54.553753 (+ 345us) server_negotiation.cc:299] Negotiation successful
0811 08:03:54.553868 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 08:03:54.554275 22452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:54.540472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:38213 (local address 127.15.36.193:57469)
0811 08:03:54.540679 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:54.540731 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:54.541292 (+ 561us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:54.541656 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:54.541660 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:54.542342 (+ 682us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:03:54.542552 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:54.542558 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:54.543484 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:54.543485 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:54.544879 (+ 1394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:54.544883 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:54.545427 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:54.545428 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:54.545612 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:54.546355 (+ 743us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:03:54.546365 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:03:54.549789 (+ 3424us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:03:54.552244 (+ 2455us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:54.552260 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:54.552263 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:54.552596 (+ 333us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:54.552908 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:54.552909 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:54.552910 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:54.553056 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:54.553428 (+ 372us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:03:54.553435 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:03:54.553581 (+ 146us) client_negotiation.cc:769] Sending connection context
0811 08:03:54.553707 (+ 126us) client_negotiation.cc:240] Negotiation successful
0811 08:03:54.553910 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":113,"threads_started":1}
I20260811 08:03:54.555243 22450 heartbeater.cc:347] Connected to a master server at 127.15.36.254:38213
I20260811 08:03:54.555388 22450 heartbeater.cc:464] Registering TS with master...
I20260811 08:03:54.555619 22450 heartbeater.cc:511] Master 127.15.36.254:38213 requested a full tablet report, sending...
I20260811 08:03:54.556396 22231 ts_manager.cc:194] Registered new tserver with Master: cd701cdf69504752aa640a88a90093d6 (127.15.36.193:38419)
I20260811 08:03:54.557173 22231 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.15.36.193@KRBTEST.COM'} at 127.15.36.193:57469
WARNING: no policy specified for oryx/127.15.36.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.36.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.36.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/krb5kdc/oryx_127.15.36.194.keytab.
Entry for principal oryx/127.15.36.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/krb5kdc/oryx_127.15.36.194.keytab.
I20260811 08:03:54.587484 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.194:0
--local_ip_for_outbound_sockets=127.15.36.194
--webserver_interface=127.15.36.194
--webserver_port=0
--tserver_master_addrs=127.15.36.254:38213
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/krb5kdc/oryx_127.15.36.194.keytab
--principal=oryx/127.15.36.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:42827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:03:54.682744 22456 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:03:54.683113 22456 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:03:54.683163 22456 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:03:54.684674 22456 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:03:54.684762 22456 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:03:54.684814 22456 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.194
I20260811 08:03:54.686663 22456 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:42827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/krb5kdc/oryx_127.15.36.194.keytab
--principal=oryx/127.15.36.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.36.194
--webserver_port=0
--tserver_master_addrs=127.15.36.254:38213
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22456
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.194
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:03:54.687006 22456 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:03:54.687274 22456 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:03:54.694671 22464 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:54.694607 22462 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:54.694607 22461 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:03:54.695395 22456 server_base.cc:1034] running on GCE node
I20260811 08:03:54.695705 22456 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:03:54.696352 22456 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:03:54.697547 22456 hybrid_clock.cc:648] HybridClock initialized: now 1786435434697526 us; error 47 us; skew 500 ppm
Aug 11 08:03:54 dist-test-slave-2w3w krb5kdc[22180](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435434, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.36.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:03:54.700834 22456 init.cc:377] Logged in from keytab as oryx/127.15.36.194@KRBTEST.COM (short username oryx)
I20260811 08:03:54.701473 22456 webserver.cc:460] Webserver started at http://127.15.36.194:43887/ using document root <none> and password file <none>
I20260811 08:03:54.701689 22456 fs_manager.cc:359] Metadata directory not provided
I20260811 08:03:54.701735 22456 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:03:54.701843 22456 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:03:54.703091 22456 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-1/data/instance:
uuid: "fb38ba8c11d548db8c8f93e92cee9d24"
format_stamp: "Formatted at 2026-08-11 08:03:54 on dist-test-slave-2w3w"
server_key: "670ea6f15eec30b5ebd4b5b0d3f9f510"
server_key_iv: "b66a9b7fdb71328b028b1c86b5971c76"
server_key_version: "encryptionkey@0"
I20260811 08:03:54.703461 22456 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-1/wal/instance:
uuid: "fb38ba8c11d548db8c8f93e92cee9d24"
format_stamp: "Formatted at 2026-08-11 08:03:54 on dist-test-slave-2w3w"
server_key: "670ea6f15eec30b5ebd4b5b0d3f9f510"
server_key_iv: "b66a9b7fdb71328b028b1c86b5971c76"
server_key_version: "encryptionkey@0"
I20260811 08:03:54.705400 22456 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260811 08:03:54.706606 22473 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:54.707252 22456 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:03:54.707382 22456 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-1/wal
uuid: "fb38ba8c11d548db8c8f93e92cee9d24"
format_stamp: "Formatted at 2026-08-11 08:03:54 on dist-test-slave-2w3w"
server_key: "670ea6f15eec30b5ebd4b5b0d3f9f510"
server_key_iv: "b66a9b7fdb71328b028b1c86b5971c76"
server_key_version: "encryptionkey@0"
I20260811 08:03:54.707713 22456 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:03:54.717911 22456 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:03:54.720613 22456 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:03:54.720806 22456 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:03:54.721132 22456 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:03:54.721500 22456 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:03:54.721557 22456 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:54.721603 22456 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:03:54.721630 22456 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:54.728854 22456 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.194:37987
I20260811 08:03:54.728896 22598 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.194:37987 every 8 connection(s)
I20260811 08:03:54.729323 22456 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
I20260811 08:03:54.735354 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 22456
I20260811 08:03:54.735502 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-1/wal/instance
I20260811 08:03:54.735711 15507 external_mini_cluster.cc:1428] Setting key 4d248cdb74c61a9fc1fe9f9af9d3df3a
Aug 11 08:03:54 dist-test-slave-2w3w krb5kdc[22180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435434, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.36.194@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM
I20260811 08:03:54.741374 22275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:54.730098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:53419 (local address 127.15.36.254:38213)
0811 08:03:54.730174 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:54.730176 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:54.730433 (+ 257us) server_negotiation.cc:407] Connection header received
0811 08:03:54.730942 (+ 509us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:54.730943 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:54.731022 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:54.731101 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:54.732120 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:54.732619 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:54.733762 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:54.733962 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:54.734029 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:54.737486 (+ 3457us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:54.737488 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:54.737488 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:54.737499 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:54.739461 (+ 1962us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:54.740034 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:54.740036 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:54.740036 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:54.740106 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:54.740491 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:54.740492 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:54.740492 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:54.740653 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:54.740729 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:54.741176 (+ 447us) server_negotiation.cc:299] Negotiation successful
0811 08:03:54.741272 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 08:03:54.741707 22602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:54.730082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:38213 (local address 127.15.36.194:53419)
0811 08:03:54.730247 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:54.730291 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:54.730811 (+ 520us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:54.731169 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:54.731173 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:54.731791 (+ 618us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:03:54.732003 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:54.732008 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:54.732715 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:54.732715 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:54.733611 (+ 896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:54.733614 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:54.734077 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:54.734078 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:54.734194 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:54.735076 (+ 882us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:03:54.735085 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:03:54.737258 (+ 2173us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:03:54.739578 (+ 2320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:54.739591 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:54.739594 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:54.739917 (+ 323us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:54.740189 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:54.740190 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:54.740191 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:54.740383 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:54.740741 (+ 358us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:03:54.740749 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:03:54.740967 (+ 218us) client_negotiation.cc:769] Sending connection context
0811 08:03:54.741111 (+ 144us) client_negotiation.cc:240] Negotiation successful
0811 08:03:54.741358 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":87,"threads_started":1}
I20260811 08:03:54.742657 22599 heartbeater.cc:347] Connected to a master server at 127.15.36.254:38213
I20260811 08:03:54.742780 22599 heartbeater.cc:464] Registering TS with master...
I20260811 08:03:54.743075 22599 heartbeater.cc:511] Master 127.15.36.254:38213 requested a full tablet report, sending...
I20260811 08:03:54.743593 22231 ts_manager.cc:194] Registered new tserver with Master: fb38ba8c11d548db8c8f93e92cee9d24 (127.15.36.194:37987)
I20260811 08:03:54.744016 22231 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.15.36.194@KRBTEST.COM'} at 127.15.36.194:53419
WARNING: no policy specified for oryx/127.15.36.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.36.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.36.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/krb5kdc/oryx_127.15.36.195.keytab.
Entry for principal oryx/127.15.36.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/krb5kdc/oryx_127.15.36.195.keytab.
I20260811 08:03:54.775925 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.195:0
--local_ip_for_outbound_sockets=127.15.36.195
--webserver_interface=127.15.36.195
--webserver_port=0
--tserver_master_addrs=127.15.36.254:38213
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/krb5kdc/oryx_127.15.36.195.keytab
--principal=oryx/127.15.36.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:42827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:03:54.867959 22605 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:03:54.868252 22605 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:03:54.868299 22605 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:03:54.869977 22605 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:03:54.870096 22605 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:03:54.870157 22605 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.195
I20260811 08:03:54.872174 22605 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:42827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/krb5kdc/oryx_127.15.36.195.keytab
--principal=oryx/127.15.36.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.36.195
--webserver_port=0
--tserver_master_addrs=127.15.36.254:38213
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22605
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.195
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:03:54.872547 22605 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:03:54.872825 22605 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:03:54.878705 22611 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:54.878715 22612 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:54.878726 22614 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:03:54.879328 22605 server_base.cc:1034] running on GCE node
I20260811 08:03:54.879606 22605 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:03:54.879894 22605 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:03:54.881095 22605 hybrid_clock.cc:648] HybridClock initialized: now 1786435434881077 us; error 34 us; skew 500 ppm
Aug 11 08:03:54 dist-test-slave-2w3w krb5kdc[22180](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435434, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.36.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:03:54.883912 22605 init.cc:377] Logged in from keytab as oryx/127.15.36.195@KRBTEST.COM (short username oryx)
I20260811 08:03:54.884485 22605 webserver.cc:460] Webserver started at http://127.15.36.195:44421/ using document root <none> and password file <none>
I20260811 08:03:54.884739 22605 fs_manager.cc:359] Metadata directory not provided
I20260811 08:03:54.884810 22605 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:03:54.884969 22605 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:03:54.886099 22605 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-2/data/instance:
uuid: "d957252f43b5420eafb1f9611b8fb54c"
format_stamp: "Formatted at 2026-08-11 08:03:54 on dist-test-slave-2w3w"
server_key: "5960e83b7b773715ecaeac7bdde68ead"
server_key_iv: "48db1bf68a59d67df3e4bb3f72a1f2c6"
server_key_version: "encryptionkey@0"
I20260811 08:03:54.886479 22605 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-2/wal/instance:
uuid: "d957252f43b5420eafb1f9611b8fb54c"
format_stamp: "Formatted at 2026-08-11 08:03:54 on dist-test-slave-2w3w"
server_key: "5960e83b7b773715ecaeac7bdde68ead"
server_key_iv: "48db1bf68a59d67df3e4bb3f72a1f2c6"
server_key_version: "encryptionkey@0"
I20260811 08:03:54.888065 22605 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.003s
I20260811 08:03:54.889144 22622 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:54.889420 22605 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:03:54.889544 22605 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-2/wal
uuid: "d957252f43b5420eafb1f9611b8fb54c"
format_stamp: "Formatted at 2026-08-11 08:03:54 on dist-test-slave-2w3w"
server_key: "5960e83b7b773715ecaeac7bdde68ead"
server_key_iv: "48db1bf68a59d67df3e4bb3f72a1f2c6"
server_key_version: "encryptionkey@0"
I20260811 08:03:54.889637 22605 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:03:54.909369 22605 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:03:54.912321 22605 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:03:54.912451 22605 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:03:54.912709 22605 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:03:54.913013 22605 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:03:54.913046 22605 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:54.913070 22605 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:03:54.913082 22605 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:54.919111 22605 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.195:35307
I20260811 08:03:54.919200 22750 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.195:35307 every 8 connection(s)
I20260811 08:03:54.919610 22605 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
I20260811 08:03:54.923280 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 22605
I20260811 08:03:54.923393 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-2/wal/instance
I20260811 08:03:54.923622 15507 external_mini_cluster.cc:1428] Setting key 734ac211515d1d3fc6848651f7cca487
Aug 11 08:03:54 dist-test-slave-2w3w krb5kdc[22180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435434, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.36.195@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM
I20260811 08:03:54.932605 22275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:54.920664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:56033 (local address 127.15.36.254:38213)
0811 08:03:54.920762 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:54.920764 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:54.920982 (+ 218us) server_negotiation.cc:407] Connection header received
0811 08:03:54.921750 (+ 768us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:54.921752 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:54.921768 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:54.921844 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:54.923437 (+ 1593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:54.924153 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:54.925470 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:54.925675 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:54.925749 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:54.928701 (+ 2952us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:54.928703 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:54.928703 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:54.928712 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:54.930659 (+ 1947us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:54.931307 (+ 648us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:54.931309 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:54.931309 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:54.931382 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:54.931834 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:54.931836 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:54.931836 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:54.931974 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:54.932125 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:54.932442 (+ 317us) server_negotiation.cc:299] Negotiation successful
0811 08:03:54.932532 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 08:03:54.932757 22753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:54.920528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:38213 (local address 127.15.36.195:56033)
0811 08:03:54.920795 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:54.920847 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:54.921516 (+ 669us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:54.922074 (+ 558us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:54.922078 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:54.922824 (+ 746us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:03:54.923258 (+ 434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:54.923267 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:54.924259 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:54.924260 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:54.925340 (+ 1080us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:54.925343 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:54.925804 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:54.925805 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:54.925967 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:54.926737 (+ 770us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:03:54.926750 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:03:54.928540 (+ 1790us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:03:54.930781 (+ 2241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:54.930793 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:54.930796 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:54.931201 (+ 405us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:54.931506 (+ 305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:54.931507 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:54.931508 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:54.931641 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:54.932125 (+ 484us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:03:54.932133 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:03:54.932280 (+ 147us) client_negotiation.cc:769] Sending connection context
0811 08:03:54.932374 (+ 94us) client_negotiation.cc:240] Negotiation successful
0811 08:03:54.932527 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":107,"threads_started":1}
I20260811 08:03:54.933429 22751 heartbeater.cc:347] Connected to a master server at 127.15.36.254:38213
I20260811 08:03:54.933564 22751 heartbeater.cc:464] Registering TS with master...
I20260811 08:03:54.933796 22751 heartbeater.cc:511] Master 127.15.36.254:38213 requested a full tablet report, sending...
I20260811 08:03:54.934510 22231 ts_manager.cc:194] Registered new tserver with Master: d957252f43b5420eafb1f9611b8fb54c (127.15.36.195:35307)
I20260811 08:03:54.935039 22231 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.15.36.195@KRBTEST.COM'} at 127.15.36.195:56033
I20260811 08:03:54.938330 15507 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.15.36.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.36.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.36.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/krb5kdc/oryx_127.15.36.253.keytab.
Entry for principal oryx/127.15.36.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/krb5kdc/oryx_127.15.36.253.keytab.
I20260811 08:03:54.975539 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.253:38657
--webserver_interface=127.15.36.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/krb5kdc/oryx_127.15.36.253.keytab
--principal=oryx/127.15.36.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:42827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.36.254:38213,127.15.36.253:38657
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:03:55.080245 22757 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:03:55.080494 22757 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:03:55.080521 22757 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:03:55.081967 22757 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:03:55.082051 22757 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:03:55.082067 22757 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:03:55.082082 22757 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:03:55.082094 22757 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:03:55.083974 22757 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:42827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.15.36.254:38213,127.15.36.253:38657
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/krb5kdc/oryx_127.15.36.253.keytab
--principal=oryx/127.15.36.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.253:38657
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.15.36.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22757
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
W20260811 08:03:55.084136 22757 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.15.36.254:38213,127.15.36.253:38657'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260811 08:03:55.084272 22757 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:03:55.084468 22757 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:03:55.090590 22763 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:55.090590 22762 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:55.090619 22765 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:03:55.091465 22757 server_base.cc:1034] running on GCE node
I20260811 08:03:55.092245 22757 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:03:55.092700 22757 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:03:55.093920 22757 hybrid_clock.cc:648] HybridClock initialized: now 1786435435093886 us; error 50 us; skew 500 ppm
Aug 11 08:03:55 dist-test-slave-2w3w krb5kdc[22180](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435435, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.36.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:03:55.098681 22757 init.cc:377] Logged in from keytab as oryx/127.15.36.253@KRBTEST.COM (short username oryx)
I20260811 08:03:55.099341 22757 webserver.cc:460] Webserver started at http://127.15.36.253:37187/ using document root <none> and password file <none>
I20260811 08:03:55.099618 22757 fs_manager.cc:359] Metadata directory not provided
I20260811 08:03:55.099691 22757 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:03:55.099862 22757 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:03:55.101001 22757 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/master-1/data/instance:
uuid: "2f0c35cebbbc411eb7541511d3ca99d3"
format_stamp: "Formatted at 2026-08-11 08:03:55 on dist-test-slave-2w3w"
server_key: "4ce59fc352139e4ca83f3ebfc1fa1bd5"
server_key_iv: "2465d9f73d6e8bae9962da81448c4264"
server_key_version: "encryptionkey@0"
I20260811 08:03:55.101534 22757 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/master-1/wal/instance:
uuid: "2f0c35cebbbc411eb7541511d3ca99d3"
format_stamp: "Formatted at 2026-08-11 08:03:55 on dist-test-slave-2w3w"
server_key: "4ce59fc352139e4ca83f3ebfc1fa1bd5"
server_key_iv: "2465d9f73d6e8bae9962da81448c4264"
server_key_version: "encryptionkey@0"
I20260811 08:03:55.103219 22757 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260811 08:03:55.104130 22773 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:55.104343 22757 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:03:55.104462 22757 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/master-1/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/master-1/wal
uuid: "2f0c35cebbbc411eb7541511d3ca99d3"
format_stamp: "Formatted at 2026-08-11 08:03:55 on dist-test-slave-2w3w"
server_key: "4ce59fc352139e4ca83f3ebfc1fa1bd5"
server_key_iv: "2465d9f73d6e8bae9962da81448c4264"
server_key_version: "encryptionkey@0"
I20260811 08:03:55.104543 22757 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:03:55.132048 22757 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:03:55.134570 22757 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:03:55.134794 22757 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:03:55.139322 22757 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.253:38657
I20260811 08:03:55.139401 22838 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.253:38657 every 8 connection(s)
I20260811 08:03:55.139801 22757 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/master-1/data/info.pb
I20260811 08:03:55.141073 22839 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:03:55.143853 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 22757
I20260811 08:03:55.143710 22839 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38213 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 08:03:55 dist-test-slave-2w3w krb5kdc[22180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435435, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.36.253@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM
Aug 11 08:03:55 dist-test-slave-2w3w krb5kdc[22180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435434, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.15.36.253@KRBTEST.COM
I20260811 08:03:55.155119 22275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:55.144775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54286 (local address 127.15.36.254:38213)
0811 08:03:55.144834 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:55.144837 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:55.145020 (+ 183us) server_negotiation.cc:407] Connection header received
0811 08:03:55.145528 (+ 508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:55.145530 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:55.145544 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:55.145623 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:55.146442 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.147178 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.148141 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.148346 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.148428 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:55.151135 (+ 2707us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:55.151136 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:55.151137 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:55.151148 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:55.152837 (+ 1689us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:55.153686 (+ 849us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:55.153688 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:55.153689 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:55.153769 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:55.154167 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:55.154169 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:55.154169 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:55.154443 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:55.154528 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:55.154874 (+ 346us) server_negotiation.cc:299] Negotiation successful
0811 08:03:55.155022 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 08:03:55.155328 22843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:55.144564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54504 (local address 127.15.36.253:38657)
0811 08:03:55.144794 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:55.144805 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:55.144844 (+ 39us) server_negotiation.cc:407] Connection header received
0811 08:03:55.145341 (+ 497us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:55.145349 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:55.145371 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:55.145517 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:55.146185 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.147144 (+ 959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.147924 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.148279 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.148406 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:55.151519 (+ 3113us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:55.151530 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:55.151530 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:55.151539 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:55.153617 (+ 2078us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:55.154254 (+ 637us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:55.154257 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:55.154257 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:55.154308 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:55.154530 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:55.154531 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:55.154531 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:55.154736 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:55.154987 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:55.155082 (+ 95us) server_negotiation.cc:299] Negotiation successful
0811 08:03:55.155148 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":108,"threads_started":1}
I20260811 08:03:55.155339 22844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:55.144610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:38213 (local address 127.0.0.1:54286)
0811 08:03:55.144881 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:55.144921 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:55.145403 (+ 482us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:55.145649 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:55.145652 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:55.146050 (+ 398us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:03:55.146240 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:55.146245 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.147305 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.147307 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:55.148042 (+ 735us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:55.148044 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.148436 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.148437 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:55.148518 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:55.149261 (+ 743us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:03:55.149270 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:03:55.150924 (+ 1654us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:03:55.153169 (+ 2245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:55.153175 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:55.153178 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:55.153563 (+ 385us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:55.153886 (+ 323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:55.153887 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:55.153887 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:55.154004 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:55.154531 (+ 527us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:03:55.154538 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:03:55.154733 (+ 195us) client_negotiation.cc:769] Sending connection context
0811 08:03:55.154832 (+ 99us) client_negotiation.cc:240] Negotiation successful
0811 08:03:55.155056 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":87,"threads_started":1}
I20260811 08:03:55.156188 22839 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.36.253" port: 38657 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 08:03:55 dist-test-slave-2w3w krb5kdc[22180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435435, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.36.253@KRBTEST.COM for oryx/127.15.36.253@KRBTEST.COM
I20260811 08:03:55.163609 22844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:55.156528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.253:38657 (local address 127.0.0.1:54516)
0811 08:03:55.156585 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:55.156597 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:55.156643 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:55.156752 (+ 109us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:55.156753 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:55.156890 (+ 137us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:03:55.156929 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:55.156931 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.157722 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.157723 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:55.158206 (+ 483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:55.158207 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.158649 (+ 442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.158650 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:55.158713 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:55.159227 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:03:55.159232 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:03:55.160708 (+ 1476us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:03:55.162525 (+ 1817us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:55.162526 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:55.162526 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:55.162700 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:55.162932 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:55.162933 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:55.162933 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:55.163048 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:55.163314 (+ 266us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:03:55.163315 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:03:55.163358 (+ 43us) client_negotiation.cc:769] Sending connection context
0811 08:03:55.163422 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 08:03:55.163514 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260811 08:03:55.163664 22843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:55.156586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54516 (local address 127.15.36.253:38657)
0811 08:03:55.156623 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:55.156625 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:55.156632 (+ 7us) server_negotiation.cc:407] Connection header received
0811 08:03:55.156702 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:55.156702 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:55.156710 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:55.156750 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:55.157032 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.157618 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.158345 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.158547 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.158612 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:55.160857 (+ 2245us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:55.160859 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:55.160859 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:55.160867 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:55.162431 (+ 1564us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:55.162814 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:55.162815 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:55.162815 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:55.162871 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:55.163115 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:55.163116 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:55.163116 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:55.163235 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:55.163293 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:55.163454 (+ 161us) server_negotiation.cc:299] Negotiation successful
0811 08:03:55.163565 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":44,"server-negotiator.queue_time_us":20}
I20260811 08:03:55.165308 22839 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3: Bootstrap starting.
I20260811 08:03:55.166225 22839 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3: Neither blocks nor log segments found. Creating new log.
I20260811 08:03:55.166527 22839 log.cc:824] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3: Log is configured to *not* fsync() on all Append() calls
I20260811 08:03:55.167516 22839 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3: No bootstrap required, opened a new log
I20260811 08:03:55.169005 22839 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d27dfc74df774f2f8f479ece768c55ae" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38213 } } peers { permanent_uuid: "2f0c35cebbbc411eb7541511d3ca99d3" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 38657 } }
I20260811 08:03:55.169170 22839 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:03:55.169220 22839 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f0c35cebbbc411eb7541511d3ca99d3, State: Initialized, Role: FOLLOWER
I20260811 08:03:55.169382 22839 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d27dfc74df774f2f8f479ece768c55ae" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38213 } } peers { permanent_uuid: "2f0c35cebbbc411eb7541511d3ca99d3" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 38657 } }
I20260811 08:03:55.169735 22839 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:03:55.169744 22846 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d27dfc74df774f2f8f479ece768c55ae" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38213 } } peers { permanent_uuid: "2f0c35cebbbc411eb7541511d3ca99d3" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 38657 } } }
I20260811 08:03:55.169947 22846 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3 [sys.catalog]: This master's current role is: FOLLOWER
W20260811 08:03:55.171648 22857 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 08:03:55.171785 22857 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 08:03:55.173629 22757 master_runner.cc:428] Detected that this master 2f0c35cebbbc411eb7541511d3ca99d3 is joining an existing cluster
I20260811 08:03:55.173693 22757 master_runner.cc:432] Initiating AddMaster RPC to add 127.15.36.253:38657
I20260811 08:03:55.182798 22275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:55.174809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54292 (local address 127.15.36.254:38213)
0811 08:03:55.174865 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:55.174867 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:55.175120 (+ 253us) server_negotiation.cc:407] Connection header received
0811 08:03:55.175208 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:55.175209 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:55.175219 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:55.175296 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:55.175755 (+ 459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.176267 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.177307 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.177517 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.178161 (+ 644us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:55.179926 (+ 1765us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:55.179928 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:55.179928 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:55.179937 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:55.181381 (+ 1444us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:55.181883 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:55.181884 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:55.181885 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:55.181956 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:55.182183 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:55.182183 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:55.182184 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:55.182348 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:55.182417 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:55.182606 (+ 189us) server_negotiation.cc:299] Negotiation successful
0811 08:03:55.182696 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 08:03:55.182798 22843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:55.175016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54530 (local address 127.15.36.253:38657)
0811 08:03:55.175051 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:55.175053 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:55.175298 (+ 245us) server_negotiation.cc:407] Connection header received
0811 08:03:55.175371 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:55.175371 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:55.175381 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:55.175436 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:55.175895 (+ 459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.176622 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.177885 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.178167 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.178210 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:55.179642 (+ 1432us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:55.179643 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:55.179644 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:55.179651 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:55.181518 (+ 1867us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:55.181929 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:55.181930 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:55.181930 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:55.181980 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:55.182210 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:55.182211 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:55.182211 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:55.182326 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:55.182406 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:55.182532 (+ 126us) server_negotiation.cc:299] Negotiation successful
0811 08:03:55.182680 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":19,"server-negotiator.queue_time_us":17}
I20260811 08:03:55.183166 22863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:55.174774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.253:38657 (local address 127.0.0.1:54530)
0811 08:03:55.175243 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:55.175252 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:55.175320 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:55.175457 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:55.175458 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:55.175730 (+ 272us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:03:55.175806 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:55.175807 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.176723 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.176724 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:55.177779 (+ 1055us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:55.177783 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.178294 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.178295 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:55.178361 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:55.179012 (+ 651us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:03:55.179017 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:03:55.179532 (+ 515us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:03:55.181603 (+ 2071us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:55.181604 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:55.181604 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:55.181866 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:55.182048 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:55.182049 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:55.182049 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:55.182123 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:55.182397 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:03:55.182398 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:03:55.182437 (+ 39us) client_negotiation.cc:769] Sending connection context
0811 08:03:55.182508 (+ 71us) client_negotiation.cc:240] Negotiation successful
0811 08:03:55.182740 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":455,"mutex_wait_us":112,"thread_start_us":108,"threads_started":1}
I20260811 08:03:55.183255 22864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:55.174770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:38213 (local address 127.0.0.1:54292)
0811 08:03:55.175045 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:55.175060 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:55.175138 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:55.175301 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:55.175302 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:55.175603 (+ 301us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:03:55.175674 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:55.175676 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.176356 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.176357 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:55.176966 (+ 609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:55.176968 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.178170 (+ 1202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.178171 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:55.178250 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:55.178777 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:03:55.178783 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:03:55.179500 (+ 717us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:03:55.181490 (+ 1990us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:55.181490 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:55.181491 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:55.181795 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:55.182036 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:55.182037 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:55.182038 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:55.182111 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:55.182448 (+ 337us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:03:55.182449 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:03:55.182493 (+ 44us) client_negotiation.cc:769] Sending connection context
0811 08:03:55.182951 (+ 458us) client_negotiation.cc:240] Negotiation successful
0811 08:03:55.183088 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":83,"threads_started":1}
Aug 11 08:03:55 dist-test-slave-2w3w krb5kdc[22180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435434, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.36.254@KRBTEST.COM for oryx/127.15.36.253@KRBTEST.COM
I20260811 08:03:55.197183 22843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:55.186514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54538 (local address 127.15.36.253:38657)
0811 08:03:55.186561 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:55.186563 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:55.186747 (+ 184us) server_negotiation.cc:407] Connection header received
0811 08:03:55.186813 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:55.186814 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:55.186826 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:55.186906 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:55.187659 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.188818 (+ 1159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.189820 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.190166 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.190252 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:55.193602 (+ 3350us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:55.193605 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:55.193605 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:55.193618 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:55.195701 (+ 2083us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:55.196286 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:55.196287 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:55.196288 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:55.196352 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:55.196589 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:55.196589 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:55.196589 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:55.196714 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:55.196769 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:55.197034 (+ 265us) server_negotiation.cc:299] Negotiation successful
0811 08:03:55.197114 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 08:03:55.197343 22865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:55.186438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.253:38657 (local address 127.0.0.1:54538)
0811 08:03:55.186613 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:55.186661 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:55.186742 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:55.186947 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:55.186955 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:55.187391 (+ 436us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:03:55.187459 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:55.187461 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.189005 (+ 1544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.189006 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:55.189692 (+ 686us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:55.189694 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.190363 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.190366 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:55.190552 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:55.191349 (+ 797us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:03:55.191356 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:03:55.193325 (+ 1969us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:03:55.195817 (+ 2492us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:55.195831 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:55.195834 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:55.196179 (+ 345us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:55.196434 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:55.196434 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:55.196435 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:55.196518 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:55.196783 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:03:55.196792 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:03:55.196862 (+ 70us) client_negotiation.cc:769] Sending connection context
0811 08:03:55.197011 (+ 149us) client_negotiation.cc:240] Negotiation successful
0811 08:03:55.197169 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":118,"threads_started":1}
I20260811 08:03:55.198118 22231 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.15.36.253:38657: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "2f0c35cebbbc411eb7541511d3ca99d3"
member_type: NON_VOTER
last_known_addr {
host: "127.15.36.253"
port: 38657
}
attrs {
promote: true
}
}
dest_uuid: "d27dfc74df774f2f8f479ece768c55ae"
cas_config_opid_index: -1
I20260811 08:03:55.198499 22231 consensus_queue.cc:237] T 00000000000000000000000000000000 P d27dfc74df774f2f8f479ece768c55ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "d27dfc74df774f2f8f479ece768c55ae" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38213 } } peers { permanent_uuid: "2f0c35cebbbc411eb7541511d3ca99d3" member_type: NON_VOTER last_known_addr { host: "127.15.36.253" port: 38657 } attrs { promote: true } }
I20260811 08:03:55.199357 22867 raft_consensus.cc:2932] T 00000000000000000000000000000000 P d27dfc74df774f2f8f479ece768c55ae [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 2f0c35cebbbc411eb7541511d3ca99d3 (127.15.36.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "d27dfc74df774f2f8f479ece768c55ae" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38213 } } peers { permanent_uuid: "2f0c35cebbbc411eb7541511d3ca99d3" member_type: NON_VOTER last_known_addr { host: "127.15.36.253" port: 38657 } attrs { promote: true } } }
I20260811 08:03:55.200603 22867 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.15.36.253:38657
I20260811 08:03:55.200708 22867 sys_catalog.cc:455] T 00000000000000000000000000000000 P d27dfc74df774f2f8f479ece768c55ae [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "d27dfc74df774f2f8f479ece768c55ae" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "d27dfc74df774f2f8f479ece768c55ae" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38213 } } peers { permanent_uuid: "2f0c35cebbbc411eb7541511d3ca99d3" member_type: NON_VOTER last_known_addr { host: "127.15.36.253" port: 38657 } attrs { promote: true } } }
I20260811 08:03:55.200784 22867 sys_catalog.cc:458] T 00000000000000000000000000000000 P d27dfc74df774f2f8f479ece768c55ae [sys.catalog]: This master's current role is: LEADER
I20260811 08:03:55.200793 22807 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:03:55.201300 22757 master.cc:537] Master@127.15.36.253:38657 shutting down...
I20260811 08:03:55.202397 22807 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3 [term 1 FOLLOWER]: Refusing update from remote peer d27dfc74df774f2f8f479ece768c55ae: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260811 08:03:55.203261 22866 consensus_queue.cc:1035] T 00000000000000000000000000000000 P d27dfc74df774f2f8f479ece768c55ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f0c35cebbbc411eb7541511d3ca99d3" member_type: NON_VOTER last_known_addr { host: "127.15.36.253" port: 38657 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:03:55.204460 22757 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:03:55.204566 22757 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:03:55.204615 22757 tablet_replica.cc:330] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3: stopping tablet replica
W20260811 08:03:55.204746 22214 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260811 08:03:55.205276 22214 consensus_peers.cc:487] T 00000000000000000000000000000000 P d27dfc74df774f2f8f479ece768c55ae -> Peer 2f0c35cebbbc411eb7541511d3ca99d3 (127.15.36.253:38657): Couldn't send request to peer 2f0c35cebbbc411eb7541511d3ca99d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260811 08:03:55.217568 22757 master.cc:552] Master@127.15.36.253:38657 shutdown complete.
I20260811 08:03:55.217635 22757 master_runner.cc:305] Clearing existing system tablet
I20260811 08:03:55.217882 22757 fs_manager.cc:359] Metadata directory not provided
I20260811 08:03:55.217936 22757 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:03:55.218701 22757 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.002s sys 0.000s
I20260811 08:03:55.219784 22873 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:55.219936 22757 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:03:55.220003 22757 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 08:03:55.220031 22757 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/master-1/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/master-1/wal
uuid: "2f0c35cebbbc411eb7541511d3ca99d3"
format_stamp: "Formatted at 2026-08-11 08:03:55 on dist-test-slave-2w3w"
server_key: "4ce59fc352139e4ca83f3ebfc1fa1bd5"
server_key_iv: "2465d9f73d6e8bae9962da81448c4264"
server_key_version: "encryptionkey@0"
I20260811 08:03:55.220850 22757 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:03:55.222883 22757 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260811 08:03:55.223024 22757 log.cc:1196] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3: Deleting WAL directory at /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260811 08:03:55.223349 22757 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3: Deleting consensus metadata
I20260811 08:03:55.223519 22757 master_runner.cc:315] Copying system tablet from 127.15.36.254:38213
I20260811 08:03:55.224299 22757 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3: tablet copy: Beginning tablet copy session from remote peer at address 127.15.36.254:38213
I20260811 08:03:55.232195 22879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:55.224680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:38213 (local address 127.0.0.1:54302)
0811 08:03:55.224826 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:55.224841 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:55.224924 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:55.225125 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:55.225126 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:55.225333 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:03:55.225399 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:55.225401 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.226389 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.226390 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:55.227154 (+ 764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:55.227157 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.227626 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.227626 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:55.227678 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:55.228294 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:03:55.228300 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:03:55.228752 (+ 452us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:03:55.230677 (+ 1925us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:55.230678 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:55.230678 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:55.230939 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:55.231314 (+ 375us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:55.231315 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:55.231315 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:55.231391 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:55.231706 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:03:55.231707 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:03:55.231762 (+ 55us) client_negotiation.cc:769] Sending connection context
0811 08:03:55.231843 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 08:03:55.231979 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":88,"threads_started":1}
I20260811 08:03:55.232290 22275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:55.224825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54302 (local address 127.15.36.254:38213)
0811 08:03:55.224904 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:55.224907 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:55.224920 (+ 13us) server_negotiation.cc:407] Connection header received
0811 08:03:55.224984 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:55.224985 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:55.224997 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:55.225065 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:55.225488 (+ 423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.226286 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.227237 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.227544 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.227622 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:55.228869 (+ 1247us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:55.228871 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:55.228871 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:55.228879 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:55.230585 (+ 1706us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:55.231136 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:55.231138 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:55.231138 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:55.231203 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:55.231491 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:55.231492 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:55.231492 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:55.231629 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:55.231699 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:55.231864 (+ 165us) server_negotiation.cc:299] Negotiation successful
0811 08:03:55.231951 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 08:03:55.233043 22253 tablet_copy_service.cc:140] P d27dfc74df774f2f8f479ece768c55ae: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 2f0c35cebbbc411eb7541511d3ca99d3 ({username='oryx', principal='oryx/127.15.36.253@KRBTEST.COM'} at 127.0.0.1:54302)
I20260811 08:03:55.233170 22253 tablet_copy_service.cc:161] P d27dfc74df774f2f8f479ece768c55ae: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 2f0c35cebbbc411eb7541511d3ca99d3 at {username='oryx', principal='oryx/127.15.36.253@KRBTEST.COM'} at 127.0.0.1:54302: session id = 2f0c35cebbbc411eb7541511d3ca99d3-00000000000000000000000000000000
I20260811 08:03:55.234129 22253 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P d27dfc74df774f2f8f479ece768c55ae: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 08:03:55.235363 22757 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260811 08:03:55.236465 22757 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3: tablet copy: Starting download of 0 data blocks...
I20260811 08:03:55.236651 22757 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3: tablet copy: Starting download of 1 WAL segments...
I20260811 08:03:55.237742 22757 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 08:03:55.238832 22253 tablet_copy_service.cc:342] P d27dfc74df774f2f8f479ece768c55ae: Request end of tablet copy session 2f0c35cebbbc411eb7541511d3ca99d3-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.15.36.253@KRBTEST.COM'} at 127.0.0.1:54302
I20260811 08:03:55.238906 22253 tablet_copy_service.cc:433] P d27dfc74df774f2f8f479ece768c55ae: ending tablet copy session 2f0c35cebbbc411eb7541511d3ca99d3-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 2f0c35cebbbc411eb7541511d3ca99d3
I20260811 08:03:55.242421 22757 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:03:55.243935 22880 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:55.244019 22883 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:55.244014 22881 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:03:55.244402 22757 server_base.cc:1034] running on GCE node
I20260811 08:03:55.244560 22757 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:03:55.244758 22757 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:03:55.245954 22757 hybrid_clock.cc:648] HybridClock initialized: now 1786435435245933 us; error 40 us; skew 500 ppm
Aug 11 08:03:55 dist-test-slave-2w3w krb5kdc[22180](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435435, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.36.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:03:55.247512 22757 init.cc:377] Logged in from keytab as oryx/127.15.36.253@KRBTEST.COM (short username oryx)
I20260811 08:03:55.247831 22757 webserver.cc:460] Webserver started at http://127.15.36.253:37393/ using document root <none> and password file <none>
I20260811 08:03:55.247982 22757 fs_manager.cc:359] Metadata directory not provided
I20260811 08:03:55.248024 22757 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:03:55.248745 22757 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:03:55.249310 22890 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:55.249434 22757 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:55.249483 22757 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/master-1/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/master-1/wal
uuid: "2f0c35cebbbc411eb7541511d3ca99d3"
format_stamp: "Formatted at 2026-08-11 08:03:55 on dist-test-slave-2w3w"
server_key: "4ce59fc352139e4ca83f3ebfc1fa1bd5"
server_key_iv: "2465d9f73d6e8bae9962da81448c4264"
server_key_version: "encryptionkey@0"
I20260811 08:03:55.249548 22757 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:03:55.270624 22757 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:03:55.273919 22757 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:03:55.277486 22757 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.253:38657
I20260811 08:03:55.277510 22952 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.253:38657 every 8 connection(s)
I20260811 08:03:55.278160 22757 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/master-1/data/info.pb
I20260811 08:03:55.279603 22954 sys_catalog.cc:263] Verifying existing consensus state
I20260811 08:03:55.280344 22954 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3: Bootstrap starting.
I20260811 08:03:55.283881 22954 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 08:03:55.284160 22954 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3: Bootstrap complete.
I20260811 08:03:55.284418 22954 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "d27dfc74df774f2f8f479ece768c55ae" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38213 } } peers { permanent_uuid: "2f0c35cebbbc411eb7541511d3ca99d3" member_type: NON_VOTER last_known_addr { host: "127.15.36.253" port: 38657 } attrs { promote: true } }
I20260811 08:03:55.284550 22954 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2f0c35cebbbc411eb7541511d3ca99d3, State: Initialized, Role: LEARNER
I20260811 08:03:55.284600 22954 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "d27dfc74df774f2f8f479ece768c55ae" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38213 } } peers { permanent_uuid: "2f0c35cebbbc411eb7541511d3ca99d3" member_type: NON_VOTER last_known_addr { host: "127.15.36.253" port: 38657 } attrs { promote: true } }
I20260811 08:03:55.284821 22958 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "d27dfc74df774f2f8f479ece768c55ae" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38213 } } peers { permanent_uuid: "2f0c35cebbbc411eb7541511d3ca99d3" member_type: NON_VOTER last_known_addr { host: "127.15.36.253" port: 38657 } attrs { promote: true } } }
I20260811 08:03:55.284894 22954 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:03:55.284987 22958 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3 [sys.catalog]: This master's current role is: LEARNER
I20260811 08:03:55.286913 22969 catalog_manager.cc:1259] Loaded cluster ID: db71382509734f74afa8ec085bf13168
I20260811 08:03:55.287016 22969 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3: loading cluster ID for follower catalog manager: success
I20260811 08:03:55.288157 22969 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3: acquiring CA information for follower catalog manager: success
I20260811 08:03:55.288470 22969 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 08:03:55.316077 22970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:55.308025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54556 (local address 127.15.36.253:38657)
0811 08:03:55.308347 (+ 322us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:55.308349 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:55.308361 (+ 12us) server_negotiation.cc:407] Connection header received
0811 08:03:55.308391 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:55.308392 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:55.308403 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:55.308517 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:55.309139 (+ 622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.309866 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.310702 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.310946 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.311070 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:55.312842 (+ 1772us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:55.312843 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:55.312844 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:55.312861 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:55.314606 (+ 1745us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:55.315114 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:55.315116 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:55.315116 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:55.315192 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:55.315430 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:55.315431 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:55.315432 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:55.315589 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:55.315702 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:55.315861 (+ 159us) server_negotiation.cc:299] Negotiation successful
0811 08:03:55.315955 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":299,"thread_start_us":83,"threads_started":1}
WARNING: no policy specified for oryx/127.15.36.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.36.252@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.36.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/krb5kdc/oryx_127.15.36.252.keytab.
Entry for principal oryx/127.15.36.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/krb5kdc/oryx_127.15.36.252.keytab.
I20260811 08:03:55.351099 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.252:42241
--webserver_interface=127.15.36.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/krb5kdc/oryx_127.15.36.252.keytab
--principal=oryx/127.15.36.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:42827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.36.254:38213,127.15.36.253:38657,127.15.36.252:42241
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:03:55.442934 22974 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:03:55.443197 22974 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:03:55.443222 22974 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:03:55.444419 22974 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:03:55.444474 22974 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:03:55.444489 22974 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:03:55.444504 22974 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:03:55.444516 22974 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:03:55.446095 22974 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:42827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.15.36.254:38213,127.15.36.253:38657,127.15.36.252:42241
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/krb5kdc/oryx_127.15.36.252.keytab
--principal=oryx/127.15.36.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.252:42241
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.15.36.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22974
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:03:55.446326 22974 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:03:55.446527 22974 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:03:55.451889 22980 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:55.451879 22982 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:55.452065 22979 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:03:55.452241 22974 server_base.cc:1034] running on GCE node
I20260811 08:03:55.452499 22974 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:03:55.452824 22974 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:03:55.453991 22974 hybrid_clock.cc:648] HybridClock initialized: now 1786435435453974 us; error 32 us; skew 500 ppm
Aug 11 08:03:55 dist-test-slave-2w3w krb5kdc[22180](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435435, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.36.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:03:55.457000 22974 init.cc:377] Logged in from keytab as oryx/127.15.36.252@KRBTEST.COM (short username oryx)
I20260811 08:03:55.457528 22974 webserver.cc:460] Webserver started at http://127.15.36.252:37771/ using document root <none> and password file <none>
I20260811 08:03:55.457777 22974 fs_manager.cc:359] Metadata directory not provided
I20260811 08:03:55.457854 22974 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:03:55.457999 22974 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:03:55.459197 22974 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/master-2/data/instance:
uuid: "e42c1146baa3460b91783d5354038210"
format_stamp: "Formatted at 2026-08-11 08:03:55 on dist-test-slave-2w3w"
server_key: "a49f7361db6be19e932df63ac7fe7ce0"
server_key_iv: "3cda0c8bb0bf9eef99e0cbf359084873"
server_key_version: "encryptionkey@0"
I20260811 08:03:55.459570 22974 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/master-2/wal/instance:
uuid: "e42c1146baa3460b91783d5354038210"
format_stamp: "Formatted at 2026-08-11 08:03:55 on dist-test-slave-2w3w"
server_key: "a49f7361db6be19e932df63ac7fe7ce0"
server_key_iv: "3cda0c8bb0bf9eef99e0cbf359084873"
server_key_version: "encryptionkey@0"
I20260811 08:03:55.461067 22974 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 08:03:55.461899 22990 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:55.462127 22974 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:03:55.462234 22974 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/master-2/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/master-2/wal
uuid: "e42c1146baa3460b91783d5354038210"
format_stamp: "Formatted at 2026-08-11 08:03:55 on dist-test-slave-2w3w"
server_key: "a49f7361db6be19e932df63ac7fe7ce0"
server_key_iv: "3cda0c8bb0bf9eef99e0cbf359084873"
server_key_version: "encryptionkey@0"
I20260811 08:03:55.462308 22974 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:03:55.485005 22974 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:03:55.488268 22974 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:03:55.488497 22974 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:03:55.494112 22974 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.252:42241
I20260811 08:03:55.494136 23047 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.252:42241 every 8 connection(s)
I20260811 08:03:55.494602 22974 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/master-2/data/info.pb
I20260811 08:03:55.495855 23048 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:03:55.497781 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 22974
I20260811 08:03:55.498546 23048 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38213 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 08:03:55 dist-test-slave-2w3w krb5kdc[22180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435435, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.36.252@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM
Aug 11 08:03:55 dist-test-slave-2w3w krb5kdc[22180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435434, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.15.36.252@KRBTEST.COM
I20260811 08:03:55.509230 22275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:55.499484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54308 (local address 127.15.36.254:38213)
0811 08:03:55.499535 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:55.499537 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:55.499666 (+ 129us) server_negotiation.cc:407] Connection header received
0811 08:03:55.499745 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:55.499746 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:55.499758 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:55.499818 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:55.500550 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.501062 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.502012 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.502225 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.502308 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:55.504972 (+ 2664us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:55.504974 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:55.504974 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:55.504984 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:55.507060 (+ 2076us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:55.507590 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:55.507591 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:55.507591 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:55.507657 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:55.507986 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:55.507987 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:55.507987 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:55.508160 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:55.508258 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:55.509047 (+ 789us) server_negotiation.cc:299] Negotiation successful
0811 08:03:55.509142 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 08:03:55.509482 23053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:55.499346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:38213 (local address 127.0.0.1:54308)
0811 08:03:55.499529 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:55.499572 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:55.499680 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:55.499851 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:55.499854 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:55.500213 (+ 359us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:03:55.500446 (+ 233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:55.500451 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.501177 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.501178 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:55.501901 (+ 723us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:55.501903 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.502349 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.502350 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:55.502429 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:55.503139 (+ 710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:03:55.503150 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:03:55.504849 (+ 1699us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:03:55.507155 (+ 2306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:55.507160 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:55.507163 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:55.507487 (+ 324us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:55.507737 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:55.507738 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:55.507738 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:55.507895 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:55.508390 (+ 495us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:03:55.508396 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:03:55.508785 (+ 389us) client_negotiation.cc:769] Sending connection context
0811 08:03:55.508958 (+ 173us) client_negotiation.cc:240] Negotiation successful
0811 08:03:55.509186 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":92,"threads_started":1}
I20260811 08:03:55.509867 23052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:55.498601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36618 (local address 127.15.36.252:42241)
0811 08:03:55.498813 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:55.498822 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:55.498848 (+ 26us) server_negotiation.cc:407] Connection header received
0811 08:03:55.499508 (+ 660us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:55.499516 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:55.499580 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:55.499713 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:55.500325 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.501170 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.501908 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.502316 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.502419 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:55.505577 (+ 3158us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:55.505586 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:55.505587 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:55.505595 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:55.507825 (+ 2230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:55.508398 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:55.508402 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:55.508402 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:55.508493 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:55.509021 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:55.509022 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:55.509022 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:55.509209 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:55.509361 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:55.509512 (+ 151us) server_negotiation.cc:299] Negotiation successful
0811 08:03:55.509766 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":117,"threads_started":1}
I20260811 08:03:55.510219 23048 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.36.253" port: 38657 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 08:03:55 dist-test-slave-2w3w krb5kdc[22180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435435, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.36.252@KRBTEST.COM for oryx/127.15.36.253@KRBTEST.COM
I20260811 08:03:55.518936 23053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:55.510542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.253:38657 (local address 127.0.0.1:54562)
0811 08:03:55.510592 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:55.510603 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:55.510643 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:55.510860 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:55.510861 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:55.511073 (+ 212us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:03:55.511117 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:55.511119 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.512048 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.512049 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:55.512637 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:55.512639 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.513112 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.513113 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:55.513181 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:55.513869 (+ 688us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:03:55.513873 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:03:55.515480 (+ 1607us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:03:55.517637 (+ 2157us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:55.517638 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:55.517639 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:55.517878 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:55.518189 (+ 311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:55.518190 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:55.518191 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:55.518254 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:55.518595 (+ 341us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:03:55.518596 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:03:55.518642 (+ 46us) client_negotiation.cc:769] Sending connection context
0811 08:03:55.518715 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 08:03:55.518859 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260811 08:03:55.519205 22970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:55.510657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54562 (local address 127.15.36.253:38657)
0811 08:03:55.510706 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:55.510708 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:55.510716 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:03:55.510752 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:55.510753 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:55.510784 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:55.510859 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:55.511194 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.511825 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.512737 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.512964 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.513549 (+ 585us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:55.515600 (+ 2051us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:55.515602 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:55.515602 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:55.515610 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:55.517469 (+ 1859us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:55.517988 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:55.517989 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:55.517989 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:55.518058 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:55.518351 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:55.518352 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:55.518353 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:55.518509 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:55.518585 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:55.518779 (+ 194us) server_negotiation.cc:299] Negotiation successful
0811 08:03:55.518867 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 08:03:55.519744 23048 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.36.252" port: 42241 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 08:03:55 dist-test-slave-2w3w krb5kdc[22180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435435, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.36.252@KRBTEST.COM for oryx/127.15.36.252@KRBTEST.COM
I20260811 08:03:55.528684 23052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:55.520183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36626 (local address 127.15.36.252:42241)
0811 08:03:55.520263 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:55.520264 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:55.520290 (+ 26us) server_negotiation.cc:407] Connection header received
0811 08:03:55.520307 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:55.520308 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:55.520317 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:55.520366 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:55.520869 (+ 503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.521628 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.522674 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.523096 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.523167 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:55.525546 (+ 2379us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:55.525547 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:55.525548 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:55.525555 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:55.527235 (+ 1680us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:55.527640 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:55.527642 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:55.527642 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:55.527724 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:55.528045 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:55.528046 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:55.528046 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:55.528215 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:55.528284 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:55.528459 (+ 175us) server_negotiation.cc:299] Negotiation successful
0811 08:03:55.528564 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 08:03:55.528740 23053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:55.520123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.252:42241 (local address 127.0.0.1:36626)
0811 08:03:55.520183 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:55.520194 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:55.520246 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:55.520479 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:55.520480 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:55.520642 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:03:55.520688 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:55.520689 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.521862 (+ 1173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.521864 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:55.522538 (+ 674us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:55.522540 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.523185 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.523185 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:55.523245 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:55.523898 (+ 653us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:03:55.523904 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:03:55.525430 (+ 1526us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:03:55.527353 (+ 1923us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:55.527354 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:55.527354 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:55.527536 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:55.527883 (+ 347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:55.527884 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:55.527884 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:55.527955 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:55.528273 (+ 318us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:03:55.528274 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:03:55.528351 (+ 77us) client_negotiation.cc:769] Sending connection context
0811 08:03:55.528434 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 08:03:55.528617 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39,"mutex_wait_us":85}
I20260811 08:03:55.530443 23048 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e42c1146baa3460b91783d5354038210: Bootstrap starting.
I20260811 08:03:55.531581 23048 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e42c1146baa3460b91783d5354038210: Neither blocks nor log segments found. Creating new log.
I20260811 08:03:55.531898 23048 log.cc:824] T 00000000000000000000000000000000 P e42c1146baa3460b91783d5354038210: Log is configured to *not* fsync() on all Append() calls
I20260811 08:03:55.532723 23048 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e42c1146baa3460b91783d5354038210: No bootstrap required, opened a new log
I20260811 08:03:55.534394 23048 raft_consensus.cc:348] T 00000000000000000000000000000000 P e42c1146baa3460b91783d5354038210 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d27dfc74df774f2f8f479ece768c55ae" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38213 } } peers { permanent_uuid: "2f0c35cebbbc411eb7541511d3ca99d3" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 38657 } } peers { permanent_uuid: "e42c1146baa3460b91783d5354038210" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 42241 } }
I20260811 08:03:55.534602 23048 raft_consensus.cc:374] T 00000000000000000000000000000000 P e42c1146baa3460b91783d5354038210 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:03:55.534631 23048 raft_consensus.cc:729] T 00000000000000000000000000000000 P e42c1146baa3460b91783d5354038210 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e42c1146baa3460b91783d5354038210, State: Initialized, Role: FOLLOWER
I20260811 08:03:55.534801 23048 consensus_queue.cc:260] T 00000000000000000000000000000000 P e42c1146baa3460b91783d5354038210 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d27dfc74df774f2f8f479ece768c55ae" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38213 } } peers { permanent_uuid: "2f0c35cebbbc411eb7541511d3ca99d3" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 38657 } } peers { permanent_uuid: "e42c1146baa3460b91783d5354038210" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 42241 } }
I20260811 08:03:55.535312 23048 sys_catalog.cc:564] T 00000000000000000000000000000000 P e42c1146baa3460b91783d5354038210 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:03:55.535398 23055 sys_catalog.cc:455] T 00000000000000000000000000000000 P e42c1146baa3460b91783d5354038210 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d27dfc74df774f2f8f479ece768c55ae" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38213 } } peers { permanent_uuid: "2f0c35cebbbc411eb7541511d3ca99d3" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 38657 } } peers { permanent_uuid: "e42c1146baa3460b91783d5354038210" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 42241 } } }
I20260811 08:03:55.535516 23055 sys_catalog.cc:458] T 00000000000000000000000000000000 P e42c1146baa3460b91783d5354038210 [sys.catalog]: This master's current role is: FOLLOWER
W20260811 08:03:55.537429 23068 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e42c1146baa3460b91783d5354038210: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 08:03:55.537537 23068 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 08:03:55.542133 22974 master_runner.cc:428] Detected that this master e42c1146baa3460b91783d5354038210 is joining an existing cluster
I20260811 08:03:55.542246 22974 master_runner.cc:432] Initiating AddMaster RPC to add 127.15.36.252:42241
I20260811 08:03:55.552299 22970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:55.543982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54576 (local address 127.15.36.253:38657)
0811 08:03:55.544041 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:55.544043 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:55.544380 (+ 337us) server_negotiation.cc:407] Connection header received
0811 08:03:55.544442 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:55.544444 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:55.544464 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:55.544636 (+ 172us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:55.545367 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.546203 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.547377 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.547698 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.547747 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:55.549282 (+ 1535us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:55.549284 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:55.549284 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:55.549301 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:55.551065 (+ 1764us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:55.551518 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:55.551519 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:55.551519 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:55.551574 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:55.551792 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:55.551793 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:55.551793 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:55.551912 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:55.551977 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:55.552156 (+ 179us) server_negotiation.cc:299] Negotiation successful
0811 08:03:55.552229 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 08:03:55.552377 23075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:55.543828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.253:38657 (local address 127.0.0.1:54576)
0811 08:03:55.544110 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:55.544123 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:55.544191 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:55.544738 (+ 547us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:55.544739 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:55.545153 (+ 414us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:03:55.545251 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:55.545253 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.546311 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.546311 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:55.547268 (+ 957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:55.547270 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.547851 (+ 581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.547852 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:55.547932 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:55.548505 (+ 573us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:03:55.548535 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:03:55.549064 (+ 529us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:03:55.551152 (+ 2088us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:55.551153 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:55.551154 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:55.551435 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:55.551647 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:55.551648 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:55.551649 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:55.551725 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:55.551995 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:03:55.551996 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:03:55.552051 (+ 55us) client_negotiation.cc:769] Sending connection context
0811 08:03:55.552131 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 08:03:55.552255 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":200,"threads_started":1}
I20260811 08:03:55.558481 22450 heartbeater.cc:503] Master 127.15.36.254:38213 was elected leader, sending a full tablet report...
I20260811 08:03:55.561713 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 22302
I20260811 08:03:55.570909 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.193:38419
--local_ip_for_outbound_sockets=127.15.36.193
--tserver_master_addrs=127.15.36.254:38213
--webserver_port=41233
--webserver_interface=127.15.36.193
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/krb5kdc/oryx_127.15.36.193.keytab
--principal=oryx/127.15.36.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:42827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.15.36.254:38213,127.15.36.253:38657
--tserver_master_addrs=127.15.36.254:38213,127.15.36.253:38657,127.15.36.252:42241 with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 08:03:55.571965 23052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:55.544153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36628 (local address 127.15.36.252:42241)
0811 08:03:55.544192 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:55.544194 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:55.544717 (+ 523us) server_negotiation.cc:407] Connection header received
0811 08:03:55.544827 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:55.544828 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:55.544839 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:55.544873 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:55.545665 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.546475 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.547670 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.547985 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.548026 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:55.568562 (+ 20536us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:55.568564 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:55.568564 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:55.568571 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:55.570489 (+ 1918us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:55.570880 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:55.570881 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:55.570881 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:55.570946 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:55.571190 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:55.571191 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:55.571191 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:55.571338 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:55.571383 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:55.571709 (+ 326us) server_negotiation.cc:299] Negotiation successful
0811 08:03:55.571803 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 08:03:55.572295 23074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:55.544127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.252:42241 (local address 127.0.0.1:36628)
0811 08:03:55.544650 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:55.544660 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:55.544747 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:55.544937 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:55.544938 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:55.545443 (+ 505us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:03:55.545549 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:55.545563 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.546569 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.546570 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:55.547567 (+ 997us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:55.547570 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.548110 (+ 540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.548111 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:55.548241 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:55.567793 (+ 19552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:03:55.567800 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:03:55.568421 (+ 621us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:03:55.570596 (+ 2175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:55.570596 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:55.570597 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:55.570804 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:55.571041 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:55.571041 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:55.571042 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:55.571124 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:55.571531 (+ 407us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:03:55.571532 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:03:55.571586 (+ 54us) client_negotiation.cc:769] Sending connection context
0811 08:03:55.572091 (+ 505us) client_negotiation.cc:240] Negotiation successful
0811 08:03:55.572200 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":453,"thread_start_us":374,"threads_started":1}
I20260811 08:03:55.572444 22275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:55.543987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54322 (local address 127.15.36.254:38213)
0811 08:03:55.544040 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:55.544042 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:55.544718 (+ 676us) server_negotiation.cc:407] Connection header received
0811 08:03:55.544847 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:55.544848 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:55.544861 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:55.544897 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:55.545700 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.546546 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.547678 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.548030 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.548077 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:55.568591 (+ 20514us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:55.568594 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:55.568594 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:55.568604 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:55.570765 (+ 2161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:55.571483 (+ 718us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:55.571484 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:55.571485 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:55.571557 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:55.571778 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:55.571779 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:55.571779 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:55.571938 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:55.571994 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:55.572196 (+ 202us) server_negotiation.cc:299] Negotiation successful
0811 08:03:55.572297 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 08:03:55.572938 23076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:55.543870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:38213 (local address 127.0.0.1:54322)
0811 08:03:55.544612 (+ 742us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:55.544644 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:55.544748 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:55.544972 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:55.544985 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:55.545442 (+ 457us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:03:55.545597 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:55.545598 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.546648 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.546648 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:55.547578 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:55.547580 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.548155 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.548156 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:55.548241 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:55.567688 (+ 19447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:03:55.567696 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:03:55.568441 (+ 745us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:03:55.571013 (+ 2572us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:55.571014 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:55.571015 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:55.571268 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:55.571636 (+ 368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:55.571637 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:55.571637 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:55.571708 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:55.572031 (+ 323us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:03:55.572032 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:03:55.572080 (+ 48us) client_negotiation.cc:769] Sending connection context
0811 08:03:55.572648 (+ 568us) client_negotiation.cc:240] Negotiation successful
0811 08:03:55.572805 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":720,"thread_start_us":82,"threads_started":1}
Aug 11 08:03:55 dist-test-slave-2w3w krb5kdc[22180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435434, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.36.254@KRBTEST.COM for oryx/127.15.36.252@KRBTEST.COM
I20260811 08:03:55.584000 22865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:55.575409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.252:42241 (local address 127.0.0.1:36640)
0811 08:03:55.575507 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:55.575518 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:55.575557 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:55.575712 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:55.575713 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:55.575901 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:03:55.575955 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:55.575956 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.576874 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.576875 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:55.577683 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:55.577686 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.578208 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.578209 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:55.578283 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:55.578798 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:03:55.578804 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:03:55.580441 (+ 1637us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:03:55.582618 (+ 2177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:55.582619 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:55.582620 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:55.582881 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:55.583158 (+ 277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:55.583159 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:55.583159 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:55.583233 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:55.583564 (+ 331us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:03:55.583565 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:03:55.583624 (+ 59us) client_negotiation.cc:769] Sending connection context
0811 08:03:55.583701 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 08:03:55.583895 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":79}
I20260811 08:03:55.583998 23052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:55.575526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36640 (local address 127.15.36.252:42241)
0811 08:03:55.575571 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:55.575573 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:55.575582 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:03:55.575632 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:55.575633 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:55.575644 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:55.575695 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:55.576039 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.576797 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.577779 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.578120 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.578201 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:55.580564 (+ 2363us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:55.580566 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:55.580566 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:55.580576 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:55.582499 (+ 1923us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:55.582991 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:55.582992 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:55.582992 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:55.583067 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:55.583310 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:55.583311 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:55.583312 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:55.583484 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:55.583567 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:55.583750 (+ 183us) server_negotiation.cc:299] Negotiation successful
0811 08:03:55.583856 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 08:03:55.585078 22231 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.15.36.252:42241: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "e42c1146baa3460b91783d5354038210"
member_type: NON_VOTER
last_known_addr {
host: "127.15.36.252"
port: 42241
}
attrs {
promote: true
}
}
dest_uuid: "d27dfc74df774f2f8f479ece768c55ae"
cas_config_opid_index: 5
I20260811 08:03:55.585358 22231 consensus_queue.cc:237] T 00000000000000000000000000000000 P d27dfc74df774f2f8f479ece768c55ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "d27dfc74df774f2f8f479ece768c55ae" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38213 } } peers { permanent_uuid: "2f0c35cebbbc411eb7541511d3ca99d3" member_type: NON_VOTER last_known_addr { host: "127.15.36.253" port: 38657 } attrs { promote: true } } peers { permanent_uuid: "e42c1146baa3460b91783d5354038210" member_type: NON_VOTER last_known_addr { host: "127.15.36.252" port: 42241 } attrs { promote: true } }
I20260811 08:03:55.585872 22866 raft_consensus.cc:2932] T 00000000000000000000000000000000 P d27dfc74df774f2f8f479ece768c55ae [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER e42c1146baa3460b91783d5354038210 (127.15.36.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "d27dfc74df774f2f8f479ece768c55ae" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38213 } } peers { permanent_uuid: "2f0c35cebbbc411eb7541511d3ca99d3" member_type: NON_VOTER last_known_addr { host: "127.15.36.253" port: 38657 } attrs { promote: true } } peers { permanent_uuid: "e42c1146baa3460b91783d5354038210" member_type: NON_VOTER last_known_addr { host: "127.15.36.252" port: 42241 } attrs { promote: true } } }
I20260811 08:03:55.587833 23020 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e42c1146baa3460b91783d5354038210 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:03:55.588917 23020 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e42c1146baa3460b91783d5354038210 [term 1 FOLLOWER]: Refusing update from remote peer d27dfc74df774f2f8f479ece768c55ae: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260811 08:03:55.590065 22866 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.15.36.252:42241
I20260811 08:03:55.590157 22866 sys_catalog.cc:455] T 00000000000000000000000000000000 P d27dfc74df774f2f8f479ece768c55ae [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "d27dfc74df774f2f8f479ece768c55ae" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "d27dfc74df774f2f8f479ece768c55ae" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38213 } } peers { permanent_uuid: "2f0c35cebbbc411eb7541511d3ca99d3" member_type: NON_VOTER last_known_addr { host: "127.15.36.253" port: 38657 } attrs { promote: true } } peers { permanent_uuid: "e42c1146baa3460b91783d5354038210" member_type: NON_VOTER last_known_addr { host: "127.15.36.252" port: 42241 } attrs { promote: true } } }
I20260811 08:03:55.590229 22866 sys_catalog.cc:458] T 00000000000000000000000000000000 P d27dfc74df774f2f8f479ece768c55ae [sys.catalog]: This master's current role is: LEADER
I20260811 08:03:55.590412 22867 consensus_queue.cc:1035] T 00000000000000000000000000000000 P d27dfc74df774f2f8f479ece768c55ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "e42c1146baa3460b91783d5354038210" member_type: NON_VOTER last_known_addr { host: "127.15.36.252" port: 42241 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:03:55.591094 22974 master.cc:537] Master@127.15.36.252:42241 shutting down...
I20260811 08:03:55.592542 23020 raft_consensus.cc:858] T 00000000000000000000000000000000 P e42c1146baa3460b91783d5354038210 [term 1 NON_PARTICIPANT]: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d27dfc74df774f2f8f479ece768c55ae" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38213 } } peers { permanent_uuid: "2f0c35cebbbc411eb7541511d3ca99d3" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 38657 } } peers { permanent_uuid: "e42c1146baa3460b91783d5354038210" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 42241 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "d27dfc74df774f2f8f479ece768c55ae" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38213 } } peers { permanent_uuid: "2f0c35cebbbc411eb7541511d3ca99d3" member_type: NON_VOTER last_known_addr { host: "127.15.36.253" port: 38657 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "d27dfc74df774f2f8f479ece768c55ae" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38213 } } peers { permanent_uuid: "2f0c35cebbbc411eb7541511d3ca99d3" member_type: NON_VOTER last_known_addr { host: "127.15.36.253" port: 38657 } attrs { promote: true } } peers { permanent_uuid: "e42c1146baa3460b91783d5354038210" member_type: NON_VOTER last_known_addr { host: "127.15.36.252" port: 42241 } attrs { promote: true } }
W20260811 08:03:55.592626 23020 raft_consensus.cc:1565] T 00000000000000000000000000000000 P e42c1146baa3460b91783d5354038210 [term 1 NON_PARTICIPANT]: Could not prepare op 'term: 1 index: 6' and following 0 ops. Status for this op: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d27dfc74df774f2f8f479ece768c55ae" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38213 } } peers { permanent_uuid: "2f0c35cebbbc411eb7541511d3ca99d3" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 38657 } } peers { permanent_uuid: "e42c1146baa3460b91783d5354038210" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 42241 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "d27dfc74df774f2f8f479ece768c55ae" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38213 } } peers { permanent_uuid: "2f0c35cebbbc411eb7541511d3ca99d3" member_type: NON_VOTER last_known_addr { host: "127.15.36.253" port: 38657 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "d27dfc74df774f2f8f479ece768c55ae" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38213 } } peers { permanent_uuid: "2f0c35cebbbc411eb7541511d3ca99d3" member_type: NON_VOTER last_known_addr { host: "127.15.36.253" port: 38657 } attrs { promote: true } } peers { permanent_uuid: "e42c1146baa3460b91783d5354038210" member_type: NON_VOTER last_known_addr { host: "127.15.36.252" port: 42241 } attrs { promote: true } }
I20260811 08:03:55.593593 23020 raft_consensus.cc:2932] T 00000000000000000000000000000000 P e42c1146baa3460b91783d5354038210 [term 1 NON_PARTICIPANT]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 2f0c35cebbbc411eb7541511d3ca99d3 (127.15.36.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "d27dfc74df774f2f8f479ece768c55ae" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38213 } } peers { permanent_uuid: "2f0c35cebbbc411eb7541511d3ca99d3" member_type: NON_VOTER last_known_addr { host: "127.15.36.253" port: 38657 } attrs { promote: true } } }
I20260811 08:03:55.595225 23055 sys_catalog.cc:455] T 00000000000000000000000000000000 P e42c1146baa3460b91783d5354038210 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d27dfc74df774f2f8f479ece768c55ae. Latest consensus state: current_term: 1 leader_uuid: "d27dfc74df774f2f8f479ece768c55ae" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "d27dfc74df774f2f8f479ece768c55ae" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38213 } } peers { permanent_uuid: "2f0c35cebbbc411eb7541511d3ca99d3" member_type: NON_VOTER last_known_addr { host: "127.15.36.253" port: 38657 } attrs { promote: true } } }
I20260811 08:03:55.595319 23055 sys_catalog.cc:458] T 00000000000000000000000000000000 P e42c1146baa3460b91783d5354038210 [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260811 08:03:55.595357 23055 sys_catalog.cc:455] T 00000000000000000000000000000000 P e42c1146baa3460b91783d5354038210 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d27dfc74df774f2f8f479ece768c55ae" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "d27dfc74df774f2f8f479ece768c55ae" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38213 } } peers { permanent_uuid: "2f0c35cebbbc411eb7541511d3ca99d3" member_type: NON_VOTER last_known_addr { host: "127.15.36.253" port: 38657 } attrs { promote: true } } }
I20260811 08:03:55.595392 23055 sys_catalog.cc:458] T 00000000000000000000000000000000 P e42c1146baa3460b91783d5354038210 [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260811 08:03:55.595417 23055 sys_catalog.cc:455] T 00000000000000000000000000000000 P e42c1146baa3460b91783d5354038210 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d27dfc74df774f2f8f479ece768c55ae" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "d27dfc74df774f2f8f479ece768c55ae" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38213 } } peers { permanent_uuid: "2f0c35cebbbc411eb7541511d3ca99d3" member_type: NON_VOTER last_known_addr { host: "127.15.36.253" port: 38657 } attrs { promote: true } } }
I20260811 08:03:55.595446 23055 sys_catalog.cc:458] T 00000000000000000000000000000000 P e42c1146baa3460b91783d5354038210 [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260811 08:03:55.596313 22865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:55.587560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.253:38657 (local address 127.0.0.1:54582)
0811 08:03:55.587604 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:55.587616 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:55.587665 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:55.589458 (+ 1793us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:55.589459 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:55.589462 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:03:55.589513 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:55.589515 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.590625 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.590626 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:55.592994 (+ 2368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:55.592999 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.595933 (+ 2934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.595935 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:55.596046 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:55.596094 (+ 48us) client_negotiation.cc:769] Sending connection context
0811 08:03:55.596166 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 08:03:55.596224 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22}
I20260811 08:03:55.596489 22867 sys_catalog.cc:455] T 00000000000000000000000000000000 P d27dfc74df774f2f8f479ece768c55ae [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d27dfc74df774f2f8f479ece768c55ae" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "d27dfc74df774f2f8f479ece768c55ae" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38213 } } peers { permanent_uuid: "2f0c35cebbbc411eb7541511d3ca99d3" member_type: NON_VOTER last_known_addr { host: "127.15.36.253" port: 38657 } attrs { promote: true } } peers { permanent_uuid: "e42c1146baa3460b91783d5354038210" member_type: NON_VOTER last_known_addr { host: "127.15.36.252" port: 42241 } attrs { promote: true } } }
I20260811 08:03:55.596598 22867 sys_catalog.cc:458] T 00000000000000000000000000000000 P d27dfc74df774f2f8f479ece768c55ae [sys.catalog]: This master's current role is: LEADER
W20260811 08:03:55.597092 22217 consensus_peers.cc:487] T 00000000000000000000000000000000 P d27dfc74df774f2f8f479ece768c55ae -> Peer e42c1146baa3460b91783d5354038210 (127.15.36.252:42241): Couldn't send request to peer e42c1146baa3460b91783d5354038210. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260811 08:03:55.597718 22974 raft_consensus.cc:2229] T 00000000000000000000000000000000 P e42c1146baa3460b91783d5354038210 [term 1 NON_PARTICIPANT]: Raft consensus shutting down.
I20260811 08:03:55.597787 22970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:55.589190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54582 (local address 127.15.36.253:38657)
0811 08:03:55.589241 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:55.589243 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:55.589253 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:03:55.589284 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:55.589285 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:55.589312 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:55.589384 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:03:55.589588 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.590354 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.593518 (+ 3164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.594184 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.594282 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:55.594357 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:55.597625 (+ 3268us) server_negotiation.cc:299] Negotiation successful
0811 08:03:55.597697 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 08:03:55.597843 22974 raft_consensus.cc:2258] T 00000000000000000000000000000000 P e42c1146baa3460b91783d5354038210 [term 1 NON_PARTICIPANT]: Raft consensus is shut down!
I20260811 08:03:55.597879 22974 tablet_replica.cc:330] T 00000000000000000000000000000000 P e42c1146baa3460b91783d5354038210: stopping tablet replica
I20260811 08:03:55.598016 22924 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3 [term 1 LEARNER]: Refusing update from remote peer d27dfc74df774f2f8f479ece768c55ae: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260811 08:03:55.598248 22866 consensus_queue.cc:1035] T 00000000000000000000000000000000 P d27dfc74df774f2f8f479ece768c55ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f0c35cebbbc411eb7541511d3ca99d3" member_type: NON_VOTER last_known_addr { host: "127.15.36.253" port: 38657 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260811 08:03:55.598901 22924 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER e42c1146baa3460b91783d5354038210 (127.15.36.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "d27dfc74df774f2f8f479ece768c55ae" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38213 } } peers { permanent_uuid: "2f0c35cebbbc411eb7541511d3ca99d3" member_type: NON_VOTER last_known_addr { host: "127.15.36.253" port: 38657 } attrs { promote: true } } peers { permanent_uuid: "e42c1146baa3460b91783d5354038210" member_type: NON_VOTER last_known_addr { host: "127.15.36.252" port: 42241 } attrs { promote: true } } }
I20260811 08:03:55.600378 22958 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d27dfc74df774f2f8f479ece768c55ae. Latest consensus state: current_term: 1 leader_uuid: "d27dfc74df774f2f8f479ece768c55ae" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "d27dfc74df774f2f8f479ece768c55ae" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38213 } } peers { permanent_uuid: "2f0c35cebbbc411eb7541511d3ca99d3" member_type: NON_VOTER last_known_addr { host: "127.15.36.253" port: 38657 } attrs { promote: true } } peers { permanent_uuid: "e42c1146baa3460b91783d5354038210" member_type: NON_VOTER last_known_addr { host: "127.15.36.252" port: 42241 } attrs { promote: true } } }
I20260811 08:03:55.600459 22958 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3 [sys.catalog]: This master's current role is: LEARNER
I20260811 08:03:55.600497 22958 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d27dfc74df774f2f8f479ece768c55ae" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "d27dfc74df774f2f8f479ece768c55ae" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38213 } } peers { permanent_uuid: "2f0c35cebbbc411eb7541511d3ca99d3" member_type: NON_VOTER last_known_addr { host: "127.15.36.253" port: 38657 } attrs { promote: true } } peers { permanent_uuid: "e42c1146baa3460b91783d5354038210" member_type: NON_VOTER last_known_addr { host: "127.15.36.252" port: 42241 } attrs { promote: true } } }
I20260811 08:03:55.600553 22958 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3 [sys.catalog]: This master's current role is: LEARNER
I20260811 08:03:55.601120 22866 raft_consensus.cc:1050] T 00000000000000000000000000000000 P d27dfc74df774f2f8f479ece768c55ae: attempting to promote NON_VOTER 2f0c35cebbbc411eb7541511d3ca99d3 to VOTER
I20260811 08:03:55.601317 22866 consensus_queue.cc:237] T 00000000000000000000000000000000 P d27dfc74df774f2f8f479ece768c55ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "d27dfc74df774f2f8f479ece768c55ae" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38213 } } peers { permanent_uuid: "2f0c35cebbbc411eb7541511d3ca99d3" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 38657 } attrs { promote: false } } peers { permanent_uuid: "e42c1146baa3460b91783d5354038210" member_type: NON_VOTER last_known_addr { host: "127.15.36.252" port: 42241 } attrs { promote: true } }
I20260811 08:03:55.602381 22924 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3 [term 1 LEARNER]: Refusing update from remote peer d27dfc74df774f2f8f479ece768c55ae: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260811 08:03:55.602582 22867 consensus_queue.cc:1035] T 00000000000000000000000000000000 P d27dfc74df774f2f8f479ece768c55ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f0c35cebbbc411eb7541511d3ca99d3" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 38657 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260811 08:03:55.603042 22865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:55.602112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.252:42241 (local address 127.0.0.1:36642)
0811 08:03:55.602633 (+ 521us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:55.602684 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.252:42241: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":500}
W20260811 08:03:55.603106 22217 consensus_peers.cc:487] T 00000000000000000000000000000000 P d27dfc74df774f2f8f479ece768c55ae -> Peer e42c1146baa3460b91783d5354038210 (127.15.36.252:42241): Couldn't send request to peer e42c1146baa3460b91783d5354038210. Status: Network error: Client connection negotiation failed: client connection to 127.15.36.252:42241: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 08:03:55.603446 22866 raft_consensus.cc:2932] T 00000000000000000000000000000000 P d27dfc74df774f2f8f479ece768c55ae [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 2f0c35cebbbc411eb7541511d3ca99d3 (127.15.36.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "d27dfc74df774f2f8f479ece768c55ae" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38213 } } peers { permanent_uuid: "2f0c35cebbbc411eb7541511d3ca99d3" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 38657 } attrs { promote: false } } peers { permanent_uuid: "e42c1146baa3460b91783d5354038210" member_type: NON_VOTER last_known_addr { host: "127.15.36.252" port: 42241 } attrs { promote: true } } }
I20260811 08:03:55.604398 22866 sys_catalog.cc:455] T 00000000000000000000000000000000 P d27dfc74df774f2f8f479ece768c55ae [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "d27dfc74df774f2f8f479ece768c55ae" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "d27dfc74df774f2f8f479ece768c55ae" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38213 } } peers { permanent_uuid: "2f0c35cebbbc411eb7541511d3ca99d3" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 38657 } attrs { promote: false } } peers { permanent_uuid: "e42c1146baa3460b91783d5354038210" member_type: NON_VOTER last_known_addr { host: "127.15.36.252" port: 42241 } attrs { promote: true } } }
I20260811 08:03:55.604468 22866 sys_catalog.cc:458] T 00000000000000000000000000000000 P d27dfc74df774f2f8f479ece768c55ae [sys.catalog]: This master's current role is: LEADER
I20260811 08:03:55.604431 22867 sys_catalog.cc:455] T 00000000000000000000000000000000 P d27dfc74df774f2f8f479ece768c55ae [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d27dfc74df774f2f8f479ece768c55ae" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "d27dfc74df774f2f8f479ece768c55ae" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38213 } } peers { permanent_uuid: "2f0c35cebbbc411eb7541511d3ca99d3" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 38657 } attrs { promote: false } } peers { permanent_uuid: "e42c1146baa3460b91783d5354038210" member_type: NON_VOTER last_known_addr { host: "127.15.36.252" port: 42241 } attrs { promote: true } } }
I20260811 08:03:55.604514 22867 sys_catalog.cc:458] T 00000000000000000000000000000000 P d27dfc74df774f2f8f479ece768c55ae [sys.catalog]: This master's current role is: LEADER
I20260811 08:03:55.604873 22924 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 2f0c35cebbbc411eb7541511d3ca99d3 (127.15.36.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "d27dfc74df774f2f8f479ece768c55ae" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38213 } } peers { permanent_uuid: "2f0c35cebbbc411eb7541511d3ca99d3" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 38657 } attrs { promote: false } } peers { permanent_uuid: "e42c1146baa3460b91783d5354038210" member_type: NON_VOTER last_known_addr { host: "127.15.36.252" port: 42241 } attrs { promote: true } } }
I20260811 08:03:55.605800 22958 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d27dfc74df774f2f8f479ece768c55ae" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "d27dfc74df774f2f8f479ece768c55ae" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38213 } } peers { permanent_uuid: "2f0c35cebbbc411eb7541511d3ca99d3" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 38657 } attrs { promote: false } } peers { permanent_uuid: "e42c1146baa3460b91783d5354038210" member_type: NON_VOTER last_known_addr { host: "127.15.36.252" port: 42241 } attrs { promote: true } } }
I20260811 08:03:55.605873 22958 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 08:03:55.618624 22974 master.cc:552] Master@127.15.36.252:42241 shutdown complete.
I20260811 08:03:55.618703 22974 master_runner.cc:305] Clearing existing system tablet
I20260811 08:03:55.618862 22974 fs_manager.cc:359] Metadata directory not provided
I20260811 08:03:55.618916 22974 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:03:55.619777 22974 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.000s
I20260811 08:03:55.620426 23094 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:55.620554 22974 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:03:55.620604 22974 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:55.620625 22974 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/master-2/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/master-2/wal
uuid: "e42c1146baa3460b91783d5354038210"
format_stamp: "Formatted at 2026-08-11 08:03:55 on dist-test-slave-2w3w"
server_key: "a49f7361db6be19e932df63ac7fe7ce0"
server_key_iv: "3cda0c8bb0bf9eef99e0cbf359084873"
server_key_version: "encryptionkey@0"
I20260811 08:03:55.621738 22974 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P e42c1146baa3460b91783d5354038210: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:03:55.623919 22974 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P e42c1146baa3460b91783d5354038210: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260811 08:03:55.624015 22974 log.cc:1196] T 00000000000000000000000000000000 P e42c1146baa3460b91783d5354038210: Deleting WAL directory at /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260811 08:03:55.624266 22974 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P e42c1146baa3460b91783d5354038210: Deleting consensus metadata
I20260811 08:03:55.624495 22974 master_runner.cc:315] Copying system tablet from 127.15.36.254:38213
I20260811 08:03:55.625160 22974 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P e42c1146baa3460b91783d5354038210: tablet copy: Beginning tablet copy session from remote peer at address 127.15.36.254:38213
I20260811 08:03:55.635121 22275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:55.625604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54334 (local address 127.15.36.254:38213)
0811 08:03:55.625657 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:55.625659 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:55.627179 (+ 1520us) server_negotiation.cc:407] Connection header received
0811 08:03:55.627255 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:55.627256 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:55.627271 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:55.627358 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:55.627805 (+ 447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.628662 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.629765 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.630083 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.630151 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:55.631627 (+ 1476us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:55.631629 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:55.631630 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:55.631639 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:55.633657 (+ 2018us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:55.634139 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:55.634140 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:55.634141 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:55.634216 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:55.634459 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:55.634461 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:55.634461 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:55.634622 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:55.634695 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:55.634894 (+ 199us) server_negotiation.cc:299] Negotiation successful
0811 08:03:55.635018 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 08:03:55.635150 23100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:55.625519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:38213 (local address 127.0.0.1:54334)
0811 08:03:55.627063 (+ 1544us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:55.627081 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:55.627181 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:55.627380 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:55.627381 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:55.627653 (+ 272us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:03:55.627711 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:55.627713 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.628757 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.628758 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:55.629659 (+ 901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:55.629662 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.630166 (+ 504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.630167 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:55.630231 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:55.630816 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:03:55.630831 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:03:55.631509 (+ 678us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:03:55.633790 (+ 2281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:55.633791 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:55.633792 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:55.634044 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:55.634297 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:55.634297 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:55.634298 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:55.634380 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:55.634701 (+ 321us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:03:55.634702 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:03:55.634773 (+ 71us) client_negotiation.cc:769] Sending connection context
0811 08:03:55.634856 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 08:03:55.635045 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1514,"thread_start_us":79,"threads_started":1}
I20260811 08:03:55.635968 22253 tablet_copy_service.cc:140] P d27dfc74df774f2f8f479ece768c55ae: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer e42c1146baa3460b91783d5354038210 ({username='oryx', principal='oryx/127.15.36.252@KRBTEST.COM'} at 127.0.0.1:54334)
I20260811 08:03:55.636044 22253 tablet_copy_service.cc:161] P d27dfc74df774f2f8f479ece768c55ae: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer e42c1146baa3460b91783d5354038210 at {username='oryx', principal='oryx/127.15.36.252@KRBTEST.COM'} at 127.0.0.1:54334: session id = e42c1146baa3460b91783d5354038210-00000000000000000000000000000000
I20260811 08:03:55.636698 22253 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P d27dfc74df774f2f8f479ece768c55ae: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 08:03:55.637313 22974 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260811 08:03:55.638900 22974 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P e42c1146baa3460b91783d5354038210: tablet copy: Starting download of 0 data blocks...
I20260811 08:03:55.639139 22974 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P e42c1146baa3460b91783d5354038210: tablet copy: Starting download of 1 WAL segments...
I20260811 08:03:55.640010 22974 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P e42c1146baa3460b91783d5354038210: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 08:03:55.641211 22253 tablet_copy_service.cc:342] P d27dfc74df774f2f8f479ece768c55ae: Request end of tablet copy session e42c1146baa3460b91783d5354038210-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.15.36.252@KRBTEST.COM'} at 127.0.0.1:54334
I20260811 08:03:55.641287 22253 tablet_copy_service.cc:433] P d27dfc74df774f2f8f479ece768c55ae: ending tablet copy session e42c1146baa3460b91783d5354038210-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer e42c1146baa3460b91783d5354038210
I20260811 08:03:55.644852 22974 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:03:55.646325 23102 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:55.646577 23103 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:55.646827 23105 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:03:55.647267 22974 server_base.cc:1034] running on GCE node
I20260811 08:03:55.647424 22974 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:03:55.647584 22974 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:03:55.648726 22974 hybrid_clock.cc:648] HybridClock initialized: now 1786435435648710 us; error 32 us; skew 500 ppm
Aug 11 08:03:55 dist-test-slave-2w3w krb5kdc[22180](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435435, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.36.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:03:55.651882 22974 init.cc:377] Logged in from keytab as oryx/127.15.36.252@KRBTEST.COM (short username oryx)
I20260811 08:03:55.652417 22974 webserver.cc:460] Webserver started at http://127.15.36.252:39379/ using document root <none> and password file <none>
I20260811 08:03:55.652660 22974 fs_manager.cc:359] Metadata directory not provided
I20260811 08:03:55.652769 22974 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:03:55.653761 22974 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.000s
I20260811 08:03:55.654436 23113 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:55.654564 22974 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:55.654605 22974 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/master-2/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/master-2/wal
uuid: "e42c1146baa3460b91783d5354038210"
format_stamp: "Formatted at 2026-08-11 08:03:55 on dist-test-slave-2w3w"
server_key: "a49f7361db6be19e932df63ac7fe7ce0"
server_key_iv: "3cda0c8bb0bf9eef99e0cbf359084873"
server_key_version: "encryptionkey@0"
I20260811 08:03:55.654671 22974 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:03:55.667253 22974 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:03:55.669371 22974 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:03:55.673244 22974 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.252:42241
I20260811 08:03:55.673638 23170 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.252:42241 every 8 connection(s)
I20260811 08:03:55.673684 22974 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/master-2/data/info.pb
I20260811 08:03:55.674863 23171 sys_catalog.cc:263] Verifying existing consensus state
I20260811 08:03:55.675602 23171 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e42c1146baa3460b91783d5354038210: Bootstrap starting.
I20260811 08:03:55.678434 23171 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e42c1146baa3460b91783d5354038210: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 08:03:55.678781 23171 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e42c1146baa3460b91783d5354038210: Bootstrap complete.
I20260811 08:03:55.679083 23171 raft_consensus.cc:348] T 00000000000000000000000000000000 P e42c1146baa3460b91783d5354038210 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "d27dfc74df774f2f8f479ece768c55ae" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38213 } } peers { permanent_uuid: "2f0c35cebbbc411eb7541511d3ca99d3" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 38657 } attrs { promote: false } } peers { permanent_uuid: "e42c1146baa3460b91783d5354038210" member_type: NON_VOTER last_known_addr { host: "127.15.36.252" port: 42241 } attrs { promote: true } }
I20260811 08:03:55.679186 23171 raft_consensus.cc:729] T 00000000000000000000000000000000 P e42c1146baa3460b91783d5354038210 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e42c1146baa3460b91783d5354038210, State: Initialized, Role: LEARNER
I20260811 08:03:55.679226 23171 consensus_queue.cc:260] T 00000000000000000000000000000000 P e42c1146baa3460b91783d5354038210 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "d27dfc74df774f2f8f479ece768c55ae" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38213 } } peers { permanent_uuid: "2f0c35cebbbc411eb7541511d3ca99d3" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 38657 } attrs { promote: false } } peers { permanent_uuid: "e42c1146baa3460b91783d5354038210" member_type: NON_VOTER last_known_addr { host: "127.15.36.252" port: 42241 } attrs { promote: true } }
I20260811 08:03:55.679456 23171 sys_catalog.cc:564] T 00000000000000000000000000000000 P e42c1146baa3460b91783d5354038210 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:03:55.682080 23174 sys_catalog.cc:455] T 00000000000000000000000000000000 P e42c1146baa3460b91783d5354038210 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "d27dfc74df774f2f8f479ece768c55ae" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38213 } } peers { permanent_uuid: "2f0c35cebbbc411eb7541511d3ca99d3" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 38657 } attrs { promote: false } } peers { permanent_uuid: "e42c1146baa3460b91783d5354038210" member_type: NON_VOTER last_known_addr { host: "127.15.36.252" port: 42241 } attrs { promote: true } } }
I20260811 08:03:55.682210 23174 sys_catalog.cc:458] T 00000000000000000000000000000000 P e42c1146baa3460b91783d5354038210 [sys.catalog]: This master's current role is: LEARNER
I20260811 08:03:55.682458 23188 catalog_manager.cc:1259] Loaded cluster ID: db71382509734f74afa8ec085bf13168
I20260811 08:03:55.682505 23188 catalog_manager.cc:1552] T 00000000000000000000000000000000 P e42c1146baa3460b91783d5354038210: loading cluster ID for follower catalog manager: success
I20260811 08:03:55.683635 23188 catalog_manager.cc:1574] T 00000000000000000000000000000000 P e42c1146baa3460b91783d5354038210: acquiring CA information for follower catalog manager: success
I20260811 08:03:55.683984 23188 catalog_manager.cc:1602] T 00000000000000000000000000000000 P e42c1146baa3460b91783d5354038210: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260811 08:03:55.689834 23079 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:03:55.690135 23079 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:03:55.690166 23079 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:03:55.691854 23079 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:03:55.691926 23079 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:03:55.691962 23079 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.193
I20260811 08:03:55.694229 23079 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:42827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/krb5kdc/oryx_127.15.36.193.keytab
--principal=oryx/127.15.36.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.193:38419
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.36.193
--webserver_port=41233
--tserver_master_addrs=127.15.36.254:38213,127.15.36.253:38657,127.15.36.252:42241
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23079
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.193
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:03:55.694535 23079 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:03:55.694849 23079 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:03:55.700958 23195 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:55.701112 23194 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:55.701258 23198 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:03:55.701848 23079 server_base.cc:1034] running on GCE node
I20260811 08:03:55.702111 23079 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:03:55.702461 23079 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:03:55.703625 23079 hybrid_clock.cc:648] HybridClock initialized: now 1786435435703613 us; error 30 us; skew 500 ppm
Aug 11 08:03:55 dist-test-slave-2w3w krb5kdc[22180](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435435, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.36.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:03:55.707347 23079 init.cc:377] Logged in from keytab as oryx/127.15.36.193@KRBTEST.COM (short username oryx)
I20260811 08:03:55.707854 23079 webserver.cc:460] Webserver started at http://127.15.36.193:41233/ using document root <none> and password file <none>
I20260811 08:03:55.708133 23079 fs_manager.cc:359] Metadata directory not provided
I20260811 08:03:55.708231 23079 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:03:55.709856 23079 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:03:55.710677 23205 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:55.710942 23079 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:03:55.711305 23079 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-0/wal
uuid: "cd701cdf69504752aa640a88a90093d6"
format_stamp: "Formatted at 2026-08-11 08:03:54 on dist-test-slave-2w3w"
server_key: "9a71ca3be861f92f95ee9aca6bf22c60"
server_key_iv: "3a5a0d8b2c609a5b4e8a867b4443096d"
server_key_version: "encryptionkey@0"
I20260811 08:03:55.711798 23079 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:03:55.724648 23079 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:03:55.727439 23079 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:03:55.727633 23079 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:03:55.727914 23079 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:03:55.728268 23079 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:03:55.728339 23079 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:55.728377 23079 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:03:55.728404 23079 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:55.736055 23079 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.193:38419
I20260811 08:03:55.736095 23333 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.193:38419 every 8 connection(s)
I20260811 08:03:55.736584 23079 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
I20260811 08:03:55.739686 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 23079
I20260811 08:03:55.740008 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 22456
Aug 11 08:03:55 dist-test-slave-2w3w krb5kdc[22180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435435, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.36.193@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM
Aug 11 08:03:55 dist-test-slave-2w3w krb5kdc[22180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435435, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.36.193@KRBTEST.COM for oryx/127.15.36.252@KRBTEST.COM
Aug 11 08:03:55 dist-test-slave-2w3w krb5kdc[22180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435435, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.36.193@KRBTEST.COM for oryx/127.15.36.253@KRBTEST.COM
I20260811 08:03:55.752708 22275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:55.737540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:52753 (local address 127.15.36.254:38213)
0811 08:03:55.737598 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:55.737601 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:55.738258 (+ 657us) server_negotiation.cc:407] Connection header received
0811 08:03:55.738893 (+ 635us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:55.738895 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:55.738911 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:55.738967 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:55.740322 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.740993 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.742691 (+ 1698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.743085 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.743133 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:55.748007 (+ 4874us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:55.748009 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:55.748009 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:55.748020 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:55.750746 (+ 2726us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:55.751532 (+ 786us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:55.751533 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:55.751533 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:55.751592 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:55.751840 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:55.751841 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:55.751841 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:55.751978 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:55.752035 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:55.752502 (+ 467us) server_negotiation.cc:299] Negotiation successful
0811 08:03:55.752601 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 08:03:55.752822 22970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:55.737516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:35287 (local address 127.15.36.253:38657)
0811 08:03:55.737583 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:55.737586 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:55.737986 (+ 400us) server_negotiation.cc:407] Connection header received
0811 08:03:55.738820 (+ 834us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:55.738822 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:55.738835 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:55.738899 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:55.742005 (+ 3106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.742937 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.744140 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.744559 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.744652 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:55.748122 (+ 3470us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:55.748124 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:55.748125 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:55.748136 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:55.750470 (+ 2334us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:55.751412 (+ 942us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:55.751413 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:55.751414 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:55.751478 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:55.751794 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:55.751795 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:55.751796 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:55.751969 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:55.752024 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:55.752576 (+ 552us) server_negotiation.cc:299] Negotiation successful
0811 08:03:55.752676 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 08:03:55.753295 23342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:55.737504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:38213 (local address 127.15.36.193:52753)
0811 08:03:55.738183 (+ 679us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:55.738194 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:55.738658 (+ 464us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:55.739490 (+ 832us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:55.739491 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:55.739719 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:03:55.740191 (+ 472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:55.740195 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.741121 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.741121 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:55.742426 (+ 1305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:55.742429 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.743239 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.743240 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:55.743555 (+ 315us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:55.744237 (+ 682us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:03:55.744249 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:03:55.747922 (+ 3673us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:03:55.750862 (+ 2940us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:55.750863 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:55.750864 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:55.751427 (+ 563us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:55.751668 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:55.751669 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:55.751669 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:55.751751 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:55.752070 (+ 319us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:03:55.752070 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:03:55.752275 (+ 205us) client_negotiation.cc:769] Sending connection context
0811 08:03:55.752875 (+ 600us) client_negotiation.cc:240] Negotiation successful
0811 08:03:55.753004 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":649,"mutex_wait_us":34,"thread_start_us":133,"threads_started":1}
I20260811 08:03:55.753360 23339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:55.737503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.253:38657 (local address 127.15.36.193:35287)
0811 08:03:55.737802 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:55.737856 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:55.738654 (+ 798us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:55.739042 (+ 388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:55.739047 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:55.739594 (+ 547us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:03:55.741888 (+ 2294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:55.741890 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.743078 (+ 1188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.743079 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:55.744019 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:55.744023 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.744664 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.744665 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:55.744734 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:55.745198 (+ 464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:03:55.745203 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:03:55.747763 (+ 2560us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:03:55.750598 (+ 2835us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:55.750614 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:55.750617 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:55.751319 (+ 702us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:55.751550 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:55.751551 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:55.751552 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:55.751707 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:55.752060 (+ 353us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:03:55.752069 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:03:55.752276 (+ 207us) client_negotiation.cc:769] Sending connection context
0811 08:03:55.752941 (+ 665us) client_negotiation.cc:240] Negotiation successful
0811 08:03:55.753076 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"mutex_wait_us":1933,"thread_start_us":141,"threads_started":1}
I20260811 08:03:55.753396 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.194:37987
--local_ip_for_outbound_sockets=127.15.36.194
--tserver_master_addrs=127.15.36.254:38213
--webserver_port=43887
--webserver_interface=127.15.36.194
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/krb5kdc/oryx_127.15.36.194.keytab
--principal=oryx/127.15.36.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:42827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.15.36.254:38213,127.15.36.253:38657
--tserver_master_addrs=127.15.36.254:38213,127.15.36.253:38657,127.15.36.252:42241 with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 08:03:55.753862 23335 heartbeater.cc:347] Connected to a master server at 127.15.36.254:38213
I20260811 08:03:55.753961 23335 heartbeater.cc:464] Registering TS with master...
I20260811 08:03:55.753378 23343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:55.737883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.252:42241 (local address 127.15.36.193:55993)
0811 08:03:55.738304 (+ 421us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:55.738314 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:55.738685 (+ 371us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:55.739074 (+ 389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:55.739075 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:55.739590 (+ 515us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:03:55.740099 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:55.740107 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.741701 (+ 1594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.741702 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:55.742844 (+ 1142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:55.742848 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.743705 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.743706 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:55.743795 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:55.744745 (+ 950us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:03:55.744751 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:03:55.748209 (+ 3458us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:03:55.750862 (+ 2653us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:55.750863 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:55.750864 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:55.751427 (+ 563us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:55.751668 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:55.751669 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:55.751669 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:55.751763 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:55.752067 (+ 304us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:03:55.752078 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:03:55.752275 (+ 197us) client_negotiation.cc:769] Sending connection context
0811 08:03:55.752475 (+ 200us) client_negotiation.cc:240] Negotiation successful
0811 08:03:55.752684 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":408,"mutex_wait_us":44,"thread_start_us":71,"threads_started":1}
I20260811 08:03:55.754143 23336 heartbeater.cc:347] Connected to a master server at 127.15.36.253:38657
I20260811 08:03:55.754209 23335 heartbeater.cc:511] Master 127.15.36.254:38213 requested a full tablet report, sending...
I20260811 08:03:55.754305 23336 heartbeater.cc:464] Registering TS with master...
I20260811 08:03:55.754388 23336 heartbeater.cc:511] Master 127.15.36.253:38657 requested a full tablet report, sending...
I20260811 08:03:55.754745 23344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:55.738037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:55993 (local address 127.15.36.252:42241)
0811 08:03:55.738191 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:55.738193 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:55.738353 (+ 160us) server_negotiation.cc:407] Connection header received
0811 08:03:55.738887 (+ 534us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:55.738888 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:55.738907 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:55.739115 (+ 208us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:55.740234 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.741584 (+ 1350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.743077 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.743540 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.743633 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:55.748339 (+ 4706us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:55.748341 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:55.748341 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:55.748350 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:55.750694 (+ 2344us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:55.751517 (+ 823us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:55.751519 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:55.751519 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:55.751592 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:55.751833 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:55.751834 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:55.751834 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:55.751979 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:55.752037 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:55.754515 (+ 2478us) server_negotiation.cc:299] Negotiation successful
0811 08:03:55.754634 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":98,"threads_started":1}
I20260811 08:03:55.754745 22231 ts_manager.cc:194] Re-registered known tserver with Master: cd701cdf69504752aa640a88a90093d6 (127.15.36.193:38419)
I20260811 08:03:55.754853 22910 ts_manager.cc:194] Registered new tserver with Master: cd701cdf69504752aa640a88a90093d6 (127.15.36.193:38419)
I20260811 08:03:55.755293 22231 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.15.36.193@KRBTEST.COM'} at 127.15.36.193:52753
I20260811 08:03:55.755522 23334 heartbeater.cc:347] Connected to a master server at 127.15.36.252:42241
I20260811 08:03:55.755580 23334 heartbeater.cc:464] Registering TS with master...
I20260811 08:03:55.755648 23334 heartbeater.cc:511] Master 127.15.36.252:42241 requested a full tablet report, sending...
I20260811 08:03:55.756410 23131 ts_manager.cc:194] Registered new tserver with Master: cd701cdf69504752aa640a88a90093d6 (127.15.36.193:38419)
W20260811 08:03:55.852300 23345 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:03:55.852560 23345 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:03:55.852591 23345 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:03:55.854105 23345 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:03:55.854169 23345 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:03:55.854203 23345 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.194
I20260811 08:03:55.856326 23345 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:42827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/krb5kdc/oryx_127.15.36.194.keytab
--principal=oryx/127.15.36.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.194:37987
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.36.194
--webserver_port=43887
--tserver_master_addrs=127.15.36.254:38213,127.15.36.253:38657,127.15.36.252:42241
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23345
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.194
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:03:55.856670 23345 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:03:55.856963 23345 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:03:55.863135 23351 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:55.863149 23353 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:55.863135 23350 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:03:55.863505 23345 server_base.cc:1034] running on GCE node
I20260811 08:03:55.863839 23345 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:03:55.864099 23345 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:03:55.865260 23345 hybrid_clock.cc:648] HybridClock initialized: now 1786435435865247 us; error 35 us; skew 500 ppm
Aug 11 08:03:55 dist-test-slave-2w3w krb5kdc[22180](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435435, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.36.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:03:55.869028 23345 init.cc:377] Logged in from keytab as oryx/127.15.36.194@KRBTEST.COM (short username oryx)
I20260811 08:03:55.869592 23345 webserver.cc:460] Webserver started at http://127.15.36.194:43887/ using document root <none> and password file <none>
I20260811 08:03:55.869822 23345 fs_manager.cc:359] Metadata directory not provided
I20260811 08:03:55.869882 23345 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:03:55.871588 23345 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 08:03:55.872251 23363 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:55.872553 23345 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:03:55.872639 23345 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-1/wal
uuid: "fb38ba8c11d548db8c8f93e92cee9d24"
format_stamp: "Formatted at 2026-08-11 08:03:54 on dist-test-slave-2w3w"
server_key: "670ea6f15eec30b5ebd4b5b0d3f9f510"
server_key_iv: "b66a9b7fdb71328b028b1c86b5971c76"
server_key_version: "encryptionkey@0"
I20260811 08:03:55.873085 23345 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:03:55.887480 23345 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:03:55.890010 23345 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:03:55.890175 23345 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:03:55.890489 23345 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:03:55.890842 23345 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:03:55.890900 23345 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:55.890945 23345 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:03:55.891038 23345 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:55.898335 23345 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.194:37987
I20260811 08:03:55.898382 23486 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.194:37987 every 8 connection(s)
I20260811 08:03:55.898783 23345 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
I20260811 08:03:55.901866 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 23345
I20260811 08:03:55.902249 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 22605
Aug 11 08:03:55 dist-test-slave-2w3w krb5kdc[22180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435435, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.36.194@KRBTEST.COM for oryx/127.15.36.253@KRBTEST.COM
Aug 11 08:03:55 dist-test-slave-2w3w krb5kdc[22180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435435, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.36.194@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM
Aug 11 08:03:55 dist-test-slave-2w3w krb5kdc[22180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435435, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.36.194@KRBTEST.COM for oryx/127.15.36.252@KRBTEST.COM
I20260811 08:03:55.915118 22970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:55.899741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:41285 (local address 127.15.36.253:38657)
0811 08:03:55.899793 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:55.899795 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:55.899998 (+ 203us) server_negotiation.cc:407] Connection header received
0811 08:03:55.901041 (+ 1043us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:55.901043 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:55.901056 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:55.901117 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:55.902398 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.903494 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.905429 (+ 1935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.905836 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.905887 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:55.910860 (+ 4973us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:55.910862 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:55.910862 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:55.910872 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:55.912975 (+ 2103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:55.913809 (+ 834us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:55.913810 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:55.913810 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:55.913879 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:55.914238 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:55.914239 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:55.914239 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:55.914412 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:55.914456 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:55.914885 (+ 429us) server_negotiation.cc:299] Negotiation successful
0811 08:03:55.915014 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 08:03:55.915141 22275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:55.899627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:51945 (local address 127.15.36.254:38213)
0811 08:03:55.899684 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:55.899687 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:55.899969 (+ 282us) server_negotiation.cc:407] Connection header received
0811 08:03:55.901060 (+ 1091us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:55.901061 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:55.901074 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:55.901109 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:55.902408 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.903322 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.905421 (+ 2099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.905769 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.905822 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:55.910648 (+ 4826us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:55.910651 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:55.910651 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:55.910663 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:55.913223 (+ 2560us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:55.913920 (+ 697us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:55.913921 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:55.913922 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:55.913985 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:55.914211 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:55.914212 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:55.914212 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:55.914369 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:55.914421 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:55.914937 (+ 516us) server_negotiation.cc:299] Negotiation successful
0811 08:03:55.915048 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 08:03:55.915870 23494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:55.899641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:38213 (local address 127.15.36.194:51945)
0811 08:03:55.899840 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:55.899886 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:55.900951 (+ 1065us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:55.901202 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:55.901207 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:55.901730 (+ 523us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:03:55.902245 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:55.902259 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.903510 (+ 1251us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.903511 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:55.905264 (+ 1753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:55.905269 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.905948 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.905949 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:55.906146 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:55.907430 (+ 1284us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:03:55.907436 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:03:55.910263 (+ 2827us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:03:55.913561 (+ 3298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:55.913562 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:55.913562 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:55.913827 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:55.914060 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:55.914060 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:55.914061 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:55.914129 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:55.914476 (+ 347us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:03:55.914484 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:03:55.914676 (+ 192us) client_negotiation.cc:769] Sending connection context
0811 08:03:55.915452 (+ 776us) client_negotiation.cc:240] Negotiation successful
0811 08:03:55.915692 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"mutex_wait_us":570,"thread_start_us":107,"threads_started":1}
I20260811 08:03:55.916033 23493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:55.899641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.253:38657 (local address 127.15.36.194:41285)
0811 08:03:55.899854 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:55.899888 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:55.900926 (+ 1038us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:55.901202 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:55.901206 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:55.901738 (+ 532us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:03:55.902278 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:55.902282 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.903629 (+ 1347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.903630 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:55.905265 (+ 1635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:55.905269 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.905990 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.905992 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:55.906148 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:55.907304 (+ 1156us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:03:55.907318 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:03:55.910729 (+ 3411us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:03:55.913219 (+ 2490us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:55.913236 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:55.913239 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:55.913709 (+ 470us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:55.913959 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:55.913960 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:55.913960 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:55.914157 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:55.914507 (+ 350us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:03:55.914507 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:03:55.914676 (+ 169us) client_negotiation.cc:769] Sending connection context
0811 08:03:55.915327 (+ 651us) client_negotiation.cc:240] Negotiation successful
0811 08:03:55.915594 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"mutex_wait_us":120,"thread_start_us":93,"threads_started":1}
I20260811 08:03:55.916630 23489 heartbeater.cc:347] Connected to a master server at 127.15.36.254:38213
I20260811 08:03:55.916756 23489 heartbeater.cc:464] Registering TS with master...
I20260811 08:03:55.916949 23489 heartbeater.cc:511] Master 127.15.36.254:38213 requested a full tablet report, sending...
I20260811 08:03:55.917162 23490 heartbeater.cc:347] Connected to a master server at 127.15.36.253:38657
I20260811 08:03:55.917203 23490 heartbeater.cc:464] Registering TS with master...
I20260811 08:03:55.917271 23490 heartbeater.cc:511] Master 127.15.36.253:38657 requested a full tablet report, sending...
I20260811 08:03:55.917385 22231 ts_manager.cc:194] Re-registered known tserver with Master: fb38ba8c11d548db8c8f93e92cee9d24 (127.15.36.194:37987)
I20260811 08:03:55.917570 22910 ts_manager.cc:194] Registered new tserver with Master: fb38ba8c11d548db8c8f93e92cee9d24 (127.15.36.194:37987)
I20260811 08:03:55.917850 23344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:55.900060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:33421 (local address 127.15.36.252:42241)
0811 08:03:55.900124 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:55.900126 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:55.900164 (+ 38us) server_negotiation.cc:407] Connection header received
0811 08:03:55.901059 (+ 895us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:55.901061 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:55.901078 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:55.901109 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:55.902414 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.903328 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.905419 (+ 2091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.905776 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.905822 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:55.913562 (+ 7740us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:55.913565 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:55.913565 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:55.913577 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:55.915923 (+ 2346us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:55.916699 (+ 776us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:55.916700 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:55.916701 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:55.916775 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:55.917045 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:55.917046 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:55.917047 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:55.917232 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:55.917287 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:55.917577 (+ 290us) server_negotiation.cc:299] Negotiation successful
0811 08:03:55.917705 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 08:03:55.917899 22231 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.15.36.194@KRBTEST.COM'} at 127.15.36.194:51945
I20260811 08:03:55.918262 23496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:55.899964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.252:42241 (local address 127.15.36.194:33421)
0811 08:03:55.900110 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:55.900120 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:55.900951 (+ 831us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:55.901204 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:55.901207 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:55.901696 (+ 489us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:03:55.902246 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:55.902259 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.903510 (+ 1251us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.903511 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:55.905264 (+ 1753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:55.905269 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:55.905949 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:55.905950 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:55.906146 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:55.907552 (+ 1406us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:03:55.907556 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:03:55.913441 (+ 5885us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:03:55.916056 (+ 2615us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:55.916057 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:55.916057 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:55.916579 (+ 522us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:55.916866 (+ 287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:55.916867 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:55.916867 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:55.916952 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:55.917359 (+ 407us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:03:55.917360 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:03:55.917421 (+ 61us) client_negotiation.cc:769] Sending connection context
0811 08:03:55.917947 (+ 526us) client_negotiation.cc:240] Negotiation successful
0811 08:03:55.918096 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"mutex_wait_us":118,"thread_start_us":61,"threads_started":1}
I20260811 08:03:55.919719 23488 heartbeater.cc:347] Connected to a master server at 127.15.36.252:42241
I20260811 08:03:55.919793 23488 heartbeater.cc:464] Registering TS with master...
I20260811 08:03:55.920002 23488 heartbeater.cc:511] Master 127.15.36.252:42241 requested a full tablet report, sending...
I20260811 08:03:55.920387 23131 ts_manager.cc:194] Registered new tserver with Master: fb38ba8c11d548db8c8f93e92cee9d24 (127.15.36.194:37987)
I20260811 08:03:55.924482 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.195:35307
--local_ip_for_outbound_sockets=127.15.36.195
--tserver_master_addrs=127.15.36.254:38213
--webserver_port=44421
--webserver_interface=127.15.36.195
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/krb5kdc/oryx_127.15.36.195.keytab
--principal=oryx/127.15.36.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:42827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.15.36.254:38213,127.15.36.253:38657
--tserver_master_addrs=127.15.36.254:38213,127.15.36.253:38657,127.15.36.252:42241 with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:03:56.021687 23497 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:03:56.021927 23497 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:03:56.021960 23497 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:03:56.023401 23497 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:03:56.023468 23497 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:03:56.023500 23497 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.195
I20260811 08:03:56.025161 23497 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:42827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/krb5kdc/oryx_127.15.36.195.keytab
--principal=oryx/127.15.36.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.195:35307
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.36.195
--webserver_port=44421
--tserver_master_addrs=127.15.36.254:38213,127.15.36.253:38657,127.15.36.252:42241
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23497
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.195
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:03:56.025394 23497 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:03:56.025612 23497 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:03:56.031322 23502 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:56.031379 23506 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:56.031322 23504 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:03:56.031788 23497 server_base.cc:1034] running on GCE node
I20260811 08:03:56.032089 23497 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:03:56.032388 23497 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:03:56.033582 23497 hybrid_clock.cc:648] HybridClock initialized: now 1786435436033574 us; error 42 us; skew 500 ppm
Aug 11 08:03:56 dist-test-slave-2w3w krb5kdc[22180](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435436, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.36.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:03:56.036659 23497 init.cc:377] Logged in from keytab as oryx/127.15.36.195@KRBTEST.COM (short username oryx)
I20260811 08:03:56.037185 23497 webserver.cc:460] Webserver started at http://127.15.36.195:44421/ using document root <none> and password file <none>
I20260811 08:03:56.037449 23497 fs_manager.cc:359] Metadata directory not provided
I20260811 08:03:56.037544 23497 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:03:56.039433 23497 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:03:56.040285 23516 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:56.040531 23497 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:03:56.040652 23497 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-2/wal
uuid: "d957252f43b5420eafb1f9611b8fb54c"
format_stamp: "Formatted at 2026-08-11 08:03:54 on dist-test-slave-2w3w"
server_key: "5960e83b7b773715ecaeac7bdde68ead"
server_key_iv: "48db1bf68a59d67df3e4bb3f72a1f2c6"
server_key_version: "encryptionkey@0"
I20260811 08:03:56.041067 23497 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:03:56.056663 23497 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:03:56.059274 23497 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:03:56.059451 23497 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:03:56.059717 23497 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:03:56.060071 23497 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:03:56.060134 23497 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:56.060180 23497 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:03:56.060209 23497 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:56.066285 23497 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.195:35307
I20260811 08:03:56.066331 23642 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.195:35307 every 8 connection(s)
I20260811 08:03:56.066690 23497 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
I20260811 08:03:56.071918 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 23497
Aug 11 08:03:56 dist-test-slave-2w3w krb5kdc[22180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435436, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.36.195@KRBTEST.COM for oryx/127.15.36.253@KRBTEST.COM
Aug 11 08:03:56 dist-test-slave-2w3w krb5kdc[22180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435436, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.36.195@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM
Aug 11 08:03:56 dist-test-slave-2w3w krb5kdc[22180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435436, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.36.195@KRBTEST.COM for oryx/127.15.36.252@KRBTEST.COM
I20260811 08:03:56.083442 23344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:56.067600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:50073 (local address 127.15.36.252:42241)
0811 08:03:56.067650 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:56.067652 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:56.068144 (+ 492us) server_negotiation.cc:407] Connection header received
0811 08:03:56.068856 (+ 712us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:56.068857 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:56.068870 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:56.068929 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:56.069779 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:56.070550 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:56.072106 (+ 1556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:56.072455 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:56.072509 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:56.077742 (+ 5233us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:56.077743 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:56.077743 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:56.077753 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:56.081090 (+ 3337us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:56.081944 (+ 854us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:56.081946 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:56.081946 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:56.082005 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:56.082282 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:56.082283 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:56.082283 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:56.082420 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:56.082469 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:56.083197 (+ 728us) server_negotiation.cc:299] Negotiation successful
0811 08:03:56.083321 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 08:03:56.084157 23647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:56.067544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.252:42241 (local address 127.15.36.195:50073)
0811 08:03:56.067994 (+ 450us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:56.068041 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:56.068641 (+ 600us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:56.068958 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:56.068962 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:56.069559 (+ 597us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:03:56.069638 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:56.069644 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:56.070659 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:56.070660 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:56.071913 (+ 1253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:56.071918 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:56.072607 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:56.072608 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:56.072743 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:56.073803 (+ 1060us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:03:56.073807 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:03:56.077643 (+ 3836us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:03:56.081376 (+ 3733us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:56.081377 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:56.081377 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:56.081860 (+ 483us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:56.082081 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:56.082082 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:56.082082 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:56.082186 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:56.082520 (+ 334us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:03:56.082530 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:03:56.082728 (+ 198us) client_negotiation.cc:769] Sending connection context
0811 08:03:56.083616 (+ 888us) client_negotiation.cc:240] Negotiation successful
0811 08:03:56.083870 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":408,"mutex_wait_us":121,"thread_start_us":324,"threads_started":1}
I20260811 08:03:56.084393 22275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:56.068269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:58713 (local address 127.15.36.254:38213)
0811 08:03:56.068319 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:56.068352 (+ 33us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:56.068360 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:03:56.068901 (+ 541us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:56.068903 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:56.068915 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:56.068966 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:56.069745 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:56.070546 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:56.072090 (+ 1544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:56.072404 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:56.072449 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:56.077855 (+ 5406us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:56.077857 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:56.077858 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:56.077866 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:56.080434 (+ 2568us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:56.082823 (+ 2389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:56.082825 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:56.082825 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:56.082897 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:56.083344 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:56.083345 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:56.083346 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:56.083546 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:56.083604 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:56.084165 (+ 561us) server_negotiation.cc:299] Negotiation successful
0811 08:03:56.084272 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 08:03:56.084570 22970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:56.067570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:45655 (local address 127.15.36.253:38657)
0811 08:03:56.067627 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:56.067630 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:56.068152 (+ 522us) server_negotiation.cc:407] Connection header received
0811 08:03:56.068752 (+ 600us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:56.068753 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:56.068766 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:56.068839 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:56.069756 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:56.070301 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:56.072090 (+ 1789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:56.072404 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:56.072449 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:56.078118 (+ 5669us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:56.078120 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:56.078120 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:56.078129 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:56.081286 (+ 3157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:56.081859 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:56.081860 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:56.081861 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:56.081924 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:56.082271 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:56.082272 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:56.082273 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:56.082420 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:56.082466 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:56.084357 (+ 1891us) server_negotiation.cc:299] Negotiation successful
0811 08:03:56.084446 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 08:03:56.084733 23643 heartbeater.cc:347] Connected to a master server at 127.15.36.252:42241
I20260811 08:03:56.084795 23656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:56.073069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54348 (local address 127.15.36.254:38213)
0811 08:03:56.074007 (+ 938us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:56.074009 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:56.074048 (+ 39us) server_negotiation.cc:407] Connection header received
0811 08:03:56.074160 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:56.074161 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:56.074177 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:56.074224 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:56.075192 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:56.076047 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:56.077159 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:56.077502 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:56.077545 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:56.081457 (+ 3912us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:56.081459 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:56.081459 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:56.081467 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:56.083345 (+ 1878us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:56.083783 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:56.083784 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:56.083784 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:56.083845 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:56.084078 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:56.084079 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:56.084079 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:56.084218 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:56.084300 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:56.084529 (+ 229us) server_negotiation.cc:299] Negotiation successful
0811 08:03:56.084628 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":905,"thread_start_us":103,"threads_started":1}
I20260811 08:03:56.084838 23643 heartbeater.cc:464] Registering TS with master...
I20260811 08:03:56.085040 23648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:56.067543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.253:38657 (local address 127.15.36.195:45655)
0811 08:03:56.068064 (+ 521us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:56.068073 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:56.068641 (+ 568us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:56.068958 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:56.068962 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:56.069418 (+ 456us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:03:56.069638 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:56.069644 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:56.070410 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:56.070411 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:56.071987 (+ 1576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:56.071988 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:56.072555 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:56.072556 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:56.072739 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:56.073658 (+ 919us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:03:56.073664 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:03:56.077321 (+ 3657us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:03:56.081533 (+ 4212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:56.081533 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:56.081534 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:56.081769 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:56.082019 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:56.082020 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:56.082020 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:56.082186 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:56.082520 (+ 334us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:03:56.082530 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:03:56.082733 (+ 203us) client_negotiation.cc:769] Sending connection context
0811 08:03:56.084710 (+ 1977us) client_negotiation.cc:240] Negotiation successful
0811 08:03:56.084938 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":496,"mutex_wait_us":180,"thread_start_us":341,"threads_started":1}
I20260811 08:03:56.085062 23643 heartbeater.cc:511] Master 127.15.36.252:42241 requested a full tablet report, sending...
I20260811 08:03:56.085547 23645 heartbeater.cc:347] Connected to a master server at 127.15.36.253:38657
I20260811 08:03:56.085628 23645 heartbeater.cc:464] Registering TS with master...
I20260811 08:03:56.085711 23645 heartbeater.cc:511] Master 127.15.36.253:38657 requested a full tablet report, sending...
I20260811 08:03:56.085887 23131 ts_manager.cc:194] Registered new tserver with Master: d957252f43b5420eafb1f9611b8fb54c (127.15.36.195:35307)
I20260811 08:03:56.086056 22910 ts_manager.cc:194] Registered new tserver with Master: d957252f43b5420eafb1f9611b8fb54c (127.15.36.195:35307)
I20260811 08:03:56.086259 23649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:56.068130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:38213 (local address 127.15.36.195:58713)
0811 08:03:56.068259 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:56.068268 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:56.068653 (+ 385us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:56.068995 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:56.068997 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:56.069405 (+ 408us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:03:56.069636 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:56.069641 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:56.070855 (+ 1214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:56.070856 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:56.071971 (+ 1115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:56.071974 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:56.072557 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:56.072558 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:56.072739 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:56.073548 (+ 809us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:03:56.073560 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:03:56.077757 (+ 4197us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:03:56.081200 (+ 3443us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:56.081225 (+ 25us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:56.081228 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:56.081709 (+ 481us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:56.083137 (+ 1428us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:56.083138 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:56.083139 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:56.083223 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:56.083960 (+ 737us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:03:56.083961 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:03:56.084022 (+ 61us) client_negotiation.cc:769] Sending connection context
0811 08:03:56.085953 (+ 1931us) client_negotiation.cc:240] Negotiation successful
0811 08:03:56.086132 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"mutex_wait_us":119,"thread_start_us":65,"threads_started":1}
I20260811 08:03:56.086705 23644 heartbeater.cc:347] Connected to a master server at 127.15.36.254:38213
I20260811 08:03:56.086781 23644 heartbeater.cc:464] Registering TS with master...
I20260811 08:03:56.086851 23644 heartbeater.cc:511] Master 127.15.36.254:38213 requested a full tablet report, sending...
I20260811 08:03:56.087744 23658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:56.073374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36656 (local address 127.15.36.252:42241)
0811 08:03:56.073535 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:56.073537 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:56.074107 (+ 570us) server_negotiation.cc:407] Connection header received
0811 08:03:56.074207 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:56.074208 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:56.074221 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:56.074273 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:56.075368 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:56.076135 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:56.078163 (+ 2028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:56.078484 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:56.078520 (+ 36us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:56.080171 (+ 1651us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:56.080173 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:56.080173 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:56.080181 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:56.082661 (+ 2480us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:56.086580 (+ 3919us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:56.086582 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:56.086582 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:56.086698 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:56.087004 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:56.087005 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:56.087005 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:56.087187 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:56.087304 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:56.087539 (+ 235us) server_negotiation.cc:299] Negotiation successful
0811 08:03:56.087635 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":73,"threads_started":1}
I20260811 08:03:56.088250 23659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:56.073535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54598 (local address 127.15.36.253:38657)
0811 08:03:56.073805 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:56.073807 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:56.074829 (+ 1022us) server_negotiation.cc:407] Connection header received
0811 08:03:56.074935 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:56.074936 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:56.074948 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:56.075019 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:56.075745 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:56.076661 (+ 916us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:56.077729 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:56.078030 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:56.078072 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:56.079959 (+ 1887us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:56.079961 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:56.079962 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:56.079970 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:56.083939 (+ 3969us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:56.087367 (+ 3428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:56.087369 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:56.087369 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:56.087431 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:56.087622 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:56.087623 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:56.087623 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:56.087749 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:56.087869 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:56.088098 (+ 229us) server_negotiation.cc:299] Negotiation successful
0811 08:03:56.088182 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":247,"thread_start_us":58,"threads_started":1}
I20260811 08:03:56.087260 22231 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54348:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:03:56.089509 22231 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:03:56.090477 22229 ts_manager.cc:194] Re-registered known tserver with Master: d957252f43b5420eafb1f9611b8fb54c (127.15.36.195:35307)
I20260811 08:03:56.090875 22229 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.15.36.195@KRBTEST.COM'} at 127.15.36.195:58713
I20260811 08:03:56.098752 22865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:56.094168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.195:35307 (local address 127.0.0.1:44292)
0811 08:03:56.094320 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:56.094333 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:56.094378 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:56.094831 (+ 453us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:56.094833 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:56.094835 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:03:56.094888 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:56.094890 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:56.096411 (+ 1521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:56.096412 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:56.097549 (+ 1137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:56.097552 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:56.098504 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:56.098505 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:56.098570 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:56.098574 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:03:56.098605 (+ 31us) client_negotiation.cc:240] Negotiation successful
0811 08:03:56.098653 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131}
I20260811 08:03:56.098765 23667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:56.094232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.193:38419 (local address 127.0.0.1:49464)
0811 08:03:56.094511 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:56.094522 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:56.094569 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:56.095328 (+ 759us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:56.095329 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:56.095331 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:03:56.095377 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:56.095379 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:56.096692 (+ 1313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:56.096693 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:56.097759 (+ 1066us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:56.097761 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:56.098458 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:56.098459 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:56.098521 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:56.098525 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:03:56.098585 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 08:03:56.098630 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":121,"threads_started":1}
I20260811 08:03:56.098835 23670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:56.094579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49464 (local address 127.15.36.193:38419)
0811 08:03:56.094845 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:56.094850 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:56.094861 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:03:56.095168 (+ 307us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:56.095191 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:56.095213 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:56.095479 (+ 266us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:03:56.095547 (+ 68us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:56.096607 (+ 1060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:56.097841 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:56.098365 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:56.098459 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:56.098547 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:56.098603 (+ 56us) server_negotiation.cc:299] Negotiation successful
0811 08:03:56.098643 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":229,"thread_start_us":91,"threads_started":1}
I20260811 08:03:56.099390 23668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:56.094384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44292 (local address 127.15.36.195:35307)
0811 08:03:56.094584 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:56.094589 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:56.094599 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:03:56.094641 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:56.094643 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:56.094662 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:56.094838 (+ 176us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:03:56.094949 (+ 111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:56.096277 (+ 1328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:56.097646 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:56.098399 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:56.099029 (+ 630us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:56.099132 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:56.099178 (+ 46us) server_negotiation.cc:299] Negotiation successful
0811 08:03:56.099222 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":89,"threads_started":1}
I20260811 08:03:56.099761 23669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:56.094555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37672 (local address 127.15.36.194:37987)
0811 08:03:56.094779 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:56.094784 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:56.095080 (+ 296us) server_negotiation.cc:407] Connection header received
0811 08:03:56.095160 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:56.095163 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:56.095179 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:56.095267 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:03:56.095467 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:56.096601 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:56.097919 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:56.098638 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:56.098702 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:56.098766 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:56.099628 (+ 862us) server_negotiation.cc:299] Negotiation successful
0811 08:03:56.099680 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":88,"threads_started":1}
I20260811 08:03:56.099788 23262 tablet_service.cc:1467] Processing CreateTablet for tablet 3ff0b6f834434f769d81a70c423fdd94 (DEFAULT_TABLE table=test-table [id=c91ffeb9f69f47b0839611134714bcee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:03:56.100003 23666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:56.094246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.194:37987 (local address 127.0.0.1:37672)
0811 08:03:56.095016 (+ 770us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:56.095026 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:56.095084 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:56.095295 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:56.095297 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:56.095301 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:03:56.095353 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:56.095355 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:56.096708 (+ 1353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:56.096709 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:56.097813 (+ 1104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:56.097816 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:56.098816 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:56.098817 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:56.099371 (+ 554us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:56.099377 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 08:03:56.099870 (+ 493us) client_negotiation.cc:240] Negotiation successful
0811 08:03:56.099933 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":753,"thread_start_us":161,"threads_started":1}
I20260811 08:03:56.100036 23568 tablet_service.cc:1467] Processing CreateTablet for tablet 3ff0b6f834434f769d81a70c423fdd94 (DEFAULT_TABLE table=test-table [id=c91ffeb9f69f47b0839611134714bcee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:03:56.100193 23262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ff0b6f834434f769d81a70c423fdd94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:03:56.100348 23568 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ff0b6f834434f769d81a70c423fdd94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:03:56.100718 23413 tablet_service.cc:1467] Processing CreateTablet for tablet 3ff0b6f834434f769d81a70c423fdd94 (DEFAULT_TABLE table=test-table [id=c91ffeb9f69f47b0839611134714bcee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:03:56.100981 23413 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ff0b6f834434f769d81a70c423fdd94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:03:56.104384 23671 tablet_bootstrap.cc:492] T 3ff0b6f834434f769d81a70c423fdd94 P fb38ba8c11d548db8c8f93e92cee9d24: Bootstrap starting.
I20260811 08:03:56.105069 23671 tablet_bootstrap.cc:654] T 3ff0b6f834434f769d81a70c423fdd94 P fb38ba8c11d548db8c8f93e92cee9d24: Neither blocks nor log segments found. Creating new log.
I20260811 08:03:56.105576 23671 log.cc:824] T 3ff0b6f834434f769d81a70c423fdd94 P fb38ba8c11d548db8c8f93e92cee9d24: Log is configured to *not* fsync() on all Append() calls
I20260811 08:03:56.105968 23672 tablet_bootstrap.cc:492] T 3ff0b6f834434f769d81a70c423fdd94 P d957252f43b5420eafb1f9611b8fb54c: Bootstrap starting.
I20260811 08:03:56.106612 23671 tablet_bootstrap.cc:492] T 3ff0b6f834434f769d81a70c423fdd94 P fb38ba8c11d548db8c8f93e92cee9d24: No bootstrap required, opened a new log
I20260811 08:03:56.106695 23671 ts_tablet_manager.cc:1397] T 3ff0b6f834434f769d81a70c423fdd94 P fb38ba8c11d548db8c8f93e92cee9d24: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 08:03:56.106755 23672 tablet_bootstrap.cc:654] T 3ff0b6f834434f769d81a70c423fdd94 P d957252f43b5420eafb1f9611b8fb54c: Neither blocks nor log segments found. Creating new log.
I20260811 08:03:56.107218 23672 log.cc:824] T 3ff0b6f834434f769d81a70c423fdd94 P d957252f43b5420eafb1f9611b8fb54c: Log is configured to *not* fsync() on all Append() calls
I20260811 08:03:56.107620 23673 tablet_bootstrap.cc:492] T 3ff0b6f834434f769d81a70c423fdd94 P cd701cdf69504752aa640a88a90093d6: Bootstrap starting.
I20260811 08:03:56.108336 23673 tablet_bootstrap.cc:654] T 3ff0b6f834434f769d81a70c423fdd94 P cd701cdf69504752aa640a88a90093d6: Neither blocks nor log segments found. Creating new log.
I20260811 08:03:56.108744 23673 log.cc:824] T 3ff0b6f834434f769d81a70c423fdd94 P cd701cdf69504752aa640a88a90093d6: Log is configured to *not* fsync() on all Append() calls
I20260811 08:03:56.109364 23672 tablet_bootstrap.cc:492] T 3ff0b6f834434f769d81a70c423fdd94 P d957252f43b5420eafb1f9611b8fb54c: No bootstrap required, opened a new log
I20260811 08:03:56.109264 23671 raft_consensus.cc:348] T 3ff0b6f834434f769d81a70c423fdd94 P fb38ba8c11d548db8c8f93e92cee9d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d957252f43b5420eafb1f9611b8fb54c" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 35307 } } peers { permanent_uuid: "fb38ba8c11d548db8c8f93e92cee9d24" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 37987 } } peers { permanent_uuid: "cd701cdf69504752aa640a88a90093d6" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 38419 } }
I20260811 08:03:56.109436 23671 raft_consensus.cc:374] T 3ff0b6f834434f769d81a70c423fdd94 P fb38ba8c11d548db8c8f93e92cee9d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:03:56.109455 23672 ts_tablet_manager.cc:1397] T 3ff0b6f834434f769d81a70c423fdd94 P d957252f43b5420eafb1f9611b8fb54c: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20260811 08:03:56.109481 23671 raft_consensus.cc:729] T 3ff0b6f834434f769d81a70c423fdd94 P fb38ba8c11d548db8c8f93e92cee9d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb38ba8c11d548db8c8f93e92cee9d24, State: Initialized, Role: FOLLOWER
I20260811 08:03:56.109550 23673 tablet_bootstrap.cc:492] T 3ff0b6f834434f769d81a70c423fdd94 P cd701cdf69504752aa640a88a90093d6: No bootstrap required, opened a new log
I20260811 08:03:56.109622 23673 ts_tablet_manager.cc:1397] T 3ff0b6f834434f769d81a70c423fdd94 P cd701cdf69504752aa640a88a90093d6: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 08:03:56.109615 23671 consensus_queue.cc:260] T 3ff0b6f834434f769d81a70c423fdd94 P fb38ba8c11d548db8c8f93e92cee9d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d957252f43b5420eafb1f9611b8fb54c" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 35307 } } peers { permanent_uuid: "fb38ba8c11d548db8c8f93e92cee9d24" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 37987 } } peers { permanent_uuid: "cd701cdf69504752aa640a88a90093d6" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 38419 } }
I20260811 08:03:56.109910 23671 ts_tablet_manager.cc:1428] T 3ff0b6f834434f769d81a70c423fdd94 P fb38ba8c11d548db8c8f93e92cee9d24: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260811 08:03:56.110155 23489 heartbeater.cc:503] Master 127.15.36.254:38213 was elected leader, sending a full tablet report...
I20260811 08:03:56.112768 23673 raft_consensus.cc:348] T 3ff0b6f834434f769d81a70c423fdd94 P cd701cdf69504752aa640a88a90093d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d957252f43b5420eafb1f9611b8fb54c" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 35307 } } peers { permanent_uuid: "fb38ba8c11d548db8c8f93e92cee9d24" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 37987 } } peers { permanent_uuid: "cd701cdf69504752aa640a88a90093d6" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 38419 } }
I20260811 08:03:56.112946 23673 raft_consensus.cc:374] T 3ff0b6f834434f769d81a70c423fdd94 P cd701cdf69504752aa640a88a90093d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:03:56.112993 23673 raft_consensus.cc:729] T 3ff0b6f834434f769d81a70c423fdd94 P cd701cdf69504752aa640a88a90093d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd701cdf69504752aa640a88a90093d6, State: Initialized, Role: FOLLOWER
I20260811 08:03:56.113010 23672 raft_consensus.cc:348] T 3ff0b6f834434f769d81a70c423fdd94 P d957252f43b5420eafb1f9611b8fb54c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d957252f43b5420eafb1f9611b8fb54c" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 35307 } } peers { permanent_uuid: "fb38ba8c11d548db8c8f93e92cee9d24" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 37987 } } peers { permanent_uuid: "cd701cdf69504752aa640a88a90093d6" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 38419 } }
I20260811 08:03:56.113122 23673 consensus_queue.cc:260] T 3ff0b6f834434f769d81a70c423fdd94 P cd701cdf69504752aa640a88a90093d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d957252f43b5420eafb1f9611b8fb54c" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 35307 } } peers { permanent_uuid: "fb38ba8c11d548db8c8f93e92cee9d24" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 37987 } } peers { permanent_uuid: "cd701cdf69504752aa640a88a90093d6" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 38419 } }
I20260811 08:03:56.113183 23672 raft_consensus.cc:374] T 3ff0b6f834434f769d81a70c423fdd94 P d957252f43b5420eafb1f9611b8fb54c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:03:56.113209 23672 raft_consensus.cc:729] T 3ff0b6f834434f769d81a70c423fdd94 P d957252f43b5420eafb1f9611b8fb54c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d957252f43b5420eafb1f9611b8fb54c, State: Initialized, Role: FOLLOWER
I20260811 08:03:56.113344 23672 consensus_queue.cc:260] T 3ff0b6f834434f769d81a70c423fdd94 P d957252f43b5420eafb1f9611b8fb54c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d957252f43b5420eafb1f9611b8fb54c" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 35307 } } peers { permanent_uuid: "fb38ba8c11d548db8c8f93e92cee9d24" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 37987 } } peers { permanent_uuid: "cd701cdf69504752aa640a88a90093d6" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 38419 } }
I20260811 08:03:56.113708 23644 heartbeater.cc:503] Master 127.15.36.254:38213 was elected leader, sending a full tablet report...
I20260811 08:03:56.113889 23673 ts_tablet_manager.cc:1428] T 3ff0b6f834434f769d81a70c423fdd94 P cd701cdf69504752aa640a88a90093d6: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260811 08:03:56.114045 23335 heartbeater.cc:503] Master 127.15.36.254:38213 was elected leader, sending a full tablet report...
I20260811 08:03:56.114527 23672 ts_tablet_manager.cc:1428] T 3ff0b6f834434f769d81a70c423fdd94 P d957252f43b5420eafb1f9611b8fb54c: Time spent starting tablet: real 0.005s user 0.003s sys 0.001s
I20260811 08:03:56.144361 23666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:56.141217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.252:42241 (local address 127.0.0.1:36672)
0811 08:03:56.141317 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:56.141331 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:56.141387 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:56.141613 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:56.141614 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:56.141616 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:03:56.141685 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:56.141686 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:56.142450 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:56.142450 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:56.143348 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:56.143352 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:56.144114 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:56.144115 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:56.144186 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:56.144189 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:03:56.144245 (+ 56us) client_negotiation.cc:240] Negotiation successful
0811 08:03:56.144294 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":75}
I20260811 08:03:56.144398 23658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:56.141353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36672 (local address 127.15.36.252:42241)
0811 08:03:56.141432 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:56.141434 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:56.141444 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:03:56.141475 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:56.141476 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:56.141497 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:56.141575 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:03:56.141807 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:56.142345 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:56.143458 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:56.143982 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:56.144051 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:56.144112 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:56.144295 (+ 183us) server_negotiation.cc:299] Negotiation successful
0811 08:03:56.144341 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 08:03:56.144773 23143 raft_consensus.cc:1203] T 00000000000000000000000000000000 P e42c1146baa3460b91783d5354038210 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.9] Dedup: 1.7->[1.8-1.9]
I20260811 08:03:56.145218 23174 sys_catalog.cc:455] T 00000000000000000000000000000000 P e42c1146baa3460b91783d5354038210 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d27dfc74df774f2f8f479ece768c55ae. Latest consensus state: current_term: 1 leader_uuid: "d27dfc74df774f2f8f479ece768c55ae" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "d27dfc74df774f2f8f479ece768c55ae" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38213 } } peers { permanent_uuid: "2f0c35cebbbc411eb7541511d3ca99d3" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 38657 } attrs { promote: false } } peers { permanent_uuid: "e42c1146baa3460b91783d5354038210" member_type: NON_VOTER last_known_addr { host: "127.15.36.252" port: 42241 } attrs { promote: true } } }
I20260811 08:03:56.145344 23174 sys_catalog.cc:458] T 00000000000000000000000000000000 P e42c1146baa3460b91783d5354038210 [sys.catalog]: This master's current role is: LEARNER
W20260811 08:03:56.149997 23492 tablet.cc:2369] T 3ff0b6f834434f769d81a70c423fdd94 P fb38ba8c11d548db8c8f93e92cee9d24: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:03:56.220418 23680 raft_consensus.cc:482] T 3ff0b6f834434f769d81a70c423fdd94 P cd701cdf69504752aa640a88a90093d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:03:56.220577 23680 raft_consensus.cc:504] T 3ff0b6f834434f769d81a70c423fdd94 P cd701cdf69504752aa640a88a90093d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d957252f43b5420eafb1f9611b8fb54c" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 35307 } } peers { permanent_uuid: "fb38ba8c11d548db8c8f93e92cee9d24" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 37987 } } peers { permanent_uuid: "cd701cdf69504752aa640a88a90093d6" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 38419 } }
I20260811 08:03:56.221041 23680 leader_election.cc:288] T 3ff0b6f834434f769d81a70c423fdd94 P cd701cdf69504752aa640a88a90093d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d957252f43b5420eafb1f9611b8fb54c (127.15.36.195:35307), fb38ba8c11d548db8c8f93e92cee9d24 (127.15.36.194:37987)
I20260811 08:03:56.224215 23343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:56.221261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.195:35307 (local address 127.15.36.193:37141)
0811 08:03:56.221333 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:56.221347 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:56.221396 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:56.221610 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:56.221611 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:56.221613 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:03:56.221701 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:56.221703 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:56.222421 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:56.222422 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:56.223349 (+ 927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:56.223353 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:56.223947 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:56.223948 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:56.224039 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:56.224044 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 08:03:56.224102 (+ 58us) client_negotiation.cc:240] Negotiation successful
0811 08:03:56.224151 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50,"mutex_wait_us":21}
I20260811 08:03:56.224335 23668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:56.221360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:37141 (local address 127.15.36.195:35307)
0811 08:03:56.221458 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:56.221461 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:56.221474 (+ 13us) server_negotiation.cc:407] Connection header received
0811 08:03:56.221508 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:56.221509 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:56.221520 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:56.221584 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:03:56.221778 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:56.222305 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:56.223480 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:56.223860 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:56.223929 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:56.223939 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:56.224150 (+ 211us) server_negotiation.cc:299] Negotiation successful
0811 08:03:56.224205 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 08:03:56.224453 23342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:56.221373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.194:37987 (local address 127.15.36.193:34329)
0811 08:03:56.221451 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:56.221463 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:56.221507 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:56.221695 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:56.221696 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:56.221697 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:03:56.221793 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:56.221795 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:56.222572 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:56.222573 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:56.223390 (+ 817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:56.223393 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:56.224144 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:56.224146 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:56.224232 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:56.224235 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:03:56.224314 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 08:03:56.224361 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":60,"mutex_wait_us":18}
I20260811 08:03:56.224597 23669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:56.221491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:34329 (local address 127.15.36.194:37987)
0811 08:03:56.221544 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:56.221547 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:56.221555 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:03:56.221604 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:56.221605 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:56.221615 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:56.221680 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:03:56.221873 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:56.222471 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:56.223518 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:56.223889 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:56.224043 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:56.224054 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:56.224484 (+ 430us) server_negotiation.cc:299] Negotiation successful
0811 08:03:56.224535 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 08:03:56.224702 23590 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ff0b6f834434f769d81a70c423fdd94" candidate_uuid: "cd701cdf69504752aa640a88a90093d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d957252f43b5420eafb1f9611b8fb54c" is_pre_election: true
I20260811 08:03:56.224896 23590 raft_consensus.cc:2454] T 3ff0b6f834434f769d81a70c423fdd94 P d957252f43b5420eafb1f9611b8fb54c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd701cdf69504752aa640a88a90093d6 in term 0.
I20260811 08:03:56.225092 23434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ff0b6f834434f769d81a70c423fdd94" candidate_uuid: "cd701cdf69504752aa640a88a90093d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb38ba8c11d548db8c8f93e92cee9d24" is_pre_election: true
I20260811 08:03:56.225217 23206 leader_election.cc:302] T 3ff0b6f834434f769d81a70c423fdd94 P cd701cdf69504752aa640a88a90093d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd701cdf69504752aa640a88a90093d6, d957252f43b5420eafb1f9611b8fb54c; no voters:
I20260811 08:03:56.225261 23434 raft_consensus.cc:2454] T 3ff0b6f834434f769d81a70c423fdd94 P fb38ba8c11d548db8c8f93e92cee9d24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd701cdf69504752aa640a88a90093d6 in term 0.
I20260811 08:03:56.225426 23680 raft_consensus.cc:2781] T 3ff0b6f834434f769d81a70c423fdd94 P cd701cdf69504752aa640a88a90093d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:03:56.225503 23680 raft_consensus.cc:482] T 3ff0b6f834434f769d81a70c423fdd94 P cd701cdf69504752aa640a88a90093d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:03:56.225536 23680 raft_consensus.cc:3037] T 3ff0b6f834434f769d81a70c423fdd94 P cd701cdf69504752aa640a88a90093d6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:03:56.226495 23680 raft_consensus.cc:504] T 3ff0b6f834434f769d81a70c423fdd94 P cd701cdf69504752aa640a88a90093d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d957252f43b5420eafb1f9611b8fb54c" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 35307 } } peers { permanent_uuid: "fb38ba8c11d548db8c8f93e92cee9d24" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 37987 } } peers { permanent_uuid: "cd701cdf69504752aa640a88a90093d6" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 38419 } }
I20260811 08:03:56.226673 23680 leader_election.cc:288] T 3ff0b6f834434f769d81a70c423fdd94 P cd701cdf69504752aa640a88a90093d6 [CANDIDATE]: Term 1 election: Requested vote from peers d957252f43b5420eafb1f9611b8fb54c (127.15.36.195:35307), fb38ba8c11d548db8c8f93e92cee9d24 (127.15.36.194:37987)
I20260811 08:03:56.226857 23434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ff0b6f834434f769d81a70c423fdd94" candidate_uuid: "cd701cdf69504752aa640a88a90093d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb38ba8c11d548db8c8f93e92cee9d24"
I20260811 08:03:56.226965 23434 raft_consensus.cc:3037] T 3ff0b6f834434f769d81a70c423fdd94 P fb38ba8c11d548db8c8f93e92cee9d24 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:03:56.226928 23590 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ff0b6f834434f769d81a70c423fdd94" candidate_uuid: "cd701cdf69504752aa640a88a90093d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d957252f43b5420eafb1f9611b8fb54c"
I20260811 08:03:56.227133 23590 raft_consensus.cc:3037] T 3ff0b6f834434f769d81a70c423fdd94 P d957252f43b5420eafb1f9611b8fb54c [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:03:56.227972 23434 raft_consensus.cc:2454] T 3ff0b6f834434f769d81a70c423fdd94 P fb38ba8c11d548db8c8f93e92cee9d24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd701cdf69504752aa640a88a90093d6 in term 1.
I20260811 08:03:56.228098 23590 raft_consensus.cc:2454] T 3ff0b6f834434f769d81a70c423fdd94 P d957252f43b5420eafb1f9611b8fb54c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd701cdf69504752aa640a88a90093d6 in term 1.
I20260811 08:03:56.228171 23210 leader_election.cc:302] T 3ff0b6f834434f769d81a70c423fdd94 P cd701cdf69504752aa640a88a90093d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd701cdf69504752aa640a88a90093d6, fb38ba8c11d548db8c8f93e92cee9d24; no voters:
I20260811 08:03:56.228368 23680 raft_consensus.cc:2781] T 3ff0b6f834434f769d81a70c423fdd94 P cd701cdf69504752aa640a88a90093d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:03:56.228499 23680 raft_consensus.cc:686] T 3ff0b6f834434f769d81a70c423fdd94 P cd701cdf69504752aa640a88a90093d6 [term 1 LEADER]: Becoming Leader. State: Replica: cd701cdf69504752aa640a88a90093d6, State: Running, Role: LEADER
I20260811 08:03:56.228726 23680 consensus_queue.cc:237] T 3ff0b6f834434f769d81a70c423fdd94 P cd701cdf69504752aa640a88a90093d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d957252f43b5420eafb1f9611b8fb54c" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 35307 } } peers { permanent_uuid: "fb38ba8c11d548db8c8f93e92cee9d24" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 37987 } } peers { permanent_uuid: "cd701cdf69504752aa640a88a90093d6" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 38419 } }
I20260811 08:03:56.229851 22229 catalog_manager.cc:5495] T 3ff0b6f834434f769d81a70c423fdd94 P cd701cdf69504752aa640a88a90093d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to cd701cdf69504752aa640a88a90093d6 (127.15.36.193). New cstate: current_term: 1 leader_uuid: "cd701cdf69504752aa640a88a90093d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d957252f43b5420eafb1f9611b8fb54c" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 35307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb38ba8c11d548db8c8f93e92cee9d24" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 37987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd701cdf69504752aa640a88a90093d6" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 38419 } health_report { overall_health: HEALTHY } } }
I20260811 08:03:56.230602 23689 sys_catalog.cc:455] T 00000000000000000000000000000000 P d27dfc74df774f2f8f479ece768c55ae [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d27dfc74df774f2f8f479ece768c55ae" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "d27dfc74df774f2f8f479ece768c55ae" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38213 } } peers { permanent_uuid: "2f0c35cebbbc411eb7541511d3ca99d3" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 38657 } attrs { promote: false } } peers { permanent_uuid: "e42c1146baa3460b91783d5354038210" member_type: NON_VOTER last_known_addr { host: "127.15.36.252" port: 42241 } attrs { promote: true } } }
I20260811 08:03:56.230705 23689 sys_catalog.cc:458] T 00000000000000000000000000000000 P d27dfc74df774f2f8f479ece768c55ae [sys.catalog]: This master's current role is: LEADER
I20260811 08:03:56.231325 23092 raft_consensus.cc:1050] T 00000000000000000000000000000000 P d27dfc74df774f2f8f479ece768c55ae: attempting to promote NON_VOTER e42c1146baa3460b91783d5354038210 to VOTER
I20260811 08:03:56.231451 23092 consensus_queue.cc:237] T 00000000000000000000000000000000 P d27dfc74df774f2f8f479ece768c55ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "d27dfc74df774f2f8f479ece768c55ae" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38213 } } peers { permanent_uuid: "2f0c35cebbbc411eb7541511d3ca99d3" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 38657 } attrs { promote: false } } peers { permanent_uuid: "e42c1146baa3460b91783d5354038210" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 42241 } attrs { promote: false } }
I20260811 08:03:56.231951 22924 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3 [term 1 FOLLOWER]: Refusing update from remote peer d27dfc74df774f2f8f479ece768c55ae: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260811 08:03:56.232105 23142 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e42c1146baa3460b91783d5354038210 [term 1 LEARNER]: Refusing update from remote peer d27dfc74df774f2f8f479ece768c55ae: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260811 08:03:56.232357 23689 consensus_queue.cc:1035] T 00000000000000000000000000000000 P d27dfc74df774f2f8f479ece768c55ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "e42c1146baa3460b91783d5354038210" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 42241 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260811 08:03:56.232473 23080 consensus_queue.cc:1035] T 00000000000000000000000000000000 P d27dfc74df774f2f8f479ece768c55ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f0c35cebbbc411eb7541511d3ca99d3" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 38657 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260811 08:03:56.233083 23092 raft_consensus.cc:2932] T 00000000000000000000000000000000 P d27dfc74df774f2f8f479ece768c55ae [term 1 LEADER]: Committing config change with OpId 1.11: config changed from index 7 to 11, e42c1146baa3460b91783d5354038210 (127.15.36.252) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "d27dfc74df774f2f8f479ece768c55ae" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38213 } } peers { permanent_uuid: "2f0c35cebbbc411eb7541511d3ca99d3" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 38657 } attrs { promote: false } } peers { permanent_uuid: "e42c1146baa3460b91783d5354038210" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 42241 } attrs { promote: false } } }
I20260811 08:03:56.233210 22924 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 7 to 11, e42c1146baa3460b91783d5354038210 (127.15.36.252) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "d27dfc74df774f2f8f479ece768c55ae" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38213 } } peers { permanent_uuid: "2f0c35cebbbc411eb7541511d3ca99d3" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 38657 } attrs { promote: false } } peers { permanent_uuid: "e42c1146baa3460b91783d5354038210" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 42241 } attrs { promote: false } } }
I20260811 08:03:56.233239 23142 raft_consensus.cc:2932] T 00000000000000000000000000000000 P e42c1146baa3460b91783d5354038210 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 7 to 11, e42c1146baa3460b91783d5354038210 (127.15.36.252) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "d27dfc74df774f2f8f479ece768c55ae" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38213 } } peers { permanent_uuid: "2f0c35cebbbc411eb7541511d3ca99d3" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 38657 } attrs { promote: false } } peers { permanent_uuid: "e42c1146baa3460b91783d5354038210" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 42241 } attrs { promote: false } } }
I20260811 08:03:56.234006 23092 sys_catalog.cc:455] T 00000000000000000000000000000000 P d27dfc74df774f2f8f479ece768c55ae [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "d27dfc74df774f2f8f479ece768c55ae" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "d27dfc74df774f2f8f479ece768c55ae" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38213 } } peers { permanent_uuid: "2f0c35cebbbc411eb7541511d3ca99d3" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 38657 } attrs { promote: false } } peers { permanent_uuid: "e42c1146baa3460b91783d5354038210" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 42241 } attrs { promote: false } } }
I20260811 08:03:56.234091 23092 sys_catalog.cc:458] T 00000000000000000000000000000000 P d27dfc74df774f2f8f479ece768c55ae [sys.catalog]: This master's current role is: LEADER
I20260811 08:03:56.234180 23092 sys_catalog.cc:455] T 00000000000000000000000000000000 P d27dfc74df774f2f8f479ece768c55ae [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d27dfc74df774f2f8f479ece768c55ae" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "d27dfc74df774f2f8f479ece768c55ae" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38213 } } peers { permanent_uuid: "2f0c35cebbbc411eb7541511d3ca99d3" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 38657 } attrs { promote: false } } peers { permanent_uuid: "e42c1146baa3460b91783d5354038210" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 42241 } attrs { promote: false } } }
I20260811 08:03:56.234249 23092 sys_catalog.cc:458] T 00000000000000000000000000000000 P d27dfc74df774f2f8f479ece768c55ae [sys.catalog]: This master's current role is: LEADER
I20260811 08:03:56.234300 23092 sys_catalog.cc:455] T 00000000000000000000000000000000 P d27dfc74df774f2f8f479ece768c55ae [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d27dfc74df774f2f8f479ece768c55ae" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "d27dfc74df774f2f8f479ece768c55ae" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38213 } } peers { permanent_uuid: "2f0c35cebbbc411eb7541511d3ca99d3" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 38657 } attrs { promote: false } } peers { permanent_uuid: "e42c1146baa3460b91783d5354038210" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 42241 } attrs { promote: false } } }
I20260811 08:03:56.234350 23092 sys_catalog.cc:458] T 00000000000000000000000000000000 P d27dfc74df774f2f8f479ece768c55ae [sys.catalog]: This master's current role is: LEADER
I20260811 08:03:56.234421 23174 sys_catalog.cc:455] T 00000000000000000000000000000000 P e42c1146baa3460b91783d5354038210 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d27dfc74df774f2f8f479ece768c55ae" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "d27dfc74df774f2f8f479ece768c55ae" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38213 } } peers { permanent_uuid: "2f0c35cebbbc411eb7541511d3ca99d3" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 38657 } attrs { promote: false } } peers { permanent_uuid: "e42c1146baa3460b91783d5354038210" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 42241 } attrs { promote: false } } }
I20260811 08:03:56.234400 23691 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d27dfc74df774f2f8f479ece768c55ae" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "d27dfc74df774f2f8f479ece768c55ae" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38213 } } peers { permanent_uuid: "2f0c35cebbbc411eb7541511d3ca99d3" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 38657 } attrs { promote: false } } peers { permanent_uuid: "e42c1146baa3460b91783d5354038210" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 42241 } attrs { promote: false } } }
I20260811 08:03:56.234493 23174 sys_catalog.cc:458] T 00000000000000000000000000000000 P e42c1146baa3460b91783d5354038210 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 08:03:56.234493 23691 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3 [sys.catalog]: This master's current role is: FOLLOWER
W20260811 08:03:56.238610 23338 tablet.cc:2369] T 3ff0b6f834434f769d81a70c423fdd94 P cd701cdf69504752aa640a88a90093d6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:03:56.248288 23670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:56.245841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49466 (local address 127.15.36.193:38419)
0811 08:03:56.245926 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:56.245928 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:56.245938 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:03:56.245989 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:56.245990 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:56.246016 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:56.246086 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:03:56.246224 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:56.246742 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:56.247594 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:56.247790 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:56.247850 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:56.247994 (+ 144us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:03:56.248099 (+ 105us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:03:56.248158 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:56.248206 (+ 48us) server_negotiation.cc:299] Negotiation successful
0811 08:03:56.248224 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 08:03:56.250554 23590 raft_consensus.cc:1261] T 3ff0b6f834434f769d81a70c423fdd94 P d957252f43b5420eafb1f9611b8fb54c [term 1 FOLLOWER]: Refusing update from remote peer cd701cdf69504752aa640a88a90093d6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:03:56.250578 23434 raft_consensus.cc:1261] T 3ff0b6f834434f769d81a70c423fdd94 P fb38ba8c11d548db8c8f93e92cee9d24 [term 1 FOLLOWER]: Refusing update from remote peer cd701cdf69504752aa640a88a90093d6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:03:56.250988 23687 consensus_queue.cc:1035] T 3ff0b6f834434f769d81a70c423fdd94 P cd701cdf69504752aa640a88a90093d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d957252f43b5420eafb1f9611b8fb54c" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 35307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:03:56.251165 23680 consensus_queue.cc:1035] T 3ff0b6f834434f769d81a70c423fdd94 P cd701cdf69504752aa640a88a90093d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb38ba8c11d548db8c8f93e92cee9d24" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 37987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:03:56.254424 23693 mvcc.cc:205] Tried to move back new op lower bound from 7317239546878746624 to 7317239546793775104. Current Snapshot: MvccSnapshot[applied={T|T < 7317239546878746624}]
I20260811 08:03:56.257416 22229 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54348:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:03:56.257527 22229 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54348:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:03:56.257858 23696 mvcc.cc:205] Tried to move back new op lower bound from 7317239546878746624 to 7317239546793775104. Current Snapshot: MvccSnapshot[applied={T|T < 7317239546878746624 or (T in {7317239546878746624})}]
I20260811 08:03:56.258000 23695 mvcc.cc:205] Tried to move back new op lower bound from 7317239546878746624 to 7317239546793775104. Current Snapshot: MvccSnapshot[applied={T|T < 7317239546878746624 or (T in {7317239546878746624})}]
I20260811 08:03:56.259025 22229 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d27dfc74df774f2f8f479ece768c55ae: Sending DeleteTablet for 3 replicas of tablet 3ff0b6f834434f769d81a70c423fdd94
I20260811 08:03:56.259534 23413 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ff0b6f834434f769d81a70c423fdd94 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:03:56 UTC) from {username='oryx', principal='oryx/127.15.36.254@KRBTEST.COM'} at 127.0.0.1:37672
I20260811 08:03:56.259800 23705 tablet_replica.cc:330] T 3ff0b6f834434f769d81a70c423fdd94 P fb38ba8c11d548db8c8f93e92cee9d24: stopping tablet replica
I20260811 08:03:56.259989 23705 raft_consensus.cc:2229] T 3ff0b6f834434f769d81a70c423fdd94 P fb38ba8c11d548db8c8f93e92cee9d24 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:03:56.260195 23705 raft_consensus.cc:2258] T 3ff0b6f834434f769d81a70c423fdd94 P fb38ba8c11d548db8c8f93e92cee9d24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:03:56.260299 23262 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ff0b6f834434f769d81a70c423fdd94 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:03:56 UTC) from {username='oryx', principal='oryx/127.15.36.254@KRBTEST.COM'} at 127.0.0.1:49464
I20260811 08:03:56.260529 23707 tablet_replica.cc:330] T 3ff0b6f834434f769d81a70c423fdd94 P cd701cdf69504752aa640a88a90093d6: stopping tablet replica
I20260811 08:03:56.260676 23707 raft_consensus.cc:2229] T 3ff0b6f834434f769d81a70c423fdd94 P cd701cdf69504752aa640a88a90093d6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 08:03:56.260699 23568 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ff0b6f834434f769d81a70c423fdd94 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:03:56 UTC) from {username='oryx', principal='oryx/127.15.36.254@KRBTEST.COM'} at 127.0.0.1:44292
I20260811 08:03:56.260784 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 22194
I20260811 08:03:56.264201 23708 tablet_replica.cc:330] T 3ff0b6f834434f769d81a70c423fdd94 P d957252f43b5420eafb1f9611b8fb54c: stopping tablet replica
I20260811 08:03:56.264343 23708 raft_consensus.cc:2229] T 3ff0b6f834434f769d81a70c423fdd94 P d957252f43b5420eafb1f9611b8fb54c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:03:56.264462 23708 raft_consensus.cc:2258] T 3ff0b6f834434f769d81a70c423fdd94 P d957252f43b5420eafb1f9611b8fb54c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:03:56.264789 23707 raft_consensus.cc:2258] T 3ff0b6f834434f769d81a70c423fdd94 P cd701cdf69504752aa640a88a90093d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:03:56.265527 23707 ts_tablet_manager.cc:1905] T 3ff0b6f834434f769d81a70c423fdd94 P cd701cdf69504752aa640a88a90093d6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:03:56.268600 23707 ts_tablet_manager.cc:1918] T 3ff0b6f834434f769d81a70c423fdd94 P cd701cdf69504752aa640a88a90093d6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:03:56.268797 23707 log.cc:1196] T 3ff0b6f834434f769d81a70c423fdd94 P cd701cdf69504752aa640a88a90093d6: Deleting WAL directory at /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-0/wal/wals/3ff0b6f834434f769d81a70c423fdd94
I20260811 08:03:56.269249 23707 ts_tablet_manager.cc:1939] T 3ff0b6f834434f769d81a70c423fdd94 P cd701cdf69504752aa640a88a90093d6: Deleting consensus metadata
I20260811 08:03:56.270604 23658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:56.259971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36674 (local address 127.15.36.252:42241)
0811 08:03:56.260015 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:56.260017 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:56.261071 (+ 1054us) server_negotiation.cc:407] Connection header received
0811 08:03:56.261161 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:56.261162 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:56.261172 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:56.261202 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:56.262682 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:56.263297 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:56.264625 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:56.264927 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:56.264977 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:56.267071 (+ 2094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:56.267072 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:56.267073 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:56.267082 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:56.269116 (+ 2034us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:56.269662 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:56.269663 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:56.269664 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:56.269743 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:56.269993 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:56.269994 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:56.269994 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:56.270149 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:56.270290 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:56.270402 (+ 112us) server_negotiation.cc:299] Negotiation successful
0811 08:03:56.270496 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 08:03:56.271513 23708 ts_tablet_manager.cc:1905] T 3ff0b6f834434f769d81a70c423fdd94 P d957252f43b5420eafb1f9611b8fb54c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:03:56.271531 23705 ts_tablet_manager.cc:1905] T 3ff0b6f834434f769d81a70c423fdd94 P fb38ba8c11d548db8c8f93e92cee9d24: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:03:56.273762 23705 ts_tablet_manager.cc:1918] T 3ff0b6f834434f769d81a70c423fdd94 P fb38ba8c11d548db8c8f93e92cee9d24: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:03:56.273901 23705 log.cc:1196] T 3ff0b6f834434f769d81a70c423fdd94 P fb38ba8c11d548db8c8f93e92cee9d24: Deleting WAL directory at /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-1/wal/wals/3ff0b6f834434f769d81a70c423fdd94
I20260811 08:03:56.274063 23708 ts_tablet_manager.cc:1918] T 3ff0b6f834434f769d81a70c423fdd94 P d957252f43b5420eafb1f9611b8fb54c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:03:56.274188 23708 log.cc:1196] T 3ff0b6f834434f769d81a70c423fdd94 P d957252f43b5420eafb1f9611b8fb54c: Deleting WAL directory at /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-2/wal/wals/3ff0b6f834434f769d81a70c423fdd94
W20260811 08:03:56.274183 23206 connection.cc:535] server connection from 127.0.0.1:49464 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 08:03:56.274248 23705 ts_tablet_manager.cc:1939] T 3ff0b6f834434f769d81a70c423fdd94 P fb38ba8c11d548db8c8f93e92cee9d24: Deleting consensus metadata
I20260811 08:03:56.274597 23708 ts_tablet_manager.cc:1939] T 3ff0b6f834434f769d81a70c423fdd94 P d957252f43b5420eafb1f9611b8fb54c: Deleting consensus metadata
W20260811 08:03:56.274686 23367 connection.cc:441] server connection from 127.0.0.1:37672 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37672 (request call id 1) could send its response
W20260811 08:03:56.275183 23520 connection.cc:441] server connection from 127.0.0.1:44292 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44292 (request call id 1) could send its response
I20260811 08:03:56.286563 23658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:56.277272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36682 (local address 127.15.36.252:42241)
0811 08:03:56.277337 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:56.277340 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:56.277569 (+ 229us) server_negotiation.cc:407] Connection header received
0811 08:03:56.277670 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:56.277671 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:56.277683 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:56.277713 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:56.278815 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:56.279586 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:56.281238 (+ 1652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:56.281475 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:56.281571 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:56.283215 (+ 1644us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:56.283216 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:56.283216 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:56.283225 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:56.285093 (+ 1868us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:56.285522 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:56.285523 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:56.285523 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:56.285587 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:56.285820 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:56.285821 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:56.285821 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:56.285995 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:56.286091 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:56.286339 (+ 248us) server_negotiation.cc:299] Negotiation successful
0811 08:03:56.286444 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 08:03:56.286624 23659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:56.277079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54604 (local address 127.15.36.253:38657)
0811 08:03:56.277132 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:56.277134 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:56.277279 (+ 145us) server_negotiation.cc:407] Connection header received
0811 08:03:56.277453 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:56.277454 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:56.277467 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:56.277501 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:56.278540 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:56.279602 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:56.281235 (+ 1633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:56.281569 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:56.281613 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:56.283364 (+ 1751us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:56.283365 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:56.283366 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:56.283374 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:56.285249 (+ 1875us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:56.285717 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:56.285718 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:56.285718 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:56.285773 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:56.286026 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:56.286028 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:56.286028 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:56.286204 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:56.286307 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:56.286419 (+ 112us) server_negotiation.cc:299] Negotiation successful
0811 08:03:56.286514 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 08:03:57.257093 23718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:57.256729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:38213 (local address 127.15.36.195:55129)
0811 08:03:57.256988 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:57.257051 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:38213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":118,"threads_started":1}
I20260811 08:03:57.257064 23717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:57.256729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:38213 (local address 127.15.36.193:53967)
0811 08:03:57.256904 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:57.257000 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:38213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":80,"threads_started":1}
W20260811 08:03:57.257347 23644 heartbeater.cc:644] Failed to heartbeat to 127.15.36.254:38213 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.15.36.254:38213: connect: Connection refused (error 111)
W20260811 08:03:57.257424 23335 heartbeater.cc:644] Failed to heartbeat to 127.15.36.254:38213 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.15.36.254:38213: connect: Connection refused (error 111)
I20260811 08:03:57.257869 23719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:57.257610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:38213 (local address 127.15.36.194:42395)
0811 08:03:57.257744 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:57.257823 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:38213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":89,"threads_started":1}
W20260811 08:03:57.258080 23489 heartbeater.cc:644] Failed to heartbeat to 127.15.36.254:38213 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.15.36.254:38213: connect: Connection refused (error 111)
I20260811 08:03:57.760208 23720 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d27dfc74df774f2f8f479ece768c55ae)
I20260811 08:03:57.760298 23721 raft_consensus.cc:482] T 00000000000000000000000000000000 P e42c1146baa3460b91783d5354038210 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d27dfc74df774f2f8f479ece768c55ae)
I20260811 08:03:57.760388 23720 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "d27dfc74df774f2f8f479ece768c55ae" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38213 } } peers { permanent_uuid: "2f0c35cebbbc411eb7541511d3ca99d3" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 38657 } attrs { promote: false } } peers { permanent_uuid: "e42c1146baa3460b91783d5354038210" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 42241 } attrs { promote: false } }
I20260811 08:03:57.760555 23721 raft_consensus.cc:504] T 00000000000000000000000000000000 P e42c1146baa3460b91783d5354038210 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "d27dfc74df774f2f8f479ece768c55ae" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38213 } } peers { permanent_uuid: "2f0c35cebbbc411eb7541511d3ca99d3" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 38657 } attrs { promote: false } } peers { permanent_uuid: "e42c1146baa3460b91783d5354038210" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 42241 } attrs { promote: false } }
I20260811 08:03:57.760716 23720 leader_election.cc:288] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d27dfc74df774f2f8f479ece768c55ae (127.15.36.254:38213), e42c1146baa3460b91783d5354038210 (127.15.36.252:42241)
I20260811 08:03:57.760855 23721 leader_election.cc:288] T 00000000000000000000000000000000 P e42c1146baa3460b91783d5354038210 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d27dfc74df774f2f8f479ece768c55ae (127.15.36.254:38213), 2f0c35cebbbc411eb7541511d3ca99d3 (127.15.36.253:38657)
I20260811 08:03:57.761270 23722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:57.760893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:38213 (local address 127.0.0.1:54830)
0811 08:03:57.761163 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:57.761224 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:38213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":82,"threads_started":1}
I20260811 08:03:57.761364 23723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:57.760954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:38213 (local address 127.0.0.1:54836)
0811 08:03:57.761211 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:57.761319 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:38213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":44,"threads_started":1}
W20260811 08:03:57.761495 23117 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.36.254:38213: connect: Connection refused (error 111)
W20260811 08:03:57.761564 22895 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.36.254:38213: connect: Connection refused (error 111)
I20260811 08:03:57.761963 23723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:57.761864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:38213 (local address 127.0.0.1:54852)
0811 08:03:57.761905 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:57.761932 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:38213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260811 08:03:57.762027 23722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:57.761940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:38213 (local address 127.0.0.1:54862)
0811 08:03:57.761979 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:57.762001 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:38213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260811 08:03:57.762069 23117 leader_election.cc:334] T 00000000000000000000000000000000 P e42c1146baa3460b91783d5354038210 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d27dfc74df774f2f8f479ece768c55ae (127.15.36.254:38213): Network error: Client connection negotiation failed: client connection to 127.15.36.254:38213: connect: Connection refused (error 111)
W20260811 08:03:57.762135 22895 leader_election.cc:334] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d27dfc74df774f2f8f479ece768c55ae (127.15.36.254:38213): Network error: Client connection negotiation failed: client connection to 127.15.36.254:38213: connect: Connection refused (error 111)
I20260811 08:03:57.764710 23725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:57.761173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.252:42241 (local address 127.0.0.1:36696)
0811 08:03:57.761306 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:57.761496 (+ 190us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:57.761594 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:57.761960 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:57.761961 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:57.761963 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:03:57.762001 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:57.762003 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:57.762856 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:57.762857 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:57.763815 (+ 958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:57.763818 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:57.764427 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:57.764428 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:57.764496 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:57.764502 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 08:03:57.764583 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 08:03:57.764631 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":62,"threads_started":1}
I20260811 08:03:57.764710 23727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:57.761448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36696 (local address 127.15.36.252:42241)
0811 08:03:57.761788 (+ 340us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:57.761790 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:57.761796 (+ 6us) server_negotiation.cc:407] Connection header received
0811 08:03:57.761814 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:57.761814 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:57.761824 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:57.761917 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:03:57.762243 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:57.762732 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:57.763919 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:57.764315 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:57.764422 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:57.764435 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:57.764588 (+ 153us) server_negotiation.cc:299] Negotiation successful
0811 08:03:57.764633 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":321,"thread_start_us":43,"threads_started":1}
I20260811 08:03:57.764835 23726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:57.761268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54616 (local address 127.15.36.253:38657)
0811 08:03:57.761408 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:57.761410 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:57.761620 (+ 210us) server_negotiation.cc:407] Connection header received
0811 08:03:57.761649 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:57.761650 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:57.761660 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:57.761737 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:03:57.761960 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:57.762699 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:57.763967 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:57.764395 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:57.764500 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:57.764513 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:57.764680 (+ 167us) server_negotiation.cc:299] Negotiation successful
0811 08:03:57.764727 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":40,"threads_started":1}
I20260811 08:03:57.765064 23142 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f0c35cebbbc411eb7541511d3ca99d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "e42c1146baa3460b91783d5354038210" is_pre_election: true
I20260811 08:03:57.765219 23142 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e42c1146baa3460b91783d5354038210 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f0c35cebbbc411eb7541511d3ca99d3 in term 1.
I20260811 08:03:57.765477 23724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:57.761095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.253:38657 (local address 127.0.0.1:54616)
0811 08:03:57.761459 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:57.761471 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:57.761548 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:57.761800 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:57.761801 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:57.761805 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:03:57.761875 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:57.761878 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:57.762813 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:57.762814 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:57.763837 (+ 1023us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:57.763840 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:57.764505 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:57.764506 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:57.764583 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:57.764586 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:03:57.764672 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 08:03:57.764726 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":348,"thread_start_us":56,"threads_started":1}
I20260811 08:03:57.765477 22895 leader_election.cc:302] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f0c35cebbbc411eb7541511d3ca99d3, e42c1146baa3460b91783d5354038210; no voters: d27dfc74df774f2f8f479ece768c55ae
I20260811 08:03:57.765648 23720 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 08:03:57.765702 23720 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d27dfc74df774f2f8f479ece768c55ae)
I20260811 08:03:57.765738 23720 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 08:03:57.765770 22924 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e42c1146baa3460b91783d5354038210" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "2f0c35cebbbc411eb7541511d3ca99d3" is_pre_election: true
I20260811 08:03:57.766709 23720 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "d27dfc74df774f2f8f479ece768c55ae" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38213 } } peers { permanent_uuid: "2f0c35cebbbc411eb7541511d3ca99d3" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 38657 } attrs { promote: false } } peers { permanent_uuid: "e42c1146baa3460b91783d5354038210" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 42241 } attrs { promote: false } }
I20260811 08:03:57.766902 23720 leader_election.cc:288] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3 [CANDIDATE]: Term 2 election: Requested vote from peers d27dfc74df774f2f8f479ece768c55ae (127.15.36.254:38213), e42c1146baa3460b91783d5354038210 (127.15.36.252:42241)
I20260811 08:03:57.766913 22924 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e42c1146baa3460b91783d5354038210 in current term 2: Already voted for candidate 2f0c35cebbbc411eb7541511d3ca99d3 in this term.
I20260811 08:03:57.767163 23725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:57.767033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:38213 (local address 127.0.0.1:54868)
0811 08:03:57.767099 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:57.767133 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:38213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260811 08:03:57.767287 23142 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f0c35cebbbc411eb7541511d3ca99d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "e42c1146baa3460b91783d5354038210"
I20260811 08:03:57.767485 23142 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e42c1146baa3460b91783d5354038210 [term 1 FOLLOWER]: Advancing to term 2
I20260811 08:03:57.767616 23725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:57.767500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:38213 (local address 127.0.0.1:54878)
0811 08:03:57.767550 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:57.767580 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:38213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260811 08:03:57.767628 23115 leader_election.cc:302] T 00000000000000000000000000000000 P e42c1146baa3460b91783d5354038210 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e42c1146baa3460b91783d5354038210; no voters: 2f0c35cebbbc411eb7541511d3ca99d3, d27dfc74df774f2f8f479ece768c55ae
W20260811 08:03:57.767769 22895 leader_election.cc:334] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d27dfc74df774f2f8f479ece768c55ae (127.15.36.254:38213): Network error: Client connection negotiation failed: client connection to 127.15.36.254:38213: connect: Connection refused (error 111)
I20260811 08:03:57.768358 23142 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e42c1146baa3460b91783d5354038210 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f0c35cebbbc411eb7541511d3ca99d3 in term 2.
I20260811 08:03:57.768540 23721 raft_consensus.cc:2726] T 00000000000000000000000000000000 P e42c1146baa3460b91783d5354038210 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 08:03:57.768569 22895 leader_election.cc:302] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f0c35cebbbc411eb7541511d3ca99d3, e42c1146baa3460b91783d5354038210; no voters: d27dfc74df774f2f8f479ece768c55ae
I20260811 08:03:57.768688 23720 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 08:03:57.768873 23720 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3 [term 2 LEADER]: Becoming Leader. State: Replica: 2f0c35cebbbc411eb7541511d3ca99d3, State: Running, Role: LEADER
I20260811 08:03:57.768980 23720 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "d27dfc74df774f2f8f479ece768c55ae" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38213 } } peers { permanent_uuid: "2f0c35cebbbc411eb7541511d3ca99d3" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 38657 } attrs { promote: false } } peers { permanent_uuid: "e42c1146baa3460b91783d5354038210" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 42241 } attrs { promote: false } }
I20260811 08:03:57.769400 23730 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2f0c35cebbbc411eb7541511d3ca99d3. Latest consensus state: current_term: 2 leader_uuid: "2f0c35cebbbc411eb7541511d3ca99d3" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "d27dfc74df774f2f8f479ece768c55ae" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38213 } } peers { permanent_uuid: "2f0c35cebbbc411eb7541511d3ca99d3" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 38657 } attrs { promote: false } } peers { permanent_uuid: "e42c1146baa3460b91783d5354038210" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 42241 } attrs { promote: false } } }
I20260811 08:03:57.769511 23730 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3 [sys.catalog]: This master's current role is: LEADER
I20260811 08:03:57.769690 23733 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:03:57.770138 23733 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:03:57.770200 23733 catalog_manager.cc:1259] Loaded cluster ID: db71382509734f74afa8ec085bf13168
I20260811 08:03:57.770216 23733 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:03:57.770357 23733 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:03:57.770413 23733 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3: Loaded TSK: 0
I20260811 08:03:57.770512 23733 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:03:57.793642 22908 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54604:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:03:57.795665 22908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:03:57.797153 23725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:57.796864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:38213 (local address 127.0.0.1:54902)
0811 08:03:57.796968 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:57.797114 (+ 146us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:38213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
I20260811 08:03:57.797122 23142 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e42c1146baa3460b91783d5354038210 [term 2 FOLLOWER]: Refusing update from remote peer 2f0c35cebbbc411eb7541511d3ca99d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260811 08:03:57.797529 23720 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e42c1146baa3460b91783d5354038210" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 42241 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260811 08:03:57.797662 23725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:57.797554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:38213 (local address 127.0.0.1:54914)
0811 08:03:57.797605 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:57.797640 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:38213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260811 08:03:57.797847 22895 consensus_peers.cc:487] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3 -> Peer d27dfc74df774f2f8f479ece768c55ae (127.15.36.254:38213): Couldn't send request to peer d27dfc74df774f2f8f479ece768c55ae. Status: Network error: Client connection negotiation failed: client connection to 127.15.36.254:38213: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 08:03:57.798624 23721 sys_catalog.cc:455] T 00000000000000000000000000000000 P e42c1146baa3460b91783d5354038210 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2f0c35cebbbc411eb7541511d3ca99d3. Latest consensus state: current_term: 2 leader_uuid: "2f0c35cebbbc411eb7541511d3ca99d3" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "d27dfc74df774f2f8f479ece768c55ae" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38213 } } peers { permanent_uuid: "2f0c35cebbbc411eb7541511d3ca99d3" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 38657 } attrs { promote: false } } peers { permanent_uuid: "e42c1146baa3460b91783d5354038210" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 42241 } attrs { promote: false } } }
I20260811 08:03:57.798736 23721 sys_catalog.cc:458] T 00000000000000000000000000000000 P e42c1146baa3460b91783d5354038210 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 08:03:57.799293 23734 mvcc.cc:205] Tried to move back new op lower bound from 7317239553213935616 to 7317239553102413824. Current Snapshot: MvccSnapshot[applied={T|T < 7317239553213935616}]
I20260811 08:03:57.799432 23730 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "2f0c35cebbbc411eb7541511d3ca99d3" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "d27dfc74df774f2f8f479ece768c55ae" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38213 } } peers { permanent_uuid: "2f0c35cebbbc411eb7541511d3ca99d3" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 38657 } attrs { promote: false } } peers { permanent_uuid: "e42c1146baa3460b91783d5354038210" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 42241 } attrs { promote: false } } }
I20260811 08:03:57.799540 23730 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3 [sys.catalog]: This master's current role is: LEADER
I20260811 08:03:57.799552 23721 sys_catalog.cc:455] T 00000000000000000000000000000000 P e42c1146baa3460b91783d5354038210 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "2f0c35cebbbc411eb7541511d3ca99d3" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "d27dfc74df774f2f8f479ece768c55ae" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38213 } } peers { permanent_uuid: "2f0c35cebbbc411eb7541511d3ca99d3" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 38657 } attrs { promote: false } } peers { permanent_uuid: "e42c1146baa3460b91783d5354038210" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 42241 } attrs { promote: false } } }
I20260811 08:03:57.799633 23721 sys_catalog.cc:458] T 00000000000000000000000000000000 P e42c1146baa3460b91783d5354038210 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 08:03:57.799727 23735 mvcc.cc:205] Tried to move back new op lower bound from 7317239553213935616 to 7317239553102413824. Current Snapshot: MvccSnapshot[applied={T|T < 7317239553213935616}]
I20260811 08:03:57.805194 23744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:57.801880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44304 (local address 127.15.36.195:35307)
0811 08:03:57.801986 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:57.801988 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:57.801997 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:03:57.802022 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:57.802022 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:57.802034 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:57.802228 (+ 194us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:03:57.802267 (+ 39us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:57.803068 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:57.804169 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:57.804799 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:57.804886 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:57.804899 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:57.805064 (+ 165us) server_negotiation.cc:299] Negotiation successful
0811 08:03:57.805112 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88,"thread_start_us":56,"threads_started":1}
I20260811 08:03:57.805219 23722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:57.801490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.195:35307 (local address 127.0.0.1:44304)
0811 08:03:57.801520 (+ 30us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:57.801533 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:57.801586 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:57.802127 (+ 541us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:57.802128 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:57.802130 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:03:57.802165 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:57.802166 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:57.803136 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:57.803137 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:57.804039 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:57.804043 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:57.804886 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:57.804887 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:57.804964 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:57.804968 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:03:57.805053 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 08:03:57.805107 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19,"mutex_wait_us":2}
I20260811 08:03:57.805370 23743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:57.801744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37686 (local address 127.15.36.194:37987)
0811 08:03:57.801871 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:57.801873 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:57.801881 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:03:57.801909 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:57.801910 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:57.801922 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:57.801988 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:03:57.802168 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:57.802993 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:57.804233 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:57.804792 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:57.804875 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:57.804888 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:57.805254 (+ 366us) server_negotiation.cc:299] Negotiation successful
0811 08:03:57.805303 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106,"thread_start_us":58,"threads_started":1}
I20260811 08:03:57.805223 23725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:57.801464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.194:37987 (local address 127.0.0.1:37686)
0811 08:03:57.801638 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:57.801646 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:57.801670 (+ 24us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:57.802043 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:57.802044 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:57.802046 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:03:57.802092 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:57.802094 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:57.803071 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:57.803072 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:57.804117 (+ 1045us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:57.804120 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:57.804921 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:57.804922 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:57.804984 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:57.804989 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 08:03:57.805037 (+ 48us) client_negotiation.cc:240] Negotiation successful
0811 08:03:57.805095 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20,"mutex_wait_us":2}
I20260811 08:03:57.805474 23739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:57.801465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.193:38419 (local address 127.0.0.1:49470)
0811 08:03:57.801664 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:57.801675 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:57.801729 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:57.801953 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:57.801955 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:57.801957 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:03:57.802020 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:57.802021 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:57.802864 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:57.802865 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:57.804133 (+ 1268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:57.804135 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:57.805070 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:57.805071 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:57.805118 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:57.805121 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:03:57.805150 (+ 29us) client_negotiation.cc:240] Negotiation successful
0811 08:03:57.805188 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"mutex_wait_us":53,"thread_start_us":90,"threads_started":1}
I20260811 08:03:57.805581 23742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:57.801605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49470 (local address 127.15.36.193:38419)
0811 08:03:57.801769 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:57.801771 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:57.801781 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:03:57.801817 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:57.801818 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:57.801846 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:57.802100 (+ 254us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:03:57.802143 (+ 43us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:57.802753 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:57.804292 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:57.804976 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:57.805265 (+ 289us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:57.805280 (+ 15us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:57.805297 (+ 17us) server_negotiation.cc:299] Negotiation successful
0811 08:03:57.805338 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":86,"threads_started":1}
I20260811 08:03:57.805792 23413 tablet_service.cc:1467] Processing CreateTablet for tablet 31a0b293acb5471eb9eb43427214a2f0 (DEFAULT_TABLE table=test-table [id=5cf467766df7458fa42b4093d2fa56d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:03:57.805944 23413 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31a0b293acb5471eb9eb43427214a2f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:03:57.805959 23262 tablet_service.cc:1467] Processing CreateTablet for tablet 31a0b293acb5471eb9eb43427214a2f0 (DEFAULT_TABLE table=test-table [id=5cf467766df7458fa42b4093d2fa56d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:03:57.806133 23262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31a0b293acb5471eb9eb43427214a2f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:03:57.807557 23745 tablet_bootstrap.cc:492] T 31a0b293acb5471eb9eb43427214a2f0 P cd701cdf69504752aa640a88a90093d6: Bootstrap starting.
I20260811 08:03:57.808168 23568 tablet_service.cc:1467] Processing CreateTablet for tablet 31a0b293acb5471eb9eb43427214a2f0 (DEFAULT_TABLE table=test-table [id=5cf467766df7458fa42b4093d2fa56d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:03:57.808208 23745 tablet_bootstrap.cc:654] T 31a0b293acb5471eb9eb43427214a2f0 P cd701cdf69504752aa640a88a90093d6: Neither blocks nor log segments found. Creating new log.
I20260811 08:03:57.808332 23568 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31a0b293acb5471eb9eb43427214a2f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:03:57.808593 23746 tablet_bootstrap.cc:492] T 31a0b293acb5471eb9eb43427214a2f0 P fb38ba8c11d548db8c8f93e92cee9d24: Bootstrap starting.
I20260811 08:03:57.808895 23745 tablet_bootstrap.cc:492] T 31a0b293acb5471eb9eb43427214a2f0 P cd701cdf69504752aa640a88a90093d6: No bootstrap required, opened a new log
I20260811 08:03:57.808969 23745 ts_tablet_manager.cc:1397] T 31a0b293acb5471eb9eb43427214a2f0 P cd701cdf69504752aa640a88a90093d6: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 08:03:57.809042 23746 tablet_bootstrap.cc:654] T 31a0b293acb5471eb9eb43427214a2f0 P fb38ba8c11d548db8c8f93e92cee9d24: Neither blocks nor log segments found. Creating new log.
I20260811 08:03:57.809103 23745 raft_consensus.cc:348] T 31a0b293acb5471eb9eb43427214a2f0 P cd701cdf69504752aa640a88a90093d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb38ba8c11d548db8c8f93e92cee9d24" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 37987 } } peers { permanent_uuid: "cd701cdf69504752aa640a88a90093d6" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 38419 } } peers { permanent_uuid: "d957252f43b5420eafb1f9611b8fb54c" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 35307 } }
I20260811 08:03:57.809182 23745 raft_consensus.cc:374] T 31a0b293acb5471eb9eb43427214a2f0 P cd701cdf69504752aa640a88a90093d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:03:57.809211 23745 raft_consensus.cc:729] T 31a0b293acb5471eb9eb43427214a2f0 P cd701cdf69504752aa640a88a90093d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd701cdf69504752aa640a88a90093d6, State: Initialized, Role: FOLLOWER
I20260811 08:03:57.809275 23745 consensus_queue.cc:260] T 31a0b293acb5471eb9eb43427214a2f0 P cd701cdf69504752aa640a88a90093d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb38ba8c11d548db8c8f93e92cee9d24" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 37987 } } peers { permanent_uuid: "cd701cdf69504752aa640a88a90093d6" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 38419 } } peers { permanent_uuid: "d957252f43b5420eafb1f9611b8fb54c" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 35307 } }
I20260811 08:03:57.809463 23745 ts_tablet_manager.cc:1428] T 31a0b293acb5471eb9eb43427214a2f0 P cd701cdf69504752aa640a88a90093d6: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 08:03:57.809774 23746 tablet_bootstrap.cc:492] T 31a0b293acb5471eb9eb43427214a2f0 P fb38ba8c11d548db8c8f93e92cee9d24: No bootstrap required, opened a new log
I20260811 08:03:57.809828 23746 ts_tablet_manager.cc:1397] T 31a0b293acb5471eb9eb43427214a2f0 P fb38ba8c11d548db8c8f93e92cee9d24: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 08:03:57.809973 23746 raft_consensus.cc:348] T 31a0b293acb5471eb9eb43427214a2f0 P fb38ba8c11d548db8c8f93e92cee9d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb38ba8c11d548db8c8f93e92cee9d24" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 37987 } } peers { permanent_uuid: "cd701cdf69504752aa640a88a90093d6" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 38419 } } peers { permanent_uuid: "d957252f43b5420eafb1f9611b8fb54c" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 35307 } }
I20260811 08:03:57.810046 23746 raft_consensus.cc:374] T 31a0b293acb5471eb9eb43427214a2f0 P fb38ba8c11d548db8c8f93e92cee9d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:03:57.810065 23746 raft_consensus.cc:729] T 31a0b293acb5471eb9eb43427214a2f0 P fb38ba8c11d548db8c8f93e92cee9d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb38ba8c11d548db8c8f93e92cee9d24, State: Initialized, Role: FOLLOWER
I20260811 08:03:57.810114 23746 consensus_queue.cc:260] T 31a0b293acb5471eb9eb43427214a2f0 P fb38ba8c11d548db8c8f93e92cee9d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb38ba8c11d548db8c8f93e92cee9d24" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 37987 } } peers { permanent_uuid: "cd701cdf69504752aa640a88a90093d6" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 38419 } } peers { permanent_uuid: "d957252f43b5420eafb1f9611b8fb54c" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 35307 } }
I20260811 08:03:57.810259 23746 ts_tablet_manager.cc:1428] T 31a0b293acb5471eb9eb43427214a2f0 P fb38ba8c11d548db8c8f93e92cee9d24: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:57.810359 23751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:57.809760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:38213 (local address 127.15.36.193:53191)
0811 08:03:57.810262 (+ 502us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:57.810313 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:38213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":471,"thread_start_us":95,"threads_started":1}
I20260811 08:03:57.811106 23751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:57.811008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:38213 (local address 127.15.36.193:57849)
0811 08:03:57.811048 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:57.811073 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:38213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20260811 08:03:57.811252 23752 tablet_bootstrap.cc:492] T 31a0b293acb5471eb9eb43427214a2f0 P d957252f43b5420eafb1f9611b8fb54c: Bootstrap starting.
I20260811 08:03:57.811381 23490 heartbeater.cc:503] Master 127.15.36.253:38657 was elected leader, sending a full tablet report...
I20260811 08:03:57.811589 23754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:57.811124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:38213 (local address 127.15.36.194:40301)
0811 08:03:57.811395 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:57.811548 (+ 153us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:38213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":122,"threads_started":1}
I20260811 08:03:57.811682 23752 tablet_bootstrap.cc:654] T 31a0b293acb5471eb9eb43427214a2f0 P d957252f43b5420eafb1f9611b8fb54c: Neither blocks nor log segments found. Creating new log.
I20260811 08:03:57.812057 23754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:57.811925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:38213 (local address 127.15.36.194:36867)
0811 08:03:57.811988 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:57.812027 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:38213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260811 08:03:57.812407 23752 tablet_bootstrap.cc:492] T 31a0b293acb5471eb9eb43427214a2f0 P d957252f43b5420eafb1f9611b8fb54c: No bootstrap required, opened a new log
I20260811 08:03:57.812456 23752 ts_tablet_manager.cc:1397] T 31a0b293acb5471eb9eb43427214a2f0 P d957252f43b5420eafb1f9611b8fb54c: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 08:03:57.812559 23752 raft_consensus.cc:348] T 31a0b293acb5471eb9eb43427214a2f0 P d957252f43b5420eafb1f9611b8fb54c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb38ba8c11d548db8c8f93e92cee9d24" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 37987 } } peers { permanent_uuid: "cd701cdf69504752aa640a88a90093d6" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 38419 } } peers { permanent_uuid: "d957252f43b5420eafb1f9611b8fb54c" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 35307 } }
I20260811 08:03:57.812618 23752 raft_consensus.cc:374] T 31a0b293acb5471eb9eb43427214a2f0 P d957252f43b5420eafb1f9611b8fb54c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:03:57.812633 23752 raft_consensus.cc:729] T 31a0b293acb5471eb9eb43427214a2f0 P d957252f43b5420eafb1f9611b8fb54c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d957252f43b5420eafb1f9611b8fb54c, State: Initialized, Role: FOLLOWER
I20260811 08:03:57.812696 23752 consensus_queue.cc:260] T 31a0b293acb5471eb9eb43427214a2f0 P d957252f43b5420eafb1f9611b8fb54c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb38ba8c11d548db8c8f93e92cee9d24" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 37987 } } peers { permanent_uuid: "cd701cdf69504752aa640a88a90093d6" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 38419 } } peers { permanent_uuid: "d957252f43b5420eafb1f9611b8fb54c" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 35307 } }
I20260811 08:03:57.812904 23752 ts_tablet_manager.cc:1428] T 31a0b293acb5471eb9eb43427214a2f0 P d957252f43b5420eafb1f9611b8fb54c: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 08:03:57.813269 23757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:57.813054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:38213 (local address 127.15.36.195:58333)
0811 08:03:57.813183 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:57.813223 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:38213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":88,"threads_started":1}
I20260811 08:03:57.813910 23757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:57.813791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:38213 (local address 127.15.36.195:35635)
0811 08:03:57.813849 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:57.813881 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:38213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260811 08:03:57.819253 23646 tablet.cc:2369] T 31a0b293acb5471eb9eb43427214a2f0 P d957252f43b5420eafb1f9611b8fb54c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:03:57.914405 23756 raft_consensus.cc:482] T 31a0b293acb5471eb9eb43427214a2f0 P d957252f43b5420eafb1f9611b8fb54c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:03:57.914523 23756 raft_consensus.cc:504] T 31a0b293acb5471eb9eb43427214a2f0 P d957252f43b5420eafb1f9611b8fb54c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb38ba8c11d548db8c8f93e92cee9d24" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 37987 } } peers { permanent_uuid: "cd701cdf69504752aa640a88a90093d6" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 38419 } } peers { permanent_uuid: "d957252f43b5420eafb1f9611b8fb54c" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 35307 } }
I20260811 08:03:57.915169 23756 leader_election.cc:288] T 31a0b293acb5471eb9eb43427214a2f0 P d957252f43b5420eafb1f9611b8fb54c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fb38ba8c11d548db8c8f93e92cee9d24 (127.15.36.194:37987), cd701cdf69504752aa640a88a90093d6 (127.15.36.193:38419)
I20260811 08:03:57.918839 23757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:57.915362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.193:38419 (local address 127.15.36.195:57655)
0811 08:03:57.915417 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:57.915433 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:57.915501 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:57.915676 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:57.915677 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:57.915679 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:03:57.915781 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:57.915783 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:57.916606 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:57.916607 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:57.917688 (+ 1081us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:57.917692 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:57.918498 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:57.918499 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:57.918588 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:57.918592 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:03:57.918665 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 08:03:57.918722 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260811 08:03:57.918877 23742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:57.915441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:57655 (local address 127.15.36.193:38419)
0811 08:03:57.915506 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:57.915509 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:57.915524 (+ 15us) server_negotiation.cc:407] Connection header received
0811 08:03:57.915563 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:57.915564 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:57.915575 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:57.915669 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:03:57.915910 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:57.916491 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:57.917816 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:57.918358 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:57.918497 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:57.918510 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:57.918687 (+ 177us) server_negotiation.cc:299] Negotiation successful
0811 08:03:57.918734 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 08:03:57.919201 23743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:57.915507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:38775 (local address 127.15.36.194:37987)
0811 08:03:57.915555 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:57.915557 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:57.915687 (+ 130us) server_negotiation.cc:407] Connection header received
0811 08:03:57.915784 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:57.915785 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:57.915796 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:57.915854 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:03:57.916037 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:57.916656 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:57.918261 (+ 1605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:57.918703 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:57.918823 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:57.918834 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:57.919080 (+ 246us) server_negotiation.cc:299] Negotiation successful
0811 08:03:57.919133 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 08:03:57.919224 23758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:57.915401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.194:37987 (local address 127.15.36.195:38775)
0811 08:03:57.915615 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:57.915623 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:57.915693 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:57.915867 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:57.915867 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:57.915869 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:03:57.915952 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:57.915953 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:57.916805 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:57.916807 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:57.917941 (+ 1134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:57.917949 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:57.918862 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:57.918863 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:57.918990 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:57.918995 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 08:03:57.919068 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 08:03:57.919133 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":141,"threads_started":1}
I20260811 08:03:57.919209 23283 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31a0b293acb5471eb9eb43427214a2f0" candidate_uuid: "d957252f43b5420eafb1f9611b8fb54c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd701cdf69504752aa640a88a90093d6" is_pre_election: true
I20260811 08:03:57.919417 23283 raft_consensus.cc:2454] T 31a0b293acb5471eb9eb43427214a2f0 P cd701cdf69504752aa640a88a90093d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d957252f43b5420eafb1f9611b8fb54c in term 0.
I20260811 08:03:57.919543 23434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31a0b293acb5471eb9eb43427214a2f0" candidate_uuid: "d957252f43b5420eafb1f9611b8fb54c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb38ba8c11d548db8c8f93e92cee9d24" is_pre_election: true
I20260811 08:03:57.919661 23434 raft_consensus.cc:2454] T 31a0b293acb5471eb9eb43427214a2f0 P fb38ba8c11d548db8c8f93e92cee9d24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d957252f43b5420eafb1f9611b8fb54c in term 0.
I20260811 08:03:57.919709 23518 leader_election.cc:302] T 31a0b293acb5471eb9eb43427214a2f0 P d957252f43b5420eafb1f9611b8fb54c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd701cdf69504752aa640a88a90093d6, d957252f43b5420eafb1f9611b8fb54c; no voters:
I20260811 08:03:57.919871 23756 raft_consensus.cc:2781] T 31a0b293acb5471eb9eb43427214a2f0 P d957252f43b5420eafb1f9611b8fb54c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:03:57.919946 23756 raft_consensus.cc:482] T 31a0b293acb5471eb9eb43427214a2f0 P d957252f43b5420eafb1f9611b8fb54c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:03:57.919984 23756 raft_consensus.cc:3037] T 31a0b293acb5471eb9eb43427214a2f0 P d957252f43b5420eafb1f9611b8fb54c [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:03:57.921021 23756 raft_consensus.cc:504] T 31a0b293acb5471eb9eb43427214a2f0 P d957252f43b5420eafb1f9611b8fb54c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb38ba8c11d548db8c8f93e92cee9d24" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 37987 } } peers { permanent_uuid: "cd701cdf69504752aa640a88a90093d6" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 38419 } } peers { permanent_uuid: "d957252f43b5420eafb1f9611b8fb54c" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 35307 } }
I20260811 08:03:57.921200 23756 leader_election.cc:288] T 31a0b293acb5471eb9eb43427214a2f0 P d957252f43b5420eafb1f9611b8fb54c [CANDIDATE]: Term 1 election: Requested vote from peers fb38ba8c11d548db8c8f93e92cee9d24 (127.15.36.194:37987), cd701cdf69504752aa640a88a90093d6 (127.15.36.193:38419)
I20260811 08:03:57.921361 23434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31a0b293acb5471eb9eb43427214a2f0" candidate_uuid: "d957252f43b5420eafb1f9611b8fb54c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb38ba8c11d548db8c8f93e92cee9d24"
I20260811 08:03:57.921411 23283 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31a0b293acb5471eb9eb43427214a2f0" candidate_uuid: "d957252f43b5420eafb1f9611b8fb54c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd701cdf69504752aa640a88a90093d6"
I20260811 08:03:57.921473 23434 raft_consensus.cc:3037] T 31a0b293acb5471eb9eb43427214a2f0 P fb38ba8c11d548db8c8f93e92cee9d24 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:03:57.921506 23283 raft_consensus.cc:3037] T 31a0b293acb5471eb9eb43427214a2f0 P cd701cdf69504752aa640a88a90093d6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:03:57.922196 23434 raft_consensus.cc:2454] T 31a0b293acb5471eb9eb43427214a2f0 P fb38ba8c11d548db8c8f93e92cee9d24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d957252f43b5420eafb1f9611b8fb54c in term 1.
I20260811 08:03:57.922266 23283 raft_consensus.cc:2454] T 31a0b293acb5471eb9eb43427214a2f0 P cd701cdf69504752aa640a88a90093d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d957252f43b5420eafb1f9611b8fb54c in term 1.
I20260811 08:03:57.922441 23518 leader_election.cc:302] T 31a0b293acb5471eb9eb43427214a2f0 P d957252f43b5420eafb1f9611b8fb54c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd701cdf69504752aa640a88a90093d6, d957252f43b5420eafb1f9611b8fb54c; no voters:
I20260811 08:03:57.922609 23756 raft_consensus.cc:2781] T 31a0b293acb5471eb9eb43427214a2f0 P d957252f43b5420eafb1f9611b8fb54c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:03:57.922806 23756 raft_consensus.cc:686] T 31a0b293acb5471eb9eb43427214a2f0 P d957252f43b5420eafb1f9611b8fb54c [term 1 LEADER]: Becoming Leader. State: Replica: d957252f43b5420eafb1f9611b8fb54c, State: Running, Role: LEADER
I20260811 08:03:57.922895 23756 consensus_queue.cc:237] T 31a0b293acb5471eb9eb43427214a2f0 P d957252f43b5420eafb1f9611b8fb54c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb38ba8c11d548db8c8f93e92cee9d24" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 37987 } } peers { permanent_uuid: "cd701cdf69504752aa640a88a90093d6" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 38419 } } peers { permanent_uuid: "d957252f43b5420eafb1f9611b8fb54c" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 35307 } }
I20260811 08:03:57.923115 23645 heartbeater.cc:503] Master 127.15.36.253:38657 was elected leader, sending a full tablet report...
I20260811 08:03:57.923548 23758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:57.923222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:38213 (local address 127.15.36.195:41437)
0811 08:03:57.923471 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:57.923515 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:38213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":229}
I20260811 08:03:57.923836 22910 catalog_manager.cc:5495] T 31a0b293acb5471eb9eb43427214a2f0 P d957252f43b5420eafb1f9611b8fb54c reported cstate change: term changed from 0 to 1, leader changed from <none> to d957252f43b5420eafb1f9611b8fb54c (127.15.36.195). New cstate: current_term: 1 leader_uuid: "d957252f43b5420eafb1f9611b8fb54c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb38ba8c11d548db8c8f93e92cee9d24" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 37987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd701cdf69504752aa640a88a90093d6" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 38419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d957252f43b5420eafb1f9611b8fb54c" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 35307 } health_report { overall_health: HEALTHY } } }
I20260811 08:03:57.958338 23744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:57.953383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44310 (local address 127.15.36.195:35307)
0811 08:03:57.953475 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:57.953477 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:57.953489 (+ 12us) server_negotiation.cc:407] Connection header received
0811 08:03:57.953533 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:57.953533 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:57.953554 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:57.953646 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:03:57.953947 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:57.954782 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:57.956261 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:57.956600 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:57.956820 (+ 220us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:57.957260 (+ 440us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:03:57.957552 (+ 292us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:03:57.957633 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:57.958173 (+ 540us) server_negotiation.cc:299] Negotiation successful
0811 08:03:57.958213 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 08:03:57.960742 23434 raft_consensus.cc:1261] T 31a0b293acb5471eb9eb43427214a2f0 P fb38ba8c11d548db8c8f93e92cee9d24 [term 1 FOLLOWER]: Refusing update from remote peer d957252f43b5420eafb1f9611b8fb54c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:03:57.960865 23283 raft_consensus.cc:1261] T 31a0b293acb5471eb9eb43427214a2f0 P cd701cdf69504752aa640a88a90093d6 [term 1 FOLLOWER]: Refusing update from remote peer d957252f43b5420eafb1f9611b8fb54c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:03:57.961416 23759 consensus_queue.cc:1035] T 31a0b293acb5471eb9eb43427214a2f0 P d957252f43b5420eafb1f9611b8fb54c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb38ba8c11d548db8c8f93e92cee9d24" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 37987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:03:57.961587 23756 consensus_queue.cc:1035] T 31a0b293acb5471eb9eb43427214a2f0 P d957252f43b5420eafb1f9611b8fb54c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd701cdf69504752aa640a88a90093d6" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 38419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:03:57.962524 23336 heartbeater.cc:503] Master 127.15.36.253:38657 was elected leader, sending a full tablet report...
I20260811 08:03:57.962721 23751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:57.962614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:38213 (local address 127.15.36.193:49401)
0811 08:03:57.962658 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:57.962692 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:38213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260811 08:03:57.962939 23754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:57.962222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:38213 (local address 127.15.36.194:42335)
0811 08:03:57.962856 (+ 634us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:57.962897 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:38213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":611}
I20260811 08:03:57.964425 23758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:57.964232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:38213 (local address 127.15.36.195:33489)
0811 08:03:57.964356 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:57.964390 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:38213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106}
I20260811 08:03:57.965039 23751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:57.964745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:38213 (local address 127.15.36.193:36687)
0811 08:03:57.964945 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:57.965001 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:38213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":181}
I20260811 08:03:57.966547 22908 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54604:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:03:57.966626 23754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:57.966518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:38213 (local address 127.15.36.194:34817)
0811 08:03:57.966563 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:57.966593 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:38213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260811 08:03:57.966666 22908 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54604:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:03:57.968091 22908 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2f0c35cebbbc411eb7541511d3ca99d3: Sending DeleteTablet for 3 replicas of tablet 31a0b293acb5471eb9eb43427214a2f0
I20260811 08:03:57.968479 23262 tablet_service.cc:1514] Processing DeleteTablet for tablet 31a0b293acb5471eb9eb43427214a2f0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:03:57 UTC) from {username='oryx', principal='oryx/127.15.36.253@KRBTEST.COM'} at 127.0.0.1:49470
I20260811 08:03:57.968568 23568 tablet_service.cc:1514] Processing DeleteTablet for tablet 31a0b293acb5471eb9eb43427214a2f0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:03:57 UTC) from {username='oryx', principal='oryx/127.15.36.253@KRBTEST.COM'} at 127.0.0.1:44304
I20260811 08:03:57.968763 23772 tablet_replica.cc:330] T 31a0b293acb5471eb9eb43427214a2f0 P cd701cdf69504752aa640a88a90093d6: stopping tablet replica
I20260811 08:03:57.968833 23772 raft_consensus.cc:2229] T 31a0b293acb5471eb9eb43427214a2f0 P cd701cdf69504752aa640a88a90093d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:03:57.968895 23772 raft_consensus.cc:2258] T 31a0b293acb5471eb9eb43427214a2f0 P cd701cdf69504752aa640a88a90093d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:03:57.968891 23413 tablet_service.cc:1514] Processing DeleteTablet for tablet 31a0b293acb5471eb9eb43427214a2f0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:03:57 UTC) from {username='oryx', principal='oryx/127.15.36.253@KRBTEST.COM'} at 127.0.0.1:37686
I20260811 08:03:57.969066 23773 tablet_replica.cc:330] T 31a0b293acb5471eb9eb43427214a2f0 P d957252f43b5420eafb1f9611b8fb54c: stopping tablet replica
I20260811 08:03:57.969177 23773 raft_consensus.cc:2229] T 31a0b293acb5471eb9eb43427214a2f0 P d957252f43b5420eafb1f9611b8fb54c [term 1 LEADER]: Raft consensus shutting down.
I20260811 08:03:57.969295 23772 ts_tablet_manager.cc:1905] T 31a0b293acb5471eb9eb43427214a2f0 P cd701cdf69504752aa640a88a90093d6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:03:57.969329 23773 raft_consensus.cc:2258] T 31a0b293acb5471eb9eb43427214a2f0 P d957252f43b5420eafb1f9611b8fb54c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:03:57.969511 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 23079
I20260811 08:03:57.970772 23773 ts_tablet_manager.cc:1905] T 31a0b293acb5471eb9eb43427214a2f0 P d957252f43b5420eafb1f9611b8fb54c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:03:57.975898 23774 tablet_replica.cc:330] T 31a0b293acb5471eb9eb43427214a2f0 P fb38ba8c11d548db8c8f93e92cee9d24: stopping tablet replica
I20260811 08:03:57.976255 23774 raft_consensus.cc:2229] T 31a0b293acb5471eb9eb43427214a2f0 P fb38ba8c11d548db8c8f93e92cee9d24 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:03:57.976470 23774 raft_consensus.cc:2258] T 31a0b293acb5471eb9eb43427214a2f0 P fb38ba8c11d548db8c8f93e92cee9d24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:03:57.977062 23774 ts_tablet_manager.cc:1905] T 31a0b293acb5471eb9eb43427214a2f0 P fb38ba8c11d548db8c8f93e92cee9d24: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:03:57.977882 23773 ts_tablet_manager.cc:1918] T 31a0b293acb5471eb9eb43427214a2f0 P d957252f43b5420eafb1f9611b8fb54c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:03:57.978128 23773 log.cc:1196] T 31a0b293acb5471eb9eb43427214a2f0 P d957252f43b5420eafb1f9611b8fb54c: Deleting WAL directory at /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-2/wal/wals/31a0b293acb5471eb9eb43427214a2f0
I20260811 08:03:57.978895 23773 ts_tablet_manager.cc:1939] T 31a0b293acb5471eb9eb43427214a2f0 P d957252f43b5420eafb1f9611b8fb54c: Deleting consensus metadata
I20260811 08:03:57.980108 22891 catalog_manager.cc:4841] TS d957252f43b5420eafb1f9611b8fb54c (127.15.36.195:35307): tablet 31a0b293acb5471eb9eb43427214a2f0 (table test-table [id=5cf467766df7458fa42b4093d2fa56d4]) successfully deleted
I20260811 08:03:57.981482 23774 ts_tablet_manager.cc:1918] T 31a0b293acb5471eb9eb43427214a2f0 P fb38ba8c11d548db8c8f93e92cee9d24: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:03:57.981875 23774 log.cc:1196] T 31a0b293acb5471eb9eb43427214a2f0 P fb38ba8c11d548db8c8f93e92cee9d24: Deleting WAL directory at /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786435400844580-15507-0/minicluster-data/ts-1/wal/wals/31a0b293acb5471eb9eb43427214a2f0
I20260811 08:03:57.982319 23774 ts_tablet_manager.cc:1939] T 31a0b293acb5471eb9eb43427214a2f0 P fb38ba8c11d548db8c8f93e92cee9d24: Deleting consensus metadata
I20260811 08:03:57.982867 22895 catalog_manager.cc:4841] TS fb38ba8c11d548db8c8f93e92cee9d24 (127.15.36.194:37987): tablet 31a0b293acb5471eb9eb43427214a2f0 (table test-table [id=5cf467766df7458fa42b4093d2fa56d4]) successfully deleted
W20260811 08:03:57.987197 23739 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:03:57.986896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.193:38419 (local address 127.0.0.1:49484)
0811 08:03:57.986995 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:57.987010 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:57.987066 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:57.987133 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.193:38419: BlockingWrite error: write error: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":44}
W20260811 08:03:57.987407 22892 catalog_manager.cc:4584] TS cd701cdf69504752aa640a88a90093d6 (127.15.36.193:38419): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 31a0b293acb5471eb9eb43427214a2f0: Network error: Client connection negotiation failed: client connection to 127.15.36.193:38419: BlockingWrite error: write error: Connection reset by peer (error 104)
I20260811 08:03:57.987465 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 23345
I20260811 08:03:57.997185 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 23497
I20260811 08:03:58.005971 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 22757
I20260811 08:03:58.014357 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 22974
2026-08-11T08:03:58Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (5236 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:03:58 dist-test-slave-2w3w krb5kdc[23777](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:03:58 dist-test-slave-2w3w krb5kdc[23777](info): set up 2 sockets
Aug 11 08:03:58 dist-test-slave-2w3w krb5kdc[23777](info): commencing operation
krb5kdc: starting...
W20260811 08:03:59.247519 15507 mini_kdc.cc:121] Time spent starting KDC: real 1.204s user 0.003s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Aug 11 08:03:59 dist-test-slave-2w3w krb5kdc[23777](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435439, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:03:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:03:59Z Disabled control of system clock
WARNING: no policy specified for oryx/127.15.36.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.36.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.36.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/krb5kdc/oryx_127.15.36.254.keytab.
Entry for principal oryx/127.15.36.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/krb5kdc/oryx_127.15.36.254.keytab.
I20260811 08:03:59.396692 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:39763
--webserver_interface=127.15.36.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/krb5kdc/oryx_127.15.36.254.keytab
--principal=oryx/127.15.36.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:39973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.36.254:39763
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:03:59.491074 23791 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:03:59.491345 23791 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:03:59.491377 23791 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:03:59.492970 23791 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:03:59.493046 23791 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 08:03:59.493062 23791 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:03:59.493075 23791 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:03:59.493088 23791 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:03:59.493101 23791 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:03:59.495086 23791 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:39973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.36.254:39763
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/krb5kdc/oryx_127.15.36.254.keytab
--principal=oryx/127.15.36.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:39763
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.36.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23791
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:03:59.495352 23791 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:03:59.495568 23791 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:03:59.501386 23798 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:59.501336 23801 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:03:59.501953 23791 server_base.cc:1034] running on GCE node
W20260811 08:03:59.501336 23799 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:03:59.502410 23791 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:03:59.502816 23791 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:03:59.504045 23791 hybrid_clock.cc:648] HybridClock initialized: now 1786435439504023 us; error 58 us; skew 500 ppm
Aug 11 08:03:59 dist-test-slave-2w3w krb5kdc[23777](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435439, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.36.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:03:59.507647 23791 init.cc:377] Logged in from keytab as oryx/127.15.36.254@KRBTEST.COM (short username oryx)
I20260811 08:03:59.508271 23791 webserver.cc:460] Webserver started at http://127.15.36.254:39135/ using document root <none> and password file <none>
I20260811 08:03:59.508566 23791 fs_manager.cc:359] Metadata directory not provided
I20260811 08:03:59.508646 23791 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:03:59.508823 23791 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:03:59.510212 23791 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/master-0/data/instance:
uuid: "7e3bec8f0c164e9aae3ea98efe747f43"
format_stamp: "Formatted at 2026-08-11 08:03:59 on dist-test-slave-2w3w"
server_key: "cb4310192a1aa799e52555f0188b4c8f"
server_key_iv: "6e3c40e441b38fb0ba37a4300a49c596"
server_key_version: "encryptionkey@0"
I20260811 08:03:59.511426 23791 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/master-0/wal/instance:
uuid: "7e3bec8f0c164e9aae3ea98efe747f43"
format_stamp: "Formatted at 2026-08-11 08:03:59 on dist-test-slave-2w3w"
server_key: "cb4310192a1aa799e52555f0188b4c8f"
server_key_iv: "6e3c40e441b38fb0ba37a4300a49c596"
server_key_version: "encryptionkey@0"
I20260811 08:03:59.513990 23791 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.002s
I20260811 08:03:59.515223 23808 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:59.515673 23791 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260811 08:03:59.515899 23791 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/master-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/master-0/wal
uuid: "7e3bec8f0c164e9aae3ea98efe747f43"
format_stamp: "Formatted at 2026-08-11 08:03:59 on dist-test-slave-2w3w"
server_key: "cb4310192a1aa799e52555f0188b4c8f"
server_key_iv: "6e3c40e441b38fb0ba37a4300a49c596"
server_key_version: "encryptionkey@0"
I20260811 08:03:59.516196 23791 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:03:59.554167 23791 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:03:59.556855 23791 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:03:59.557083 23791 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:03:59.564399 23791 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.254:39763
I20260811 08:03:59.564473 23882 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.254:39763 every 8 connection(s)
I20260811 08:03:59.564883 23791 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
I20260811 08:03:59.565691 23883 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:03:59.568631 23883 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7e3bec8f0c164e9aae3ea98efe747f43: Bootstrap starting.
I20260811 08:03:59.569435 23883 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7e3bec8f0c164e9aae3ea98efe747f43: Neither blocks nor log segments found. Creating new log.
I20260811 08:03:59.569815 23883 log.cc:824] T 00000000000000000000000000000000 P 7e3bec8f0c164e9aae3ea98efe747f43: Log is configured to *not* fsync() on all Append() calls
I20260811 08:03:59.570752 23883 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7e3bec8f0c164e9aae3ea98efe747f43: No bootstrap required, opened a new log
I20260811 08:03:59.573694 23883 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7e3bec8f0c164e9aae3ea98efe747f43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e3bec8f0c164e9aae3ea98efe747f43" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 39763 } }
I20260811 08:03:59.573897 23883 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7e3bec8f0c164e9aae3ea98efe747f43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:03:59.573930 23883 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7e3bec8f0c164e9aae3ea98efe747f43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e3bec8f0c164e9aae3ea98efe747f43, State: Initialized, Role: FOLLOWER
I20260811 08:03:59.574129 23883 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7e3bec8f0c164e9aae3ea98efe747f43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e3bec8f0c164e9aae3ea98efe747f43" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 39763 } }
I20260811 08:03:59.574222 23883 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7e3bec8f0c164e9aae3ea98efe747f43 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:03:59.574249 23883 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7e3bec8f0c164e9aae3ea98efe747f43 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:03:59.574281 23883 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7e3bec8f0c164e9aae3ea98efe747f43 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:03:59.575001 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 23791
I20260811 08:03:59.575109 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/master-0/wal/instance
I20260811 08:03:59.575198 23883 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7e3bec8f0c164e9aae3ea98efe747f43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e3bec8f0c164e9aae3ea98efe747f43" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 39763 } }
I20260811 08:03:59.575330 15507 external_mini_cluster.cc:1428] Setting key e1693a3300308db3cf0f7fda32a166a5
I20260811 08:03:59.575345 23883 leader_election.cc:302] T 00000000000000000000000000000000 P 7e3bec8f0c164e9aae3ea98efe747f43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7e3bec8f0c164e9aae3ea98efe747f43; no voters:
I20260811 08:03:59.575570 23883 leader_election.cc:288] T 00000000000000000000000000000000 P 7e3bec8f0c164e9aae3ea98efe747f43 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:03:59.575733 23886 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7e3bec8f0c164e9aae3ea98efe747f43 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:03:59.575906 23883 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7e3bec8f0c164e9aae3ea98efe747f43 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:03:59.575963 23886 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7e3bec8f0c164e9aae3ea98efe747f43 [term 1 LEADER]: Becoming Leader. State: Replica: 7e3bec8f0c164e9aae3ea98efe747f43, State: Running, Role: LEADER
I20260811 08:03:59.576087 23886 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7e3bec8f0c164e9aae3ea98efe747f43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e3bec8f0c164e9aae3ea98efe747f43" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 39763 } }
I20260811 08:03:59.576928 23889 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e3bec8f0c164e9aae3ea98efe747f43 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7e3bec8f0c164e9aae3ea98efe747f43" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e3bec8f0c164e9aae3ea98efe747f43" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 39763 } } }
I20260811 08:03:59.576902 23887 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e3bec8f0c164e9aae3ea98efe747f43 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7e3bec8f0c164e9aae3ea98efe747f43. Latest consensus state: current_term: 1 leader_uuid: "7e3bec8f0c164e9aae3ea98efe747f43" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e3bec8f0c164e9aae3ea98efe747f43" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 39763 } } }
I20260811 08:03:59.577056 23889 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e3bec8f0c164e9aae3ea98efe747f43 [sys.catalog]: This master's current role is: LEADER
I20260811 08:03:59.577073 23887 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e3bec8f0c164e9aae3ea98efe747f43 [sys.catalog]: This master's current role is: LEADER
I20260811 08:03:59.577322 23899 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:03:59.578305 23899 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:03:59.581212 23899 catalog_manager.cc:1347] Generated new cluster ID: 9df587b6a12942ea9cb8d7254d8bbf63
I20260811 08:03:59.581835 23899 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 08:03:59 dist-test-slave-2w3w krb5kdc[23777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435439, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM
I20260811 08:03:59.588323 23890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:59.576116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59770 (local address 127.15.36.254:39763)
0811 08:03:59.576496 (+ 380us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:59.576507 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:59.576544 (+ 37us) server_negotiation.cc:407] Connection header received
0811 08:03:59.576685 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:59.576693 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:59.576764 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:59.577908 (+ 1144us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:59.578137 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:59.579460 (+ 1323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:59.580684 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:59.581349 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:59.581479 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:59.584534 (+ 3055us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:59.584540 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:59.584541 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:59.584563 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:59.586421 (+ 1858us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:59.586862 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:59.586866 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:59.586866 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:59.587081 (+ 215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:59.587325 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:59.587326 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:59.587327 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:59.587629 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:59.587848 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:59.587927 (+ 79us) server_negotiation.cc:299] Negotiation successful
0811 08:03:59.588088 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":233,"thread_start_us":112,"threads_started":1}
I20260811 08:03:59.599673 23899 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:03:59.600600 23899 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:03:59.606520 23899 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7e3bec8f0c164e9aae3ea98efe747f43: Generated new TSK 0
I20260811 08:03:59.606801 23899 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.15.36.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.36.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.36.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/krb5kdc/oryx_127.15.36.193.keytab.
Entry for principal oryx/127.15.36.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/krb5kdc/oryx_127.15.36.193.keytab.
I20260811 08:03:59.653407 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.193:0
--local_ip_for_outbound_sockets=127.15.36.193
--webserver_interface=127.15.36.193
--webserver_port=0
--tserver_master_addrs=127.15.36.254:39763
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/krb5kdc/oryx_127.15.36.193.keytab
--principal=oryx/127.15.36.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:39973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:03:59.757730 23912 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:03:59.758014 23912 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:03:59.758064 23912 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:03:59.759517 23912 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:03:59.759596 23912 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:03:59.759636 23912 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 08:03:59.759693 23912 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.193
I20260811 08:03:59.761490 23912 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:39973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/krb5kdc/oryx_127.15.36.193.keytab
--principal=oryx/127.15.36.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.36.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.15.36.254:39763
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23912
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.193
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:03:59.761837 23912 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:03:59.762113 23912 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:03:59.767767 23921 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:03:59.767988 23912 server_base.cc:1034] running on GCE node
W20260811 08:03:59.767767 23919 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:59.767767 23918 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:03:59.768326 23912 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:03:59.768553 23912 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:03:59.769724 23912 hybrid_clock.cc:648] HybridClock initialized: now 1786435439769692 us; error 45 us; skew 500 ppm
Aug 11 08:03:59 dist-test-slave-2w3w krb5kdc[23777](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435439, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.36.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:03:59.772681 23912 init.cc:377] Logged in from keytab as oryx/127.15.36.193@KRBTEST.COM (short username oryx)
I20260811 08:03:59.773237 23912 webserver.cc:460] Webserver started at http://127.15.36.193:44333/ using document root <none> and password file <none>
I20260811 08:03:59.773468 23912 fs_manager.cc:359] Metadata directory not provided
I20260811 08:03:59.773510 23912 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:03:59.773603 23912 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:03:59.774691 23912 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/ts-0/data/instance:
uuid: "405f04f35a9b4112b58e09f05a9ea44b"
format_stamp: "Formatted at 2026-08-11 08:03:59 on dist-test-slave-2w3w"
server_key: "01604c23c65963c60ddcf97bc8664638"
server_key_iv: "1a08365feea722e460014fbaa37ea67c"
server_key_version: "encryptionkey@0"
I20260811 08:03:59.775295 23912 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/ts-0/wal/instance:
uuid: "405f04f35a9b4112b58e09f05a9ea44b"
format_stamp: "Formatted at 2026-08-11 08:03:59 on dist-test-slave-2w3w"
server_key: "01604c23c65963c60ddcf97bc8664638"
server_key_iv: "1a08365feea722e460014fbaa37ea67c"
server_key_version: "encryptionkey@0"
I20260811 08:03:59.776926 23912 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 08:03:59.777763 23928 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:59.778007 23912 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:03:59.778108 23912 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/ts-0/wal
uuid: "405f04f35a9b4112b58e09f05a9ea44b"
format_stamp: "Formatted at 2026-08-11 08:03:59 on dist-test-slave-2w3w"
server_key: "01604c23c65963c60ddcf97bc8664638"
server_key_iv: "1a08365feea722e460014fbaa37ea67c"
server_key_version: "encryptionkey@0"
I20260811 08:03:59.778164 23912 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:03:59.791811 23912 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:03:59.794436 23912 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:03:59.794567 23912 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:03:59.795203 23912 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:03:59.795252 23912 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:59.795279 23912 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:03:59.795291 23912 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 08:03:59 dist-test-slave-2w3w krb5kdc[23777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435439, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.36.193@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM
I20260811 08:03:59.804338 23912 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.193:33463
I20260811 08:03:59.804744 24057 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.193:33463 every 8 connection(s)
I20260811 08:03:59.804800 23912 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
I20260811 08:03:59.808425 23890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:59.795880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:36693 (local address 127.15.36.254:39763)
0811 08:03:59.795960 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:59.795963 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:59.796163 (+ 200us) server_negotiation.cc:407] Connection header received
0811 08:03:59.796729 (+ 566us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:59.796730 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:59.796744 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:59.796828 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:59.797636 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:59.798824 (+ 1188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:59.800321 (+ 1497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:59.800671 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:59.800761 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:59.804791 (+ 4030us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:59.804793 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:59.804793 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:59.804805 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:59.806580 (+ 1775us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:59.807202 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:59.807203 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:59.807204 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:59.807268 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:59.807573 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:59.807573 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:59.807574 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:59.807731 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:59.807801 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:59.808219 (+ 418us) server_negotiation.cc:299] Negotiation successful
0811 08:03:59.808311 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 08:03:59.808463 23938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:59.795796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:39763 (local address 127.15.36.193:36693)
0811 08:03:59.796020 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:59.796065 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:59.796605 (+ 540us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:59.796924 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:59.796928 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:59.797282 (+ 354us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:03:59.797519 (+ 237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:59.797524 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:59.798998 (+ 1474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:59.798999 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:59.800210 (+ 1211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:59.800215 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:59.800827 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:59.800828 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:59.801193 (+ 365us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:59.802184 (+ 991us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:03:59.802196 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:03:59.804524 (+ 2328us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:03:59.806695 (+ 2171us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:59.806703 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:59.806705 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:59.807117 (+ 412us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:59.807376 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:59.807377 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:59.807377 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:59.807499 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:59.807823 (+ 324us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:03:59.807832 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:03:59.807992 (+ 160us) client_negotiation.cc:769] Sending connection context
0811 08:03:59.808113 (+ 121us) client_negotiation.cc:240] Negotiation successful
0811 08:03:59.808264 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":104,"threads_started":1}
I20260811 08:03:59.809194 24058 heartbeater.cc:347] Connected to a master server at 127.15.36.254:39763
I20260811 08:03:59.809298 24058 heartbeater.cc:464] Registering TS with master...
I20260811 08:03:59.809530 24058 heartbeater.cc:511] Master 127.15.36.254:39763 requested a full tablet report, sending...
I20260811 08:03:59.810273 23828 ts_manager.cc:194] Registered new tserver with Master: 405f04f35a9b4112b58e09f05a9ea44b (127.15.36.193:33463)
I20260811 08:03:59.811347 23828 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.15.36.193@KRBTEST.COM'} at 127.15.36.193:36693
I20260811 08:03:59.811371 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 23912
I20260811 08:03:59.811507 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/ts-0/wal/instance
I20260811 08:03:59.811730 15507 external_mini_cluster.cc:1428] Setting key 2b4a6609ec7349ec27f6d351e24c6c12
I20260811 08:03:59.817878 23890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:59.810586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:34243 (local address 127.15.36.254:39763)
0811 08:03:59.810650 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 08:03:59.810652 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:03:59.810875 (+ 223us) server_negotiation.cc:407] Connection header received
0811 08:03:59.810906 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:03:59.810906 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:03:59.810917 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:03:59.811051 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:03:59.811492 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:59.812186 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:59.813115 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:03:59.813325 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:03:59.813410 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:59.814629 (+ 1219us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:03:59.814630 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:03:59.814630 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:03:59.814637 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:03:59.816443 (+ 1806us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:59.816936 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:59.816937 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:59.816938 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:59.817015 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:03:59.817317 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:03:59.817318 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:03:59.817318 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:03:59.817460 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:03:59.817527 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 08:03:59.817720 (+ 193us) server_negotiation.cc:299] Negotiation successful
0811 08:03:59.817801 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 08:03:59.818063 24064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:03:59.810501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:39763 (local address 127.15.36.193:34243)
0811 08:03:59.810725 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0811 08:03:59.810738 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 08:03:59.810806 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:03:59.811062 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:03:59.811063 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:03:59.811314 (+ 251us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:03:59.811388 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:59.811391 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:59.812304 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:59.812305 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:59.813015 (+ 710us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:03:59.813018 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:03:59.813409 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:03:59.813409 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:03:59.813478 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:03:59.814028 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:03:59.814033 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:03:59.814516 (+ 483us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:03:59.816556 (+ 2040us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:59.816557 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:59.816558 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:59.816838 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:59.817121 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:03:59.817122 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:03:59.817123 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:03:59.817210 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:03:59.817544 (+ 334us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:03:59.817545 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:03:59.817613 (+ 68us) client_negotiation.cc:769] Sending connection context
0811 08:03:59.817704 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 08:03:59.817853 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":107,"threads_started":1}
WARNING: no policy specified for oryx/127.15.36.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.36.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.36.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/krb5kdc/oryx_127.15.36.194.keytab.
Entry for principal oryx/127.15.36.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/krb5kdc/oryx_127.15.36.194.keytab.
I20260811 08:03:59.851413 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.194:0
--local_ip_for_outbound_sockets=127.15.36.194
--webserver_interface=127.15.36.194
--webserver_port=0
--tserver_master_addrs=127.15.36.254:39763
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/krb5kdc/oryx_127.15.36.194.keytab
--principal=oryx/127.15.36.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:39973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:03:59.947201 24067 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:03:59.947458 24067 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:03:59.947489 24067 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:03:59.949084 24067 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:03:59.949175 24067 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:03:59.949201 24067 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 08:03:59.949221 24067 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.194
I20260811 08:03:59.951642 24067 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:39973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/krb5kdc/oryx_127.15.36.194.keytab
--principal=oryx/127.15.36.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.36.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.15.36.254:39763
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24067
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.194
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:03:59.951934 24067 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:03:59.952366 24067 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:03:59.958424 24073 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:59.958433 24075 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:03:59.958636 24072 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:03:59.959162 24067 server_base.cc:1034] running on GCE node
I20260811 08:03:59.959525 24067 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:03:59.959805 24067 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:03:59.961020 24067 hybrid_clock.cc:648] HybridClock initialized: now 1786435439960990 us; error 50 us; skew 500 ppm
Aug 11 08:03:59 dist-test-slave-2w3w krb5kdc[23777](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435439, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.36.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:03:59.964474 24067 init.cc:377] Logged in from keytab as oryx/127.15.36.194@KRBTEST.COM (short username oryx)
I20260811 08:03:59.965039 24067 webserver.cc:460] Webserver started at http://127.15.36.194:40869/ using document root <none> and password file <none>
I20260811 08:03:59.965291 24067 fs_manager.cc:359] Metadata directory not provided
I20260811 08:03:59.965341 24067 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:03:59.965479 24067 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:03:59.966671 24067 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/ts-1/data/instance:
uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926"
format_stamp: "Formatted at 2026-08-11 08:03:59 on dist-test-slave-2w3w"
server_key: "ac9746181c4d42a73e78102a990910fe"
server_key_iv: "8f990305ae844ad7ce34a5d7af66c333"
server_key_version: "encryptionkey@0"
I20260811 08:03:59.967633 24067 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/ts-1/wal/instance:
uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926"
format_stamp: "Formatted at 2026-08-11 08:03:59 on dist-test-slave-2w3w"
server_key: "ac9746181c4d42a73e78102a990910fe"
server_key_iv: "8f990305ae844ad7ce34a5d7af66c333"
server_key_version: "encryptionkey@0"
I20260811 08:03:59.969545 24067 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260811 08:03:59.971122 24084 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:03:59.971351 24067 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:03:59.971467 24067 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/ts-1/wal
uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926"
format_stamp: "Formatted at 2026-08-11 08:03:59 on dist-test-slave-2w3w"
server_key: "ac9746181c4d42a73e78102a990910fe"
server_key_iv: "8f990305ae844ad7ce34a5d7af66c333"
server_key_version: "encryptionkey@0"
I20260811 08:03:59.971535 24067 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:04:00.008481 24067 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:04:00.011689 24067 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:04:00.011829 24067 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:04:00.012445 24067 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:04:00.012498 24067 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:04:00.012696 24067 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:04:00.012763 24067 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 08:04:00 dist-test-slave-2w3w krb5kdc[23777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435439, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.36.194@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM
I20260811 08:04:00.024626 24067 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.194:39961
I20260811 08:04:00.024727 24217 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.194:39961 every 8 connection(s)
I20260811 08:04:00.025115 24067 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
I20260811 08:04:00.026659 23890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:00.013142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:39603 (local address 127.15.36.254:39763)
0811 08:04:00.013225 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:00.013228 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:00.013428 (+ 200us) server_negotiation.cc:407] Connection header received
0811 08:04:00.014296 (+ 868us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:00.014299 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:00.014325 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:00.014570 (+ 245us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:00.015396 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.016082 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.018310 (+ 2228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.018881 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.019043 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:00.022841 (+ 3798us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:04:00.022844 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:04:00.022844 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:04:00.022856 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:04:00.024843 (+ 1987us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:04:00.025455 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:04:00.025457 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:04:00.025458 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:04:00.025539 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:04:00.025858 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:04:00.025859 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:04:00.025859 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:04:00.026024 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:04:00.026090 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 08:04:00.026492 (+ 402us) server_negotiation.cc:299] Negotiation successful
0811 08:04:00.026586 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 08:04:00.026695 24093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:00.013117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:39763 (local address 127.15.36.194:39603)
0811 08:04:00.013271 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:00.013315 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:00.013836 (+ 521us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:00.014566 (+ 730us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:00.014570 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:00.014953 (+ 383us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:04:00.015280 (+ 327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:00.015287 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.016188 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.016190 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:00.017980 (+ 1790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:00.017985 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.019318 (+ 1333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.019320 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:00.019546 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:00.020376 (+ 830us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:04:00.020390 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:04:00.022700 (+ 2310us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:04:00.024958 (+ 2258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:04:00.024963 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:04:00.024965 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:04:00.025290 (+ 325us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:04:00.025636 (+ 346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:04:00.025637 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:04:00.025638 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:04:00.025772 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:04:00.026101 (+ 329us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:04:00.026108 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:04:00.026255 (+ 147us) client_negotiation.cc:769] Sending connection context
0811 08:04:00.026355 (+ 100us) client_negotiation.cc:240] Negotiation successful
0811 08:04:00.026518 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":82,"threads_started":1}
I20260811 08:04:00.027380 24218 heartbeater.cc:347] Connected to a master server at 127.15.36.254:39763
I20260811 08:04:00.027484 24218 heartbeater.cc:464] Registering TS with master...
I20260811 08:04:00.027700 24218 heartbeater.cc:511] Master 127.15.36.254:39763 requested a full tablet report, sending...
I20260811 08:04:00.028138 23830 ts_manager.cc:194] Registered new tserver with Master: cfbf3cc525204c3ea2f2fbe2ef6f6926 (127.15.36.194:39961)
I20260811 08:04:00.028730 23830 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.15.36.194@KRBTEST.COM'} at 127.15.36.194:39603
I20260811 08:04:00.029229 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 24067
I20260811 08:04:00.029433 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/ts-1/wal/instance
I20260811 08:04:00.029666 15507 external_mini_cluster.cc:1428] Setting key 86bd6c323667688d14523a00b3233ad4
I20260811 08:04:00.038477 23890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:00.028735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:57127 (local address 127.15.36.254:39763)
0811 08:04:00.028786 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:00.028788 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:00.029001 (+ 213us) server_negotiation.cc:407] Connection header received
0811 08:04:00.029120 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:00.029122 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:00.029134 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:00.029204 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:00.029675 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.030583 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.032121 (+ 1538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.032322 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.032396 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:00.034206 (+ 1810us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:04:00.034208 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:04:00.034208 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:04:00.034219 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:04:00.036615 (+ 2396us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:04:00.037332 (+ 717us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:04:00.037333 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:04:00.037333 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:04:00.037423 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:04:00.037785 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:04:00.037786 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:04:00.037786 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:04:00.038003 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:04:00.038075 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 08:04:00.038304 (+ 229us) server_negotiation.cc:299] Negotiation successful
0811 08:04:00.038382 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 08:04:00.038590 24225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:00.028615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:39763 (local address 127.15.36.194:57127)
0811 08:04:00.028913 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:00.028924 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:00.029044 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:00.029215 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:00.029216 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:00.029493 (+ 277us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:04:00.029576 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:00.029578 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.031091 (+ 1513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.031092 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:00.031976 (+ 884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:00.031981 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.032414 (+ 433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.032416 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:00.032501 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:00.033599 (+ 1098us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:04:00.033614 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:04:00.034083 (+ 469us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:04:00.036719 (+ 2636us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:04:00.036720 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:04:00.036721 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:04:00.037195 (+ 474us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:04:00.037575 (+ 380us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:04:00.037576 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:04:00.037577 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:04:00.037675 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:04:00.038109 (+ 434us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:04:00.038110 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:04:00.038178 (+ 68us) client_negotiation.cc:769] Sending connection context
0811 08:04:00.038277 (+ 99us) client_negotiation.cc:240] Negotiation successful
0811 08:04:00.038429 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":78,"threads_started":1}
WARNING: no policy specified for oryx/127.15.36.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.36.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.36.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/krb5kdc/oryx_127.15.36.195.keytab.
Entry for principal oryx/127.15.36.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/krb5kdc/oryx_127.15.36.195.keytab.
I20260811 08:04:00.067525 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.195:0
--local_ip_for_outbound_sockets=127.15.36.195
--webserver_interface=127.15.36.195
--webserver_port=0
--tserver_master_addrs=127.15.36.254:39763
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/krb5kdc/oryx_127.15.36.195.keytab
--principal=oryx/127.15.36.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:39973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:04:00.167670 24228 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:04:00.167945 24228 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:04:00.167979 24228 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:04:00.169276 24228 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:04:00.169330 24228 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:04:00.169354 24228 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 08:04:00.169373 24228 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.195
I20260811 08:04:00.171176 24228 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:39973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/krb5kdc/oryx_127.15.36.195.keytab
--principal=oryx/127.15.36.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.36.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.15.36.254:39763
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24228
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.195
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:04:00.171430 24228 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:04:00.171655 24228 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:04:00.179014 24236 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:04:00.179014 24233 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:04:00.179157 24234 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:04:00.179433 24228 server_base.cc:1034] running on GCE node
I20260811 08:04:00.179797 24228 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:04:00.180116 24228 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:04:00.181308 24228 hybrid_clock.cc:648] HybridClock initialized: now 1786435440181289 us; error 33 us; skew 500 ppm
Aug 11 08:04:00 dist-test-slave-2w3w krb5kdc[23777](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435440, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.36.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:04:00.184464 24228 init.cc:377] Logged in from keytab as oryx/127.15.36.195@KRBTEST.COM (short username oryx)
I20260811 08:04:00.184984 24228 webserver.cc:460] Webserver started at http://127.15.36.195:40079/ using document root <none> and password file <none>
I20260811 08:04:00.185279 24228 fs_manager.cc:359] Metadata directory not provided
I20260811 08:04:00.185348 24228 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:04:00.185480 24228 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:04:00.186911 24228 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/ts-2/data/instance:
uuid: "c16c1dbd34694d499b77890d7f0d79c9"
format_stamp: "Formatted at 2026-08-11 08:04:00 on dist-test-slave-2w3w"
server_key: "a3b4e4a481d06705078741cae19897ac"
server_key_iv: "93e50ed6bdd5fa04e5c4fb1c8dc0da55"
server_key_version: "encryptionkey@0"
I20260811 08:04:00.187402 24228 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/ts-2/wal/instance:
uuid: "c16c1dbd34694d499b77890d7f0d79c9"
format_stamp: "Formatted at 2026-08-11 08:04:00 on dist-test-slave-2w3w"
server_key: "a3b4e4a481d06705078741cae19897ac"
server_key_iv: "93e50ed6bdd5fa04e5c4fb1c8dc0da55"
server_key_version: "encryptionkey@0"
I20260811 08:04:00.189049 24228 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 08:04:00.190124 24244 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:04:00.190505 24228 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:04:00.190642 24228 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/ts-2/wal
uuid: "c16c1dbd34694d499b77890d7f0d79c9"
format_stamp: "Formatted at 2026-08-11 08:04:00 on dist-test-slave-2w3w"
server_key: "a3b4e4a481d06705078741cae19897ac"
server_key_iv: "93e50ed6bdd5fa04e5c4fb1c8dc0da55"
server_key_version: "encryptionkey@0"
I20260811 08:04:00.190750 24228 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:04:00.201710 24228 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:04:00.205109 24228 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:04:00.205324 24228 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:04:00.206043 24228 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:04:00.206120 24228 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:04:00.206167 24228 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:04:00.206192 24228 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:04:00.214761 24228 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.195:42727
I20260811 08:04:00.214893 24371 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.195:42727 every 8 connection(s)
I20260811 08:04:00.215305 24228 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
Aug 11 08:04:00 dist-test-slave-2w3w krb5kdc[23777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435440, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.36.195@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM
I20260811 08:04:00.221742 23890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:00.207590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:53171 (local address 127.15.36.254:39763)
0811 08:04:00.207655 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:00.207657 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:00.207922 (+ 265us) server_negotiation.cc:407] Connection header received
0811 08:04:00.208740 (+ 818us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:00.208741 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:00.208759 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:00.208846 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:00.209647 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.210400 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.212573 (+ 2173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.212834 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.212915 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:00.216684 (+ 3769us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:04:00.216686 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:04:00.216686 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:04:00.216696 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:04:00.219122 (+ 2426us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:04:00.220125 (+ 1003us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:04:00.220128 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:04:00.220128 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:04:00.220276 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:04:00.220756 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:04:00.220817 (+ 61us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:04:00.220818 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:04:00.221126 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:04:00.221213 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 08:04:00.221575 (+ 362us) server_negotiation.cc:299] Negotiation successful
0811 08:04:00.221669 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 08:04:00.221925 24253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:00.207515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:39763 (local address 127.15.36.195:53171)
0811 08:04:00.207778 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:00.207817 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:00.208590 (+ 773us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:00.208985 (+ 395us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:00.208990 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:00.209309 (+ 319us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:04:00.209531 (+ 222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:00.209536 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.210530 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.210532 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:00.212431 (+ 1899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:00.212438 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.212960 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.212961 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:00.213149 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:00.213974 (+ 825us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:04:00.213987 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:04:00.216185 (+ 2198us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:04:00.219259 (+ 3074us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:04:00.219270 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:04:00.219272 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:04:00.219940 (+ 668us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:04:00.220452 (+ 512us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:04:00.220453 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:04:00.220453 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:04:00.220586 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:04:00.221239 (+ 653us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:04:00.221248 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:04:00.221404 (+ 156us) client_negotiation.cc:769] Sending connection context
0811 08:04:00.221519 (+ 115us) client_negotiation.cc:240] Negotiation successful
0811 08:04:00.221679 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":99,"threads_started":1}
I20260811 08:04:00.222607 24372 heartbeater.cc:347] Connected to a master server at 127.15.36.254:39763
I20260811 08:04:00.222715 24372 heartbeater.cc:464] Registering TS with master...
I20260811 08:04:00.222926 24372 heartbeater.cc:511] Master 127.15.36.254:39763 requested a full tablet report, sending...
I20260811 08:04:00.223489 23828 ts_manager.cc:194] Registered new tserver with Master: c16c1dbd34694d499b77890d7f0d79c9 (127.15.36.195:42727)
I20260811 08:04:00.223948 23828 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.15.36.195@KRBTEST.COM'} at 127.15.36.195:53171
I20260811 08:04:00.224938 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 24228
I20260811 08:04:00.225042 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/ts-2/wal/instance
I20260811 08:04:00.225251 15507 external_mini_cluster.cc:1428] Setting key 899ece8eabfa4d2f2dad6be0cbb2bd86
I20260811 08:04:00.226230 15507 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 08:04:00.232848 24378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:00.224046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:39763 (local address 127.15.36.195:45927)
0811 08:04:00.224216 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:00.224228 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:00.224297 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:00.224455 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:00.224456 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:00.224704 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:04:00.224777 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:00.224779 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.225756 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.225757 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:00.226437 (+ 680us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:00.226440 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.227068 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.227069 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:00.227146 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:00.227743 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:04:00.227749 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:04:00.228261 (+ 512us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:04:00.231010 (+ 2749us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:04:00.231011 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:04:00.231012 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:04:00.231441 (+ 429us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:04:00.231782 (+ 341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:04:00.231783 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:04:00.231783 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:04:00.231873 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:04:00.232427 (+ 554us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:04:00.232428 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:04:00.232507 (+ 79us) client_negotiation.cc:769] Sending connection context
0811 08:04:00.232597 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 08:04:00.232743 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":113,"threads_started":1}
I20260811 08:04:00.233075 23890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:00.224087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:45927 (local address 127.15.36.254:39763)
0811 08:04:00.224131 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:00.224133 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:00.224308 (+ 175us) server_negotiation.cc:407] Connection header received
0811 08:04:00.224380 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:00.224385 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:00.224396 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:00.224447 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:00.224900 (+ 453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.225656 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.226517 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.226819 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.226901 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:00.228681 (+ 1780us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:04:00.228684 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:04:00.228685 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:04:00.228700 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:04:00.230847 (+ 2147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:04:00.231548 (+ 701us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:04:00.231550 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:04:00.231550 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:04:00.231681 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:04:00.231952 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:04:00.231953 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:04:00.231954 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:04:00.232286 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:04:00.232414 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0811 08:04:00.232759 (+ 345us) server_negotiation.cc:299] Negotiation successful
0811 08:04:00.232937 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
Aug 11 08:04:00 dist-test-slave-2w3w krb5kdc[23777](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435440, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 08:04:00 dist-test-slave-2w3w krb5kdc[23777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:04:00 dist-test-slave-2w3w krb5kdc[23777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
W20260811 08:04:00.255510 23890 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:04:00.247747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59776 (local address 127.15.36.254:39763)
0811 08:04:00.247890 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:00.247893 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:00.248031 (+ 138us) server_negotiation.cc:407] Connection header received
0811 08:04:00.248154 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:00.248155 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:00.248179 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:00.248254 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:00.248993 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.249588 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.250442 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.250667 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.250763 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:00.255405 (+ 4642us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59776: BlockingRecv error: recv got EOF from 127.0.0.1:59776 (error 108)
Metrics: {"server-negotiator.queue_time_us":97}
Aug 11 08:04:00 dist-test-slave-2w3w krb5kdc[23777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435440, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM
I20260811 08:04:00.266472 23890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:00.256925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59792 (local address 127.15.36.254:39763)
0811 08:04:00.257118 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:00.257120 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:00.257243 (+ 123us) server_negotiation.cc:407] Connection header received
0811 08:04:00.257285 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:00.257286 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:00.257300 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:00.257382 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:00.257987 (+ 605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.258495 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.259517 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.259803 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.259912 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:00.263149 (+ 3237us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:04:00.263152 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:04:00.263152 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:04:00.263163 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:04:00.264829 (+ 1666us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:04:00.265280 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:04:00.265281 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:04:00.265281 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:04:00.265340 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:04:00.265629 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:04:00.265630 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:04:00.265631 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:04:00.265775 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:04:00.265925 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0811 08:04:00.266186 (+ 261us) server_negotiation.cc:299] Negotiation successful
0811 08:04:00.266356 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 08:04:00.269021 23828 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59792:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:04:00.271921 23828 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:04:00.280751 24396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:00.275478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.193:33463 (local address 127.0.0.1:46792)
0811 08:04:00.275952 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:00.275961 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:00.276000 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:00.276410 (+ 410us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:00.276411 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:00.276412 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:04:00.276623 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:00.276626 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.278045 (+ 1419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.278047 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:00.279524 (+ 1477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:00.279528 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.280486 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.280487 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:00.280559 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:00.280563 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:04:00.280618 (+ 55us) client_negotiation.cc:240] Negotiation successful
0811 08:04:00.280654 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":459,"mutex_wait_us":167,"thread_start_us":106,"threads_started":1}
I20260811 08:04:00.280798 24397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:00.275511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34306 (local address 127.15.36.195:42727)
0811 08:04:00.276256 (+ 745us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:00.276260 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:00.276271 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:04:00.276314 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:00.276317 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:00.276334 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:00.276423 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:04:00.276639 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.277897 (+ 1258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.279497 (+ 1600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.280172 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.280283 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:00.280378 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 08:04:00.280625 (+ 247us) server_negotiation.cc:299] Negotiation successful
0811 08:04:00.280683 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":706,"thread_start_us":94,"threads_started":1}
I20260811 08:04:00.281140 24398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:00.275754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46792 (local address 127.15.36.193:33463)
0811 08:04:00.276194 (+ 440us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:00.276199 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:00.276251 (+ 52us) server_negotiation.cc:407] Connection header received
0811 08:04:00.276294 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:00.276297 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:00.276311 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:00.276526 (+ 215us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:04:00.276698 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.277902 (+ 1204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.279626 (+ 1724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.280401 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.280475 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:00.280555 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 08:04:00.280992 (+ 437us) server_negotiation.cc:299] Negotiation successful
0811 08:04:00.281042 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":384,"thread_start_us":84,"threads_started":1}
I20260811 08:04:00.280751 24394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:00.275397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.195:42727 (local address 127.0.0.1:34306)
0811 08:04:00.275605 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:00.275652 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:00.275838 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:00.276497 (+ 659us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:00.276498 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:00.276501 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:04:00.276554 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:00.276556 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.278035 (+ 1479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.278036 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:00.279390 (+ 1354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:00.279392 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.280283 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.280284 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:00.280437 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:00.280464 (+ 27us) client_negotiation.cc:769] Sending connection context
0811 08:04:00.280551 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 08:04:00.280629 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"mutex_wait_us":1,"thread_start_us":86,"threads_started":1}
I20260811 08:04:00.282124 23982 tablet_service.cc:1467] Processing CreateTablet for tablet 29989ce39a0f43a28aba36b3e98a8354 (DEFAULT_TABLE table=test-table [id=1f13c1c903bc4dd1a466e073594fc1b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:04:00.282159 24299 tablet_service.cc:1467] Processing CreateTablet for tablet 29989ce39a0f43a28aba36b3e98a8354 (DEFAULT_TABLE table=test-table [id=1f13c1c903bc4dd1a466e073594fc1b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:04:00.282321 24395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:00.275474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.194:39961 (local address 127.0.0.1:54268)
0811 08:04:00.275758 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:00.275769 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:00.275838 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:00.276381 (+ 543us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:00.276385 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:00.276387 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:04:00.276545 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:00.276548 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.279086 (+ 2538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.279087 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:00.280175 (+ 1088us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:00.280178 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.281970 (+ 1792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.281972 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:00.282064 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:00.282070 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 08:04:00.282143 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 08:04:00.282195 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"mutex_wait_us":10,"thread_start_us":92,"threads_started":1}
I20260811 08:04:00.282361 24400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:00.275768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54268 (local address 127.15.36.194:39961)
0811 08:04:00.275949 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:00.275954 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:00.275968 (+ 14us) server_negotiation.cc:407] Connection header received
0811 08:04:00.276212 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:00.276215 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:00.276240 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:00.276636 (+ 396us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:04:00.276702 (+ 66us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.278832 (+ 2130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.280287 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.281841 (+ 1554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.281937 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:00.282029 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 08:04:00.282171 (+ 142us) server_negotiation.cc:299] Negotiation successful
0811 08:04:00.282215 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":113,"threads_started":1}
I20260811 08:04:00.282598 24299 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29989ce39a0f43a28aba36b3e98a8354. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:04:00.282624 23982 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29989ce39a0f43a28aba36b3e98a8354. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:04:00.283041 24141 tablet_service.cc:1467] Processing CreateTablet for tablet 29989ce39a0f43a28aba36b3e98a8354 (DEFAULT_TABLE table=test-table [id=1f13c1c903bc4dd1a466e073594fc1b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:04:00.283390 24141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29989ce39a0f43a28aba36b3e98a8354. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:04:00.286479 24401 tablet_bootstrap.cc:492] T 29989ce39a0f43a28aba36b3e98a8354 P c16c1dbd34694d499b77890d7f0d79c9: Bootstrap starting.
I20260811 08:04:00.287298 24401 tablet_bootstrap.cc:654] T 29989ce39a0f43a28aba36b3e98a8354 P c16c1dbd34694d499b77890d7f0d79c9: Neither blocks nor log segments found. Creating new log.
I20260811 08:04:00.287631 24404 tablet_bootstrap.cc:492] T 29989ce39a0f43a28aba36b3e98a8354 P cfbf3cc525204c3ea2f2fbe2ef6f6926: Bootstrap starting.
I20260811 08:04:00.287712 24401 log.cc:824] T 29989ce39a0f43a28aba36b3e98a8354 P c16c1dbd34694d499b77890d7f0d79c9: Log is configured to *not* fsync() on all Append() calls
I20260811 08:04:00.288358 24404 tablet_bootstrap.cc:654] T 29989ce39a0f43a28aba36b3e98a8354 P cfbf3cc525204c3ea2f2fbe2ef6f6926: Neither blocks nor log segments found. Creating new log.
I20260811 08:04:00.288661 24404 log.cc:824] T 29989ce39a0f43a28aba36b3e98a8354 P cfbf3cc525204c3ea2f2fbe2ef6f6926: Log is configured to *not* fsync() on all Append() calls
I20260811 08:04:00.288776 24401 tablet_bootstrap.cc:492] T 29989ce39a0f43a28aba36b3e98a8354 P c16c1dbd34694d499b77890d7f0d79c9: No bootstrap required, opened a new log
I20260811 08:04:00.288887 24401 ts_tablet_manager.cc:1397] T 29989ce39a0f43a28aba36b3e98a8354 P c16c1dbd34694d499b77890d7f0d79c9: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 08:04:00.289039 24402 tablet_bootstrap.cc:492] T 29989ce39a0f43a28aba36b3e98a8354 P 405f04f35a9b4112b58e09f05a9ea44b: Bootstrap starting.
I20260811 08:04:00.289544 24404 tablet_bootstrap.cc:492] T 29989ce39a0f43a28aba36b3e98a8354 P cfbf3cc525204c3ea2f2fbe2ef6f6926: No bootstrap required, opened a new log
I20260811 08:04:00.289626 24404 ts_tablet_manager.cc:1397] T 29989ce39a0f43a28aba36b3e98a8354 P cfbf3cc525204c3ea2f2fbe2ef6f6926: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 08:04:00.289947 24402 tablet_bootstrap.cc:654] T 29989ce39a0f43a28aba36b3e98a8354 P 405f04f35a9b4112b58e09f05a9ea44b: Neither blocks nor log segments found. Creating new log.
I20260811 08:04:00.290246 24402 log.cc:824] T 29989ce39a0f43a28aba36b3e98a8354 P 405f04f35a9b4112b58e09f05a9ea44b: Log is configured to *not* fsync() on all Append() calls
I20260811 08:04:00.291056 24402 tablet_bootstrap.cc:492] T 29989ce39a0f43a28aba36b3e98a8354 P 405f04f35a9b4112b58e09f05a9ea44b: No bootstrap required, opened a new log
I20260811 08:04:00.291144 24402 ts_tablet_manager.cc:1397] T 29989ce39a0f43a28aba36b3e98a8354 P 405f04f35a9b4112b58e09f05a9ea44b: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 08:04:00.291312 24401 raft_consensus.cc:348] T 29989ce39a0f43a28aba36b3e98a8354 P c16c1dbd34694d499b77890d7f0d79c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c16c1dbd34694d499b77890d7f0d79c9" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42727 } } peers { permanent_uuid: "405f04f35a9b4112b58e09f05a9ea44b" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 33463 } } peers { permanent_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39961 } }
I20260811 08:04:00.291527 24401 raft_consensus.cc:374] T 29989ce39a0f43a28aba36b3e98a8354 P c16c1dbd34694d499b77890d7f0d79c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:04:00.291565 24401 raft_consensus.cc:729] T 29989ce39a0f43a28aba36b3e98a8354 P c16c1dbd34694d499b77890d7f0d79c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c16c1dbd34694d499b77890d7f0d79c9, State: Initialized, Role: FOLLOWER
I20260811 08:04:00.291731 24401 consensus_queue.cc:260] T 29989ce39a0f43a28aba36b3e98a8354 P c16c1dbd34694d499b77890d7f0d79c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c16c1dbd34694d499b77890d7f0d79c9" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42727 } } peers { permanent_uuid: "405f04f35a9b4112b58e09f05a9ea44b" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 33463 } } peers { permanent_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39961 } }
I20260811 08:04:00.291734 24404 raft_consensus.cc:348] T 29989ce39a0f43a28aba36b3e98a8354 P cfbf3cc525204c3ea2f2fbe2ef6f6926 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c16c1dbd34694d499b77890d7f0d79c9" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42727 } } peers { permanent_uuid: "405f04f35a9b4112b58e09f05a9ea44b" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 33463 } } peers { permanent_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39961 } }
I20260811 08:04:00.291895 24404 raft_consensus.cc:374] T 29989ce39a0f43a28aba36b3e98a8354 P cfbf3cc525204c3ea2f2fbe2ef6f6926 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:04:00.291950 24404 raft_consensus.cc:729] T 29989ce39a0f43a28aba36b3e98a8354 P cfbf3cc525204c3ea2f2fbe2ef6f6926 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfbf3cc525204c3ea2f2fbe2ef6f6926, State: Initialized, Role: FOLLOWER
I20260811 08:04:00.292050 24401 ts_tablet_manager.cc:1428] T 29989ce39a0f43a28aba36b3e98a8354 P c16c1dbd34694d499b77890d7f0d79c9: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260811 08:04:00.292066 24404 consensus_queue.cc:260] T 29989ce39a0f43a28aba36b3e98a8354 P cfbf3cc525204c3ea2f2fbe2ef6f6926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c16c1dbd34694d499b77890d7f0d79c9" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42727 } } peers { permanent_uuid: "405f04f35a9b4112b58e09f05a9ea44b" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 33463 } } peers { permanent_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39961 } }
I20260811 08:04:00.292555 24404 ts_tablet_manager.cc:1428] T 29989ce39a0f43a28aba36b3e98a8354 P cfbf3cc525204c3ea2f2fbe2ef6f6926: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 08:04:00.292949 24372 heartbeater.cc:503] Master 127.15.36.254:39763 was elected leader, sending a full tablet report...
I20260811 08:04:00.293781 24218 heartbeater.cc:503] Master 127.15.36.254:39763 was elected leader, sending a full tablet report...
I20260811 08:04:00.297381 24402 raft_consensus.cc:348] T 29989ce39a0f43a28aba36b3e98a8354 P 405f04f35a9b4112b58e09f05a9ea44b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c16c1dbd34694d499b77890d7f0d79c9" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42727 } } peers { permanent_uuid: "405f04f35a9b4112b58e09f05a9ea44b" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 33463 } } peers { permanent_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39961 } }
I20260811 08:04:00.297590 24402 raft_consensus.cc:374] T 29989ce39a0f43a28aba36b3e98a8354 P 405f04f35a9b4112b58e09f05a9ea44b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:04:00.297614 24402 raft_consensus.cc:729] T 29989ce39a0f43a28aba36b3e98a8354 P 405f04f35a9b4112b58e09f05a9ea44b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 405f04f35a9b4112b58e09f05a9ea44b, State: Initialized, Role: FOLLOWER
I20260811 08:04:00.297780 24402 consensus_queue.cc:260] T 29989ce39a0f43a28aba36b3e98a8354 P 405f04f35a9b4112b58e09f05a9ea44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c16c1dbd34694d499b77890d7f0d79c9" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42727 } } peers { permanent_uuid: "405f04f35a9b4112b58e09f05a9ea44b" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 33463 } } peers { permanent_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39961 } }
I20260811 08:04:00.298209 24402 ts_tablet_manager.cc:1428] T 29989ce39a0f43a28aba36b3e98a8354 P 405f04f35a9b4112b58e09f05a9ea44b: Time spent starting tablet: real 0.007s user 0.001s sys 0.003s
I20260811 08:04:00.298321 24058 heartbeater.cc:503] Master 127.15.36.254:39763 was elected leader, sending a full tablet report...
W20260811 08:04:00.305896 24059 tablet.cc:2369] T 29989ce39a0f43a28aba36b3e98a8354 P 405f04f35a9b4112b58e09f05a9ea44b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:04:00.429798 24409 raft_consensus.cc:482] T 29989ce39a0f43a28aba36b3e98a8354 P c16c1dbd34694d499b77890d7f0d79c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:04:00.429971 24409 raft_consensus.cc:504] T 29989ce39a0f43a28aba36b3e98a8354 P c16c1dbd34694d499b77890d7f0d79c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c16c1dbd34694d499b77890d7f0d79c9" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42727 } } peers { permanent_uuid: "405f04f35a9b4112b58e09f05a9ea44b" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 33463 } } peers { permanent_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39961 } }
I20260811 08:04:00.430480 24409 leader_election.cc:288] T 29989ce39a0f43a28aba36b3e98a8354 P c16c1dbd34694d499b77890d7f0d79c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 405f04f35a9b4112b58e09f05a9ea44b (127.15.36.193:33463), cfbf3cc525204c3ea2f2fbe2ef6f6926 (127.15.36.194:39961)
I20260811 08:04:00.436259 24400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:00.430990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:43017 (local address 127.15.36.194:39961)
0811 08:04:00.431087 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:00.431089 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:00.431546 (+ 457us) server_negotiation.cc:407] Connection header received
0811 08:04:00.431586 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:00.431587 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:00.431599 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:00.431670 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:04:00.431938 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.433075 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.434805 (+ 1730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.435574 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.435727 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:00.435742 (+ 15us) server_negotiation.cc:1035] Waiting for connection context
0811 08:04:00.436090 (+ 348us) server_negotiation.cc:299] Negotiation successful
0811 08:04:00.436176 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260811 08:04:00.436177 24253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:00.430693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.194:39961 (local address 127.15.36.195:43017)
0811 08:04:00.431326 (+ 633us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:00.431340 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:00.431422 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:00.431685 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:00.431686 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:00.431688 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:04:00.431801 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:00.431804 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.433169 (+ 1365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.433170 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:00.434577 (+ 1407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:00.434580 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.435762 (+ 1182us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.435763 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:00.435905 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:00.435907 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 08:04:00.435996 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 08:04:00.436058 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":610,"mutex_wait_us":70,"thread_start_us":105,"threads_started":1}
I20260811 08:04:00.436190 24412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:00.430683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.193:33463 (local address 127.15.36.195:60113)
0811 08:04:00.430878 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:00.430892 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:00.430988 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:00.431745 (+ 757us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:00.431746 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:00.431747 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:04:00.431812 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:00.431813 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.433166 (+ 1353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.433168 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:00.434573 (+ 1405us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:00.434580 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.435793 (+ 1213us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.435794 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:00.435901 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:00.435906 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 08:04:00.435996 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 08:04:00.436055 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"mutex_wait_us":37}
I20260811 08:04:00.436316 24398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:00.431548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:60113 (local address 127.15.36.193:33463)
0811 08:04:00.431617 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:00.431619 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:00.431627 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:04:00.431655 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:00.431656 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:00.431666 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:00.431730 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:04:00.431951 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.433005 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.434805 (+ 1800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.435575 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.435727 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:00.435742 (+ 15us) server_negotiation.cc:1035] Waiting for connection context
0811 08:04:00.436090 (+ 348us) server_negotiation.cc:299] Negotiation successful
0811 08:04:00.436180 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 08:04:00.436730 24166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29989ce39a0f43a28aba36b3e98a8354" candidate_uuid: "c16c1dbd34694d499b77890d7f0d79c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" is_pre_election: true
I20260811 08:04:00.436787 24007 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29989ce39a0f43a28aba36b3e98a8354" candidate_uuid: "c16c1dbd34694d499b77890d7f0d79c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "405f04f35a9b4112b58e09f05a9ea44b" is_pre_election: true
I20260811 08:04:00.436937 24166 raft_consensus.cc:2454] T 29989ce39a0f43a28aba36b3e98a8354 P cfbf3cc525204c3ea2f2fbe2ef6f6926 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c16c1dbd34694d499b77890d7f0d79c9 in term 0.
I20260811 08:04:00.436956 24007 raft_consensus.cc:2454] T 29989ce39a0f43a28aba36b3e98a8354 P 405f04f35a9b4112b58e09f05a9ea44b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c16c1dbd34694d499b77890d7f0d79c9 in term 0.
I20260811 08:04:00.437247 24248 leader_election.cc:302] T 29989ce39a0f43a28aba36b3e98a8354 P c16c1dbd34694d499b77890d7f0d79c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c16c1dbd34694d499b77890d7f0d79c9, cfbf3cc525204c3ea2f2fbe2ef6f6926; no voters:
I20260811 08:04:00.437400 24409 raft_consensus.cc:2781] T 29989ce39a0f43a28aba36b3e98a8354 P c16c1dbd34694d499b77890d7f0d79c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:04:00.437455 24409 raft_consensus.cc:482] T 29989ce39a0f43a28aba36b3e98a8354 P c16c1dbd34694d499b77890d7f0d79c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:04:00.437481 24409 raft_consensus.cc:3037] T 29989ce39a0f43a28aba36b3e98a8354 P c16c1dbd34694d499b77890d7f0d79c9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:04:00.438637 24409 raft_consensus.cc:504] T 29989ce39a0f43a28aba36b3e98a8354 P c16c1dbd34694d499b77890d7f0d79c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c16c1dbd34694d499b77890d7f0d79c9" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42727 } } peers { permanent_uuid: "405f04f35a9b4112b58e09f05a9ea44b" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 33463 } } peers { permanent_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39961 } }
I20260811 08:04:00.438838 24409 leader_election.cc:288] T 29989ce39a0f43a28aba36b3e98a8354 P c16c1dbd34694d499b77890d7f0d79c9 [CANDIDATE]: Term 1 election: Requested vote from peers 405f04f35a9b4112b58e09f05a9ea44b (127.15.36.193:33463), cfbf3cc525204c3ea2f2fbe2ef6f6926 (127.15.36.194:39961)
I20260811 08:04:00.439046 24166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29989ce39a0f43a28aba36b3e98a8354" candidate_uuid: "c16c1dbd34694d499b77890d7f0d79c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926"
I20260811 08:04:00.439149 24166 raft_consensus.cc:3037] T 29989ce39a0f43a28aba36b3e98a8354 P cfbf3cc525204c3ea2f2fbe2ef6f6926 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:04:00.439640 24007 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29989ce39a0f43a28aba36b3e98a8354" candidate_uuid: "c16c1dbd34694d499b77890d7f0d79c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "405f04f35a9b4112b58e09f05a9ea44b"
I20260811 08:04:00.440600 24166 raft_consensus.cc:2454] T 29989ce39a0f43a28aba36b3e98a8354 P cfbf3cc525204c3ea2f2fbe2ef6f6926 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c16c1dbd34694d499b77890d7f0d79c9 in term 1.
I20260811 08:04:00.440402 24007 raft_consensus.cc:3037] T 29989ce39a0f43a28aba36b3e98a8354 P 405f04f35a9b4112b58e09f05a9ea44b [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:04:00.440804 24248 leader_election.cc:302] T 29989ce39a0f43a28aba36b3e98a8354 P c16c1dbd34694d499b77890d7f0d79c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c16c1dbd34694d499b77890d7f0d79c9, cfbf3cc525204c3ea2f2fbe2ef6f6926; no voters:
I20260811 08:04:00.440904 24409 raft_consensus.cc:2781] T 29989ce39a0f43a28aba36b3e98a8354 P c16c1dbd34694d499b77890d7f0d79c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:04:00.441123 24409 raft_consensus.cc:686] T 29989ce39a0f43a28aba36b3e98a8354 P c16c1dbd34694d499b77890d7f0d79c9 [term 1 LEADER]: Becoming Leader. State: Replica: c16c1dbd34694d499b77890d7f0d79c9, State: Running, Role: LEADER
I20260811 08:04:00.441267 24409 consensus_queue.cc:237] T 29989ce39a0f43a28aba36b3e98a8354 P c16c1dbd34694d499b77890d7f0d79c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c16c1dbd34694d499b77890d7f0d79c9" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42727 } } peers { permanent_uuid: "405f04f35a9b4112b58e09f05a9ea44b" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 33463 } } peers { permanent_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39961 } }
I20260811 08:04:00.442255 23828 catalog_manager.cc:5495] T 29989ce39a0f43a28aba36b3e98a8354 P c16c1dbd34694d499b77890d7f0d79c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to c16c1dbd34694d499b77890d7f0d79c9 (127.15.36.195). New cstate: current_term: 1 leader_uuid: "c16c1dbd34694d499b77890d7f0d79c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c16c1dbd34694d499b77890d7f0d79c9" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42727 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "405f04f35a9b4112b58e09f05a9ea44b" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 33463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39961 } health_report { overall_health: UNKNOWN } } }
I20260811 08:04:00.443025 24007 raft_consensus.cc:2454] T 29989ce39a0f43a28aba36b3e98a8354 P 405f04f35a9b4112b58e09f05a9ea44b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c16c1dbd34694d499b77890d7f0d79c9 in term 1.
W20260811 08:04:00.466073 24373 tablet.cc:2369] T 29989ce39a0f43a28aba36b3e98a8354 P c16c1dbd34694d499b77890d7f0d79c9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:04:00.466949 24397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:00.464170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34308 (local address 127.15.36.195:42727)
0811 08:04:00.464300 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:00.464302 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:00.464313 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:04:00.464355 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:00.464357 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:00.464383 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:00.464503 (+ 120us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:04:00.464677 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.465167 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.466008 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.466260 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.466328 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:00.466540 (+ 212us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:04:00.466642 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:04:00.466718 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 08:04:00.466776 (+ 58us) server_negotiation.cc:299] Negotiation successful
0811 08:04:00.466846 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260811 08:04:00.469003 24166 raft_consensus.cc:1261] T 29989ce39a0f43a28aba36b3e98a8354 P cfbf3cc525204c3ea2f2fbe2ef6f6926 [term 1 FOLLOWER]: Refusing update from remote peer c16c1dbd34694d499b77890d7f0d79c9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:04:00.469003 24007 raft_consensus.cc:1261] T 29989ce39a0f43a28aba36b3e98a8354 P 405f04f35a9b4112b58e09f05a9ea44b [term 1 FOLLOWER]: Refusing update from remote peer c16c1dbd34694d499b77890d7f0d79c9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:04:00.469390 24413 consensus_queue.cc:1035] T 29989ce39a0f43a28aba36b3e98a8354 P c16c1dbd34694d499b77890d7f0d79c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "405f04f35a9b4112b58e09f05a9ea44b" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 33463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:04:00.469516 24409 consensus_queue.cc:1035] T 29989ce39a0f43a28aba36b3e98a8354 P c16c1dbd34694d499b77890d7f0d79c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:04:00.472973 24418 mvcc.cc:205] Tried to move back new op lower bound from 7317239564157616128 to 7317239564048236544. Current Snapshot: MvccSnapshot[applied={T|T < 7317239564157616128}]
I20260811 08:04:00.473639 24417 mvcc.cc:205] Tried to move back new op lower bound from 7317239564157616128 to 7317239564048236544. Current Snapshot: MvccSnapshot[applied={T|T < 7317239564157616128}]
I20260811 08:04:00.476128 23828 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59792:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:04:00.476300 23828 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59792:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:04:00.477209 23828 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7e3bec8f0c164e9aae3ea98efe747f43: Sending DeleteTablet for 3 replicas of tablet 29989ce39a0f43a28aba36b3e98a8354
I20260811 08:04:00.477728 23982 tablet_service.cc:1514] Processing DeleteTablet for tablet 29989ce39a0f43a28aba36b3e98a8354 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:04:00 UTC) from {username='oryx', principal='oryx/127.15.36.254@KRBTEST.COM'} at 127.0.0.1:46792
I20260811 08:04:00.477671 24299 tablet_service.cc:1514] Processing DeleteTablet for tablet 29989ce39a0f43a28aba36b3e98a8354 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:04:00 UTC) from {username='oryx', principal='oryx/127.15.36.254@KRBTEST.COM'} at 127.0.0.1:34306
I20260811 08:04:00.478005 24429 tablet_replica.cc:330] T 29989ce39a0f43a28aba36b3e98a8354 P c16c1dbd34694d499b77890d7f0d79c9: stopping tablet replica
I20260811 08:04:00.477999 24141 tablet_service.cc:1514] Processing DeleteTablet for tablet 29989ce39a0f43a28aba36b3e98a8354 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:04:00 UTC) from {username='oryx', principal='oryx/127.15.36.254@KRBTEST.COM'} at 127.0.0.1:54268
I20260811 08:04:00.478111 24429 raft_consensus.cc:2229] T 29989ce39a0f43a28aba36b3e98a8354 P c16c1dbd34694d499b77890d7f0d79c9 [term 1 LEADER]: Raft consensus shutting down.
I20260811 08:04:00.478263 24429 raft_consensus.cc:2258] T 29989ce39a0f43a28aba36b3e98a8354 P c16c1dbd34694d499b77890d7f0d79c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:04:00.478576 24430 tablet_replica.cc:330] T 29989ce39a0f43a28aba36b3e98a8354 P cfbf3cc525204c3ea2f2fbe2ef6f6926: stopping tablet replica
I20260811 08:04:00.478580 23828 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59792:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 08:04:00.478689 24430 raft_consensus.cc:2229] T 29989ce39a0f43a28aba36b3e98a8354 P cfbf3cc525204c3ea2f2fbe2ef6f6926 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260811 08:04:00.478752 23828 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:04:00.478787 24430 raft_consensus.cc:2258] T 29989ce39a0f43a28aba36b3e98a8354 P cfbf3cc525204c3ea2f2fbe2ef6f6926 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:04:00.478989 24428 tablet_replica.cc:330] T 29989ce39a0f43a28aba36b3e98a8354 P 405f04f35a9b4112b58e09f05a9ea44b: stopping tablet replica
I20260811 08:04:00.479107 24428 raft_consensus.cc:2229] T 29989ce39a0f43a28aba36b3e98a8354 P 405f04f35a9b4112b58e09f05a9ea44b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:04:00.479288 24428 raft_consensus.cc:2258] T 29989ce39a0f43a28aba36b3e98a8354 P 405f04f35a9b4112b58e09f05a9ea44b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:04:00.479851 24430 ts_tablet_manager.cc:1905] T 29989ce39a0f43a28aba36b3e98a8354 P cfbf3cc525204c3ea2f2fbe2ef6f6926: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:04:00.480284 23982 tablet_service.cc:1467] Processing CreateTablet for tablet f9e6d9fb379b4ed59584d3edd83101e4 (DEFAULT_TABLE table=test-table [id=d273f624f87f4294b478e382c3b55946]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:04:00.480437 23982 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f9e6d9fb379b4ed59584d3edd83101e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:04:00.480688 24141 tablet_service.cc:1467] Processing CreateTablet for tablet f9e6d9fb379b4ed59584d3edd83101e4 (DEFAULT_TABLE table=test-table [id=d273f624f87f4294b478e382c3b55946]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:04:00.480840 24141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f9e6d9fb379b4ed59584d3edd83101e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:04:00.481586 24428 ts_tablet_manager.cc:1905] T 29989ce39a0f43a28aba36b3e98a8354 P 405f04f35a9b4112b58e09f05a9ea44b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:04:00.482278 24404 tablet_bootstrap.cc:492] T f9e6d9fb379b4ed59584d3edd83101e4 P cfbf3cc525204c3ea2f2fbe2ef6f6926: Bootstrap starting.
I20260811 08:04:00.482321 24299 tablet_service.cc:1467] Processing CreateTablet for tablet f9e6d9fb379b4ed59584d3edd83101e4 (DEFAULT_TABLE table=test-table [id=d273f624f87f4294b478e382c3b55946]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:04:00.482465 24299 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f9e6d9fb379b4ed59584d3edd83101e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:04:00.482748 24404 tablet_bootstrap.cc:654] T f9e6d9fb379b4ed59584d3edd83101e4 P cfbf3cc525204c3ea2f2fbe2ef6f6926: Neither blocks nor log segments found. Creating new log.
I20260811 08:04:00.483672 24404 tablet_bootstrap.cc:492] T f9e6d9fb379b4ed59584d3edd83101e4 P cfbf3cc525204c3ea2f2fbe2ef6f6926: No bootstrap required, opened a new log
I20260811 08:04:00.483728 24404 ts_tablet_manager.cc:1397] T f9e6d9fb379b4ed59584d3edd83101e4 P cfbf3cc525204c3ea2f2fbe2ef6f6926: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 08:04:00.483856 24430 ts_tablet_manager.cc:1918] T 29989ce39a0f43a28aba36b3e98a8354 P cfbf3cc525204c3ea2f2fbe2ef6f6926: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:04:00.483932 24430 log.cc:1196] T 29989ce39a0f43a28aba36b3e98a8354 P cfbf3cc525204c3ea2f2fbe2ef6f6926: Deleting WAL directory at /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/ts-1/wal/wals/29989ce39a0f43a28aba36b3e98a8354
I20260811 08:04:00.483894 24404 raft_consensus.cc:348] T f9e6d9fb379b4ed59584d3edd83101e4 P cfbf3cc525204c3ea2f2fbe2ef6f6926 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "405f04f35a9b4112b58e09f05a9ea44b" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 33463 } } peers { permanent_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39961 } } peers { permanent_uuid: "c16c1dbd34694d499b77890d7f0d79c9" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42727 } }
I20260811 08:04:00.483984 24404 raft_consensus.cc:374] T f9e6d9fb379b4ed59584d3edd83101e4 P cfbf3cc525204c3ea2f2fbe2ef6f6926 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:04:00.484011 24404 raft_consensus.cc:729] T f9e6d9fb379b4ed59584d3edd83101e4 P cfbf3cc525204c3ea2f2fbe2ef6f6926 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfbf3cc525204c3ea2f2fbe2ef6f6926, State: Initialized, Role: FOLLOWER
I20260811 08:04:00.484016 24402 tablet_bootstrap.cc:492] T f9e6d9fb379b4ed59584d3edd83101e4 P 405f04f35a9b4112b58e09f05a9ea44b: Bootstrap starting.
I20260811 08:04:00.484066 24404 consensus_queue.cc:260] T f9e6d9fb379b4ed59584d3edd83101e4 P cfbf3cc525204c3ea2f2fbe2ef6f6926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "405f04f35a9b4112b58e09f05a9ea44b" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 33463 } } peers { permanent_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39961 } } peers { permanent_uuid: "c16c1dbd34694d499b77890d7f0d79c9" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42727 } }
I20260811 08:04:00.484162 24404 ts_tablet_manager.cc:1428] T f9e6d9fb379b4ed59584d3edd83101e4 P cfbf3cc525204c3ea2f2fbe2ef6f6926: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 08:04:00.484239 24430 ts_tablet_manager.cc:1939] T 29989ce39a0f43a28aba36b3e98a8354 P cfbf3cc525204c3ea2f2fbe2ef6f6926: Deleting consensus metadata
I20260811 08:04:00.484465 24402 tablet_bootstrap.cc:654] T f9e6d9fb379b4ed59584d3edd83101e4 P 405f04f35a9b4112b58e09f05a9ea44b: Neither blocks nor log segments found. Creating new log.
I20260811 08:04:00.484542 24428 ts_tablet_manager.cc:1918] T 29989ce39a0f43a28aba36b3e98a8354 P 405f04f35a9b4112b58e09f05a9ea44b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:04:00.484616 24428 log.cc:1196] T 29989ce39a0f43a28aba36b3e98a8354 P 405f04f35a9b4112b58e09f05a9ea44b: Deleting WAL directory at /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/ts-0/wal/wals/29989ce39a0f43a28aba36b3e98a8354
I20260811 08:04:00.484835 24401 tablet_bootstrap.cc:492] T f9e6d9fb379b4ed59584d3edd83101e4 P c16c1dbd34694d499b77890d7f0d79c9: Bootstrap starting.
I20260811 08:04:00.484884 24428 ts_tablet_manager.cc:1939] T 29989ce39a0f43a28aba36b3e98a8354 P 405f04f35a9b4112b58e09f05a9ea44b: Deleting consensus metadata
I20260811 08:04:00.485296 24401 tablet_bootstrap.cc:654] T f9e6d9fb379b4ed59584d3edd83101e4 P c16c1dbd34694d499b77890d7f0d79c9: Neither blocks nor log segments found. Creating new log.
I20260811 08:04:00.485757 23811 catalog_manager.cc:4841] TS 405f04f35a9b4112b58e09f05a9ea44b (127.15.36.193:33463): tablet 29989ce39a0f43a28aba36b3e98a8354 (table test-table [id=1f13c1c903bc4dd1a466e073594fc1b7]) successfully deleted
I20260811 08:04:00.485991 24401 tablet_bootstrap.cc:492] T f9e6d9fb379b4ed59584d3edd83101e4 P c16c1dbd34694d499b77890d7f0d79c9: No bootstrap required, opened a new log
I20260811 08:04:00.486053 24401 ts_tablet_manager.cc:1397] T f9e6d9fb379b4ed59584d3edd83101e4 P c16c1dbd34694d499b77890d7f0d79c9: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 08:04:00.486155 23813 catalog_manager.cc:4841] TS cfbf3cc525204c3ea2f2fbe2ef6f6926 (127.15.36.194:39961): tablet 29989ce39a0f43a28aba36b3e98a8354 (table test-table [id=1f13c1c903bc4dd1a466e073594fc1b7]) successfully deleted
I20260811 08:04:00.486217 24401 raft_consensus.cc:348] T f9e6d9fb379b4ed59584d3edd83101e4 P c16c1dbd34694d499b77890d7f0d79c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "405f04f35a9b4112b58e09f05a9ea44b" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 33463 } } peers { permanent_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39961 } } peers { permanent_uuid: "c16c1dbd34694d499b77890d7f0d79c9" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42727 } }
I20260811 08:04:00.486320 24401 raft_consensus.cc:374] T f9e6d9fb379b4ed59584d3edd83101e4 P c16c1dbd34694d499b77890d7f0d79c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:04:00.486344 24401 raft_consensus.cc:729] T f9e6d9fb379b4ed59584d3edd83101e4 P c16c1dbd34694d499b77890d7f0d79c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c16c1dbd34694d499b77890d7f0d79c9, State: Initialized, Role: FOLLOWER
I20260811 08:04:00.486392 24401 consensus_queue.cc:260] T f9e6d9fb379b4ed59584d3edd83101e4 P c16c1dbd34694d499b77890d7f0d79c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "405f04f35a9b4112b58e09f05a9ea44b" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 33463 } } peers { permanent_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39961 } } peers { permanent_uuid: "c16c1dbd34694d499b77890d7f0d79c9" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42727 } }
I20260811 08:04:00.486480 24401 ts_tablet_manager.cc:1428] T f9e6d9fb379b4ed59584d3edd83101e4 P c16c1dbd34694d499b77890d7f0d79c9: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 08:04:00.486567 24402 tablet_bootstrap.cc:492] T f9e6d9fb379b4ed59584d3edd83101e4 P 405f04f35a9b4112b58e09f05a9ea44b: No bootstrap required, opened a new log
I20260811 08:04:00.486624 24402 ts_tablet_manager.cc:1397] T f9e6d9fb379b4ed59584d3edd83101e4 P 405f04f35a9b4112b58e09f05a9ea44b: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.000s
I20260811 08:04:00.486891 24402 raft_consensus.cc:348] T f9e6d9fb379b4ed59584d3edd83101e4 P 405f04f35a9b4112b58e09f05a9ea44b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "405f04f35a9b4112b58e09f05a9ea44b" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 33463 } } peers { permanent_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39961 } } peers { permanent_uuid: "c16c1dbd34694d499b77890d7f0d79c9" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42727 } }
I20260811 08:04:00.487006 24402 raft_consensus.cc:374] T f9e6d9fb379b4ed59584d3edd83101e4 P 405f04f35a9b4112b58e09f05a9ea44b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:04:00.487035 24402 raft_consensus.cc:729] T f9e6d9fb379b4ed59584d3edd83101e4 P 405f04f35a9b4112b58e09f05a9ea44b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 405f04f35a9b4112b58e09f05a9ea44b, State: Initialized, Role: FOLLOWER
I20260811 08:04:00.487092 24402 consensus_queue.cc:260] T f9e6d9fb379b4ed59584d3edd83101e4 P 405f04f35a9b4112b58e09f05a9ea44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "405f04f35a9b4112b58e09f05a9ea44b" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 33463 } } peers { permanent_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39961 } } peers { permanent_uuid: "c16c1dbd34694d499b77890d7f0d79c9" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42727 } }
I20260811 08:04:00.487190 24402 ts_tablet_manager.cc:1428] T f9e6d9fb379b4ed59584d3edd83101e4 P 405f04f35a9b4112b58e09f05a9ea44b: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260811 08:04:00.487473 24429 ts_tablet_manager.cc:1905] T 29989ce39a0f43a28aba36b3e98a8354 P c16c1dbd34694d499b77890d7f0d79c9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:04:00.489480 24429 ts_tablet_manager.cc:1918] T 29989ce39a0f43a28aba36b3e98a8354 P c16c1dbd34694d499b77890d7f0d79c9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:04:00.489583 24429 log.cc:1196] T 29989ce39a0f43a28aba36b3e98a8354 P c16c1dbd34694d499b77890d7f0d79c9: Deleting WAL directory at /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/ts-2/wal/wals/29989ce39a0f43a28aba36b3e98a8354
I20260811 08:04:00.489900 24429 ts_tablet_manager.cc:1939] T 29989ce39a0f43a28aba36b3e98a8354 P c16c1dbd34694d499b77890d7f0d79c9: Deleting consensus metadata
I20260811 08:04:00.490425 23810 catalog_manager.cc:4841] TS c16c1dbd34694d499b77890d7f0d79c9 (127.15.36.195:42727): tablet 29989ce39a0f43a28aba36b3e98a8354 (table test-table [id=1f13c1c903bc4dd1a466e073594fc1b7]) successfully deleted
W20260811 08:04:00.526048 24219 tablet.cc:2369] T f9e6d9fb379b4ed59584d3edd83101e4 P cfbf3cc525204c3ea2f2fbe2ef6f6926: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:04:00.527275 24411 raft_consensus.cc:482] T f9e6d9fb379b4ed59584d3edd83101e4 P 405f04f35a9b4112b58e09f05a9ea44b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:04:00.527374 24411 raft_consensus.cc:504] T f9e6d9fb379b4ed59584d3edd83101e4 P 405f04f35a9b4112b58e09f05a9ea44b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "405f04f35a9b4112b58e09f05a9ea44b" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 33463 } } peers { permanent_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39961 } } peers { permanent_uuid: "c16c1dbd34694d499b77890d7f0d79c9" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42727 } }
I20260811 08:04:00.527801 24411 leader_election.cc:288] T f9e6d9fb379b4ed59584d3edd83101e4 P 405f04f35a9b4112b58e09f05a9ea44b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfbf3cc525204c3ea2f2fbe2ef6f6926 (127.15.36.194:39961), c16c1dbd34694d499b77890d7f0d79c9 (127.15.36.195:42727)
I20260811 08:04:00.532629 24397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:00.528265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:49889 (local address 127.15.36.195:42727)
0811 08:04:00.528350 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:00.528353 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:00.528435 (+ 82us) server_negotiation.cc:407] Connection header received
0811 08:04:00.528528 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:00.528529 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:00.528559 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:00.528629 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:04:00.528793 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.529296 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.531062 (+ 1766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.531812 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.531930 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:00.531943 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0811 08:04:00.532492 (+ 549us) server_negotiation.cc:299] Negotiation successful
0811 08:04:00.532544 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 08:04:00.532657 24437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:00.528027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.195:42727 (local address 127.15.36.193:49889)
0811 08:04:00.528371 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:00.528381 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:00.528462 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:00.528645 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:00.528646 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:00.528647 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:04:00.528711 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:00.528713 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.529407 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.529408 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:00.530889 (+ 1481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:00.530894 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.532202 (+ 1308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.532206 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:00.532281 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:00.532287 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 08:04:00.532485 (+ 198us) client_negotiation.cc:240] Negotiation successful
0811 08:04:00.532544 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":327,"mutex_wait_us":47,"thread_start_us":66,"threads_started":1}
I20260811 08:04:00.533720 24400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:00.528085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:57031 (local address 127.15.36.194:39961)
0811 08:04:00.528148 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:00.528150 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:00.528304 (+ 154us) server_negotiation.cc:407] Connection header received
0811 08:04:00.528419 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:00.528420 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:00.528433 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:00.528469 (+ 36us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:04:00.528704 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.529483 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.532016 (+ 2533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.532837 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.533227 (+ 390us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:00.533246 (+ 19us) server_negotiation.cc:1035] Waiting for connection context
0811 08:04:00.533599 (+ 353us) server_negotiation.cc:299] Negotiation successful
0811 08:04:00.533660 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 08:04:00.533681 24321 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9e6d9fb379b4ed59584d3edd83101e4" candidate_uuid: "405f04f35a9b4112b58e09f05a9ea44b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c16c1dbd34694d499b77890d7f0d79c9" is_pre_election: true
I20260811 08:04:00.534077 24321 raft_consensus.cc:2454] T f9e6d9fb379b4ed59584d3edd83101e4 P c16c1dbd34694d499b77890d7f0d79c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 405f04f35a9b4112b58e09f05a9ea44b in term 0.
I20260811 08:04:00.534559 24436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:00.528025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.194:39961 (local address 127.15.36.193:57031)
0811 08:04:00.528224 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:00.528236 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:00.528304 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:00.528545 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:00.528546 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:00.528547 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:04:00.528636 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:00.528639 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.529574 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.529575 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:00.530889 (+ 1314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:00.530894 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.533272 (+ 2378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.533273 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:00.533463 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:00.533471 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 08:04:00.533857 (+ 386us) client_negotiation.cc:240] Negotiation successful
0811 08:04:00.533934 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"mutex_wait_us":8,"thread_start_us":131,"threads_started":1}
I20260811 08:04:00.535620 23929 leader_election.cc:302] T f9e6d9fb379b4ed59584d3edd83101e4 P 405f04f35a9b4112b58e09f05a9ea44b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 405f04f35a9b4112b58e09f05a9ea44b, c16c1dbd34694d499b77890d7f0d79c9; no voters:
I20260811 08:04:00.535786 24411 raft_consensus.cc:2781] T f9e6d9fb379b4ed59584d3edd83101e4 P 405f04f35a9b4112b58e09f05a9ea44b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:04:00.535823 24411 raft_consensus.cc:482] T f9e6d9fb379b4ed59584d3edd83101e4 P 405f04f35a9b4112b58e09f05a9ea44b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:04:00.535844 24411 raft_consensus.cc:3037] T f9e6d9fb379b4ed59584d3edd83101e4 P 405f04f35a9b4112b58e09f05a9ea44b [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:04:00.535888 24166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9e6d9fb379b4ed59584d3edd83101e4" candidate_uuid: "405f04f35a9b4112b58e09f05a9ea44b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" is_pre_election: true
I20260811 08:04:00.535982 24166 raft_consensus.cc:2454] T f9e6d9fb379b4ed59584d3edd83101e4 P cfbf3cc525204c3ea2f2fbe2ef6f6926 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 405f04f35a9b4112b58e09f05a9ea44b in term 0.
I20260811 08:04:00.537963 24411 raft_consensus.cc:504] T f9e6d9fb379b4ed59584d3edd83101e4 P 405f04f35a9b4112b58e09f05a9ea44b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "405f04f35a9b4112b58e09f05a9ea44b" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 33463 } } peers { permanent_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39961 } } peers { permanent_uuid: "c16c1dbd34694d499b77890d7f0d79c9" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42727 } }
I20260811 08:04:00.538187 24411 leader_election.cc:288] T f9e6d9fb379b4ed59584d3edd83101e4 P 405f04f35a9b4112b58e09f05a9ea44b [CANDIDATE]: Term 1 election: Requested vote from peers cfbf3cc525204c3ea2f2fbe2ef6f6926 (127.15.36.194:39961), c16c1dbd34694d499b77890d7f0d79c9 (127.15.36.195:42727)
I20260811 08:04:00.538784 24166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9e6d9fb379b4ed59584d3edd83101e4" candidate_uuid: "405f04f35a9b4112b58e09f05a9ea44b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926"
I20260811 08:04:00.538926 24321 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9e6d9fb379b4ed59584d3edd83101e4" candidate_uuid: "405f04f35a9b4112b58e09f05a9ea44b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c16c1dbd34694d499b77890d7f0d79c9"
I20260811 08:04:00.539110 24321 raft_consensus.cc:3037] T f9e6d9fb379b4ed59584d3edd83101e4 P c16c1dbd34694d499b77890d7f0d79c9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:04:00.539065 24166 raft_consensus.cc:3037] T f9e6d9fb379b4ed59584d3edd83101e4 P cfbf3cc525204c3ea2f2fbe2ef6f6926 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:04:00.540314 24166 raft_consensus.cc:2454] T f9e6d9fb379b4ed59584d3edd83101e4 P cfbf3cc525204c3ea2f2fbe2ef6f6926 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 405f04f35a9b4112b58e09f05a9ea44b in term 1.
I20260811 08:04:00.540647 23933 leader_election.cc:302] T f9e6d9fb379b4ed59584d3edd83101e4 P 405f04f35a9b4112b58e09f05a9ea44b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 405f04f35a9b4112b58e09f05a9ea44b, cfbf3cc525204c3ea2f2fbe2ef6f6926; no voters:
I20260811 08:04:00.541087 24321 raft_consensus.cc:2454] T f9e6d9fb379b4ed59584d3edd83101e4 P c16c1dbd34694d499b77890d7f0d79c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 405f04f35a9b4112b58e09f05a9ea44b in term 1.
I20260811 08:04:00.541288 24411 raft_consensus.cc:2781] T f9e6d9fb379b4ed59584d3edd83101e4 P 405f04f35a9b4112b58e09f05a9ea44b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:04:00.541456 24411 raft_consensus.cc:686] T f9e6d9fb379b4ed59584d3edd83101e4 P 405f04f35a9b4112b58e09f05a9ea44b [term 1 LEADER]: Becoming Leader. State: Replica: 405f04f35a9b4112b58e09f05a9ea44b, State: Running, Role: LEADER
I20260811 08:04:00.541527 24411 consensus_queue.cc:237] T f9e6d9fb379b4ed59584d3edd83101e4 P 405f04f35a9b4112b58e09f05a9ea44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "405f04f35a9b4112b58e09f05a9ea44b" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 33463 } } peers { permanent_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39961 } } peers { permanent_uuid: "c16c1dbd34694d499b77890d7f0d79c9" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42727 } }
I20260811 08:04:00.543115 23828 catalog_manager.cc:5495] T f9e6d9fb379b4ed59584d3edd83101e4 P 405f04f35a9b4112b58e09f05a9ea44b reported cstate change: term changed from 0 to 1, leader changed from <none> to 405f04f35a9b4112b58e09f05a9ea44b (127.15.36.193). New cstate: current_term: 1 leader_uuid: "405f04f35a9b4112b58e09f05a9ea44b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "405f04f35a9b4112b58e09f05a9ea44b" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 33463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c16c1dbd34694d499b77890d7f0d79c9" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42727 } health_report { overall_health: UNKNOWN } } }
Aug 11 08:04:00 dist-test-slave-2w3w krb5kdc[23777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435439, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.36.254@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM
I20260811 08:04:00.587569 24446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:00.571870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:39763 (local address 127.0.0.1:59800)
0811 08:04:00.572209 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:00.572227 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:00.572347 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:00.572588 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:00.572589 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:00.572975 (+ 386us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:04:00.573045 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:00.573048 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.574373 (+ 1325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.574374 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:00.575153 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:00.575156 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.575738 (+ 582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.575739 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:00.575795 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:00.582376 (+ 6581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:04:00.582385 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:04:00.584132 (+ 1747us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:04:00.586127 (+ 1995us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:04:00.586138 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:04:00.586140 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:04:00.586391 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:04:00.586642 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:04:00.586643 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:04:00.586643 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:04:00.586774 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:04:00.587227 (+ 453us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:04:00.587236 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:04:00.587287 (+ 51us) client_negotiation.cc:769] Sending connection context
0811 08:04:00.587365 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 08:04:00.587488 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":96,"threads_started":1}
I20260811 08:04:00.587679 23890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:00.571958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59800 (local address 127.15.36.254:39763)
0811 08:04:00.572024 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:00.572026 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:00.572361 (+ 335us) server_negotiation.cc:407] Connection header received
0811 08:04:00.572407 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:00.572408 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:00.572422 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:00.572534 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:00.573317 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.574235 (+ 918us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.575257 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.575562 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.575670 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:00.584266 (+ 8596us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:04:00.584269 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:04:00.584269 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:04:00.584279 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:04:00.585988 (+ 1709us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:04:00.586491 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:04:00.586492 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:04:00.586493 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:04:00.586561 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:04:00.586877 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:04:00.586879 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:04:00.586879 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:04:00.587087 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:04:00.587176 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 08:04:00.587430 (+ 254us) server_negotiation.cc:299] Negotiation successful
0811 08:04:00.587563 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":34,"server-negotiator.queue_time_us":40}
I20260811 08:04:00.591198 23828 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.15.36.254@KRBTEST.COM'} at 127.0.0.1:59800:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 08:04:00.591481 23828 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:04:00.593330 24141 tablet_service.cc:1467] Processing CreateTablet for tablet 0b45f3527b1c441aabcd01346d790423 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=755a790291be4bc2a1823ce2b43d0c1b]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 08:04:00.593539 24141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b45f3527b1c441aabcd01346d790423. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:04:00.593583 24299 tablet_service.cc:1467] Processing CreateTablet for tablet 0b45f3527b1c441aabcd01346d790423 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=755a790291be4bc2a1823ce2b43d0c1b]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 08:04:00.593575 23982 tablet_service.cc:1467] Processing CreateTablet for tablet 0b45f3527b1c441aabcd01346d790423 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=755a790291be4bc2a1823ce2b43d0c1b]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 08:04:00.593745 23982 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b45f3527b1c441aabcd01346d790423. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:04:00.593721 24299 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b45f3527b1c441aabcd01346d790423. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:04:00.596292 24404 tablet_bootstrap.cc:492] T 0b45f3527b1c441aabcd01346d790423 P cfbf3cc525204c3ea2f2fbe2ef6f6926: Bootstrap starting.
I20260811 08:04:00.596294 24402 tablet_bootstrap.cc:492] T 0b45f3527b1c441aabcd01346d790423 P 405f04f35a9b4112b58e09f05a9ea44b: Bootstrap starting.
I20260811 08:04:00.596797 24402 tablet_bootstrap.cc:654] T 0b45f3527b1c441aabcd01346d790423 P 405f04f35a9b4112b58e09f05a9ea44b: Neither blocks nor log segments found. Creating new log.
I20260811 08:04:00.596791 24404 tablet_bootstrap.cc:654] T 0b45f3527b1c441aabcd01346d790423 P cfbf3cc525204c3ea2f2fbe2ef6f6926: Neither blocks nor log segments found. Creating new log.
I20260811 08:04:00.597193 24401 tablet_bootstrap.cc:492] T 0b45f3527b1c441aabcd01346d790423 P c16c1dbd34694d499b77890d7f0d79c9: Bootstrap starting.
I20260811 08:04:00.597671 24401 tablet_bootstrap.cc:654] T 0b45f3527b1c441aabcd01346d790423 P c16c1dbd34694d499b77890d7f0d79c9: Neither blocks nor log segments found. Creating new log.
I20260811 08:04:00.597955 24402 tablet_bootstrap.cc:492] T 0b45f3527b1c441aabcd01346d790423 P 405f04f35a9b4112b58e09f05a9ea44b: No bootstrap required, opened a new log
I20260811 08:04:00.598035 24402 ts_tablet_manager.cc:1397] T 0b45f3527b1c441aabcd01346d790423 P 405f04f35a9b4112b58e09f05a9ea44b: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 08:04:00.598215 24402 raft_consensus.cc:348] T 0b45f3527b1c441aabcd01346d790423 P 405f04f35a9b4112b58e09f05a9ea44b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "405f04f35a9b4112b58e09f05a9ea44b" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 33463 } } peers { permanent_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39961 } } peers { permanent_uuid: "c16c1dbd34694d499b77890d7f0d79c9" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42727 } }
I20260811 08:04:00.598325 24402 raft_consensus.cc:374] T 0b45f3527b1c441aabcd01346d790423 P 405f04f35a9b4112b58e09f05a9ea44b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:04:00.598376 24402 raft_consensus.cc:729] T 0b45f3527b1c441aabcd01346d790423 P 405f04f35a9b4112b58e09f05a9ea44b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 405f04f35a9b4112b58e09f05a9ea44b, State: Initialized, Role: FOLLOWER
I20260811 08:04:00.598430 24402 consensus_queue.cc:260] T 0b45f3527b1c441aabcd01346d790423 P 405f04f35a9b4112b58e09f05a9ea44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "405f04f35a9b4112b58e09f05a9ea44b" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 33463 } } peers { permanent_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39961 } } peers { permanent_uuid: "c16c1dbd34694d499b77890d7f0d79c9" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42727 } }
I20260811 08:04:00.598476 24404 tablet_bootstrap.cc:492] T 0b45f3527b1c441aabcd01346d790423 P cfbf3cc525204c3ea2f2fbe2ef6f6926: No bootstrap required, opened a new log
I20260811 08:04:00.598533 24404 ts_tablet_manager.cc:1397] T 0b45f3527b1c441aabcd01346d790423 P cfbf3cc525204c3ea2f2fbe2ef6f6926: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 08:04:00.598553 24402 ts_tablet_manager.cc:1428] T 0b45f3527b1c441aabcd01346d790423 P 405f04f35a9b4112b58e09f05a9ea44b: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 08:04:00.598697 24404 raft_consensus.cc:348] T 0b45f3527b1c441aabcd01346d790423 P cfbf3cc525204c3ea2f2fbe2ef6f6926 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "405f04f35a9b4112b58e09f05a9ea44b" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 33463 } } peers { permanent_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39961 } } peers { permanent_uuid: "c16c1dbd34694d499b77890d7f0d79c9" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42727 } }
I20260811 08:04:00.598706 24411 tablet_replica.cc:439] T 0b45f3527b1c441aabcd01346d790423 P 405f04f35a9b4112b58e09f05a9ea44b: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "405f04f35a9b4112b58e09f05a9ea44b" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 33463 } } peers { permanent_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39961 } } peers { permanent_uuid: "c16c1dbd34694d499b77890d7f0d79c9" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42727 } } }
I20260811 08:04:00.598791 24404 raft_consensus.cc:374] T 0b45f3527b1c441aabcd01346d790423 P cfbf3cc525204c3ea2f2fbe2ef6f6926 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:04:00.598811 24404 raft_consensus.cc:729] T 0b45f3527b1c441aabcd01346d790423 P cfbf3cc525204c3ea2f2fbe2ef6f6926 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfbf3cc525204c3ea2f2fbe2ef6f6926, State: Initialized, Role: FOLLOWER
I20260811 08:04:00.598810 24411 tablet_replica.cc:442] T 0b45f3527b1c441aabcd01346d790423 P 405f04f35a9b4112b58e09f05a9ea44b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 08:04:00.598858 24404 consensus_queue.cc:260] T 0b45f3527b1c441aabcd01346d790423 P cfbf3cc525204c3ea2f2fbe2ef6f6926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "405f04f35a9b4112b58e09f05a9ea44b" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 33463 } } peers { permanent_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39961 } } peers { permanent_uuid: "c16c1dbd34694d499b77890d7f0d79c9" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42727 } }
I20260811 08:04:00.598942 24404 ts_tablet_manager.cc:1428] T 0b45f3527b1c441aabcd01346d790423 P cfbf3cc525204c3ea2f2fbe2ef6f6926: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 08:04:00.599201 24410 tablet_replica.cc:439] T 0b45f3527b1c441aabcd01346d790423 P cfbf3cc525204c3ea2f2fbe2ef6f6926: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "405f04f35a9b4112b58e09f05a9ea44b" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 33463 } } peers { permanent_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39961 } } peers { permanent_uuid: "c16c1dbd34694d499b77890d7f0d79c9" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42727 } } }
I20260811 08:04:00.599326 24410 tablet_replica.cc:442] T 0b45f3527b1c441aabcd01346d790423 P cfbf3cc525204c3ea2f2fbe2ef6f6926: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 08:04:00.599565 24401 tablet_bootstrap.cc:492] T 0b45f3527b1c441aabcd01346d790423 P c16c1dbd34694d499b77890d7f0d79c9: No bootstrap required, opened a new log
I20260811 08:04:00.599618 24401 ts_tablet_manager.cc:1397] T 0b45f3527b1c441aabcd01346d790423 P c16c1dbd34694d499b77890d7f0d79c9: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 08:04:00.599745 24401 raft_consensus.cc:348] T 0b45f3527b1c441aabcd01346d790423 P c16c1dbd34694d499b77890d7f0d79c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "405f04f35a9b4112b58e09f05a9ea44b" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 33463 } } peers { permanent_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39961 } } peers { permanent_uuid: "c16c1dbd34694d499b77890d7f0d79c9" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42727 } }
I20260811 08:04:00.599822 24401 raft_consensus.cc:374] T 0b45f3527b1c441aabcd01346d790423 P c16c1dbd34694d499b77890d7f0d79c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:04:00.599845 24401 raft_consensus.cc:729] T 0b45f3527b1c441aabcd01346d790423 P c16c1dbd34694d499b77890d7f0d79c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c16c1dbd34694d499b77890d7f0d79c9, State: Initialized, Role: FOLLOWER
I20260811 08:04:00.599888 24401 consensus_queue.cc:260] T 0b45f3527b1c441aabcd01346d790423 P c16c1dbd34694d499b77890d7f0d79c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "405f04f35a9b4112b58e09f05a9ea44b" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 33463 } } peers { permanent_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39961 } } peers { permanent_uuid: "c16c1dbd34694d499b77890d7f0d79c9" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42727 } }
I20260811 08:04:00.599982 24401 ts_tablet_manager.cc:1428] T 0b45f3527b1c441aabcd01346d790423 P c16c1dbd34694d499b77890d7f0d79c9: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 08:04:00.600090 24413 tablet_replica.cc:439] T 0b45f3527b1c441aabcd01346d790423 P c16c1dbd34694d499b77890d7f0d79c9: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "405f04f35a9b4112b58e09f05a9ea44b" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 33463 } } peers { permanent_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39961 } } peers { permanent_uuid: "c16c1dbd34694d499b77890d7f0d79c9" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42727 } } }
I20260811 08:04:00.600162 24413 tablet_replica.cc:442] T 0b45f3527b1c441aabcd01346d790423 P c16c1dbd34694d499b77890d7f0d79c9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 08:04:00.722615 24410 raft_consensus.cc:482] T 0b45f3527b1c441aabcd01346d790423 P cfbf3cc525204c3ea2f2fbe2ef6f6926 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:04:00.723026 24410 raft_consensus.cc:504] T 0b45f3527b1c441aabcd01346d790423 P cfbf3cc525204c3ea2f2fbe2ef6f6926 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "405f04f35a9b4112b58e09f05a9ea44b" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 33463 } } peers { permanent_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39961 } } peers { permanent_uuid: "c16c1dbd34694d499b77890d7f0d79c9" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42727 } }
I20260811 08:04:00.723712 24410 leader_election.cc:288] T 0b45f3527b1c441aabcd01346d790423 P cfbf3cc525204c3ea2f2fbe2ef6f6926 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 405f04f35a9b4112b58e09f05a9ea44b (127.15.36.193:33463), c16c1dbd34694d499b77890d7f0d79c9 (127.15.36.195:42727)
I20260811 08:04:00.726850 24454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:00.723897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.193:33463 (local address 127.15.36.194:56137)
0811 08:04:00.724097 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:00.724109 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:00.724205 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:00.724379 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:00.724380 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:00.724383 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:04:00.724472 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:00.724474 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.725142 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.725143 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:00.725967 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:00.725969 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.726545 (+ 576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.726546 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:00.726632 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:00.726635 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:04:00.726706 (+ 71us) client_negotiation.cc:240] Negotiation successful
0811 08:04:00.726747 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":236,"threads_started":1}
I20260811 08:04:00.726828 24398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:00.724002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:56137 (local address 127.15.36.193:33463)
0811 08:04:00.724071 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:00.724074 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:00.724194 (+ 120us) server_negotiation.cc:407] Connection header received
0811 08:04:00.724271 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:00.724272 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:00.724283 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:00.724367 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:04:00.724566 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.725055 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.726070 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.726454 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.726544 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:00.726554 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 08:04:00.726716 (+ 162us) server_negotiation.cc:299] Negotiation successful
0811 08:04:00.726758 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 08:04:00.727222 24007 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b45f3527b1c441aabcd01346d790423" candidate_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "405f04f35a9b4112b58e09f05a9ea44b" is_pre_election: true
I20260811 08:04:00.727342 24007 raft_consensus.cc:2454] T 0b45f3527b1c441aabcd01346d790423 P 405f04f35a9b4112b58e09f05a9ea44b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfbf3cc525204c3ea2f2fbe2ef6f6926 in term 0.
I20260811 08:04:00.727540 24086 leader_election.cc:302] T 0b45f3527b1c441aabcd01346d790423 P cfbf3cc525204c3ea2f2fbe2ef6f6926 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 405f04f35a9b4112b58e09f05a9ea44b, cfbf3cc525204c3ea2f2fbe2ef6f6926; no voters:
I20260811 08:04:00.727605 24397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:00.724237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:52491 (local address 127.15.36.195:42727)
0811 08:04:00.724303 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:00.724308 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:00.724491 (+ 183us) server_negotiation.cc:407] Connection header received
0811 08:04:00.724586 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:00.724587 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:00.724599 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:00.724770 (+ 171us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:04:00.724998 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.725520 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.726562 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.727230 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.727310 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:00.727348 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0811 08:04:00.727477 (+ 129us) server_negotiation.cc:299] Negotiation successful
0811 08:04:00.727524 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 08:04:00.727638 24453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:00.723966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.195:42727 (local address 127.15.36.194:52491)
0811 08:04:00.724256 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:00.724276 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:00.724515 (+ 239us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:00.724756 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:00.724758 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:00.724764 (+ 6us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:04:00.724862 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:00.724864 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.725623 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.725624 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:00.726440 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:00.726443 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.727321 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.727322 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:00.727399 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:00.727404 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 08:04:00.727469 (+ 65us) client_negotiation.cc:240] Negotiation successful
0811 08:04:00.727511 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":57,"threads_started":1}
I20260811 08:04:00.727717 24410 raft_consensus.cc:2781] T 0b45f3527b1c441aabcd01346d790423 P cfbf3cc525204c3ea2f2fbe2ef6f6926 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:04:00.727754 24410 raft_consensus.cc:482] T 0b45f3527b1c441aabcd01346d790423 P cfbf3cc525204c3ea2f2fbe2ef6f6926 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:04:00.727782 24410 raft_consensus.cc:3037] T 0b45f3527b1c441aabcd01346d790423 P cfbf3cc525204c3ea2f2fbe2ef6f6926 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:04:00.727880 24321 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b45f3527b1c441aabcd01346d790423" candidate_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c16c1dbd34694d499b77890d7f0d79c9" is_pre_election: true
I20260811 08:04:00.727977 24321 raft_consensus.cc:2454] T 0b45f3527b1c441aabcd01346d790423 P c16c1dbd34694d499b77890d7f0d79c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfbf3cc525204c3ea2f2fbe2ef6f6926 in term 0.
I20260811 08:04:00.728749 24410 raft_consensus.cc:504] T 0b45f3527b1c441aabcd01346d790423 P cfbf3cc525204c3ea2f2fbe2ef6f6926 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "405f04f35a9b4112b58e09f05a9ea44b" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 33463 } } peers { permanent_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39961 } } peers { permanent_uuid: "c16c1dbd34694d499b77890d7f0d79c9" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42727 } }
I20260811 08:04:00.728957 24410 leader_election.cc:288] T 0b45f3527b1c441aabcd01346d790423 P cfbf3cc525204c3ea2f2fbe2ef6f6926 [CANDIDATE]: Term 1 election: Requested vote from peers 405f04f35a9b4112b58e09f05a9ea44b (127.15.36.193:33463), c16c1dbd34694d499b77890d7f0d79c9 (127.15.36.195:42727)
I20260811 08:04:00.729117 24007 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b45f3527b1c441aabcd01346d790423" candidate_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "405f04f35a9b4112b58e09f05a9ea44b"
I20260811 08:04:00.729225 24007 raft_consensus.cc:3037] T 0b45f3527b1c441aabcd01346d790423 P 405f04f35a9b4112b58e09f05a9ea44b [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:04:00.729934 24007 raft_consensus.cc:2454] T 0b45f3527b1c441aabcd01346d790423 P 405f04f35a9b4112b58e09f05a9ea44b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfbf3cc525204c3ea2f2fbe2ef6f6926 in term 1.
I20260811 08:04:00.730188 24321 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b45f3527b1c441aabcd01346d790423" candidate_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c16c1dbd34694d499b77890d7f0d79c9"
I20260811 08:04:00.730207 24086 leader_election.cc:302] T 0b45f3527b1c441aabcd01346d790423 P cfbf3cc525204c3ea2f2fbe2ef6f6926 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 405f04f35a9b4112b58e09f05a9ea44b, cfbf3cc525204c3ea2f2fbe2ef6f6926; no voters:
I20260811 08:04:00.730300 24321 raft_consensus.cc:3037] T 0b45f3527b1c441aabcd01346d790423 P c16c1dbd34694d499b77890d7f0d79c9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:04:00.730377 24410 raft_consensus.cc:2781] T 0b45f3527b1c441aabcd01346d790423 P cfbf3cc525204c3ea2f2fbe2ef6f6926 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:04:00.730540 24410 raft_consensus.cc:686] T 0b45f3527b1c441aabcd01346d790423 P cfbf3cc525204c3ea2f2fbe2ef6f6926 [term 1 LEADER]: Becoming Leader. State: Replica: cfbf3cc525204c3ea2f2fbe2ef6f6926, State: Running, Role: LEADER
I20260811 08:04:00.730647 24410 consensus_queue.cc:237] T 0b45f3527b1c441aabcd01346d790423 P cfbf3cc525204c3ea2f2fbe2ef6f6926 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "405f04f35a9b4112b58e09f05a9ea44b" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 33463 } } peers { permanent_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39961 } } peers { permanent_uuid: "c16c1dbd34694d499b77890d7f0d79c9" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42727 } }
I20260811 08:04:00.731272 24321 raft_consensus.cc:2454] T 0b45f3527b1c441aabcd01346d790423 P c16c1dbd34694d499b77890d7f0d79c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfbf3cc525204c3ea2f2fbe2ef6f6926 in term 1.
I20260811 08:04:00.731318 24455 tablet_replica.cc:439] T 0b45f3527b1c441aabcd01346d790423 P cfbf3cc525204c3ea2f2fbe2ef6f6926: TxnStatusTablet state changed. Reason: New leader cfbf3cc525204c3ea2f2fbe2ef6f6926. Latest consensus state: current_term: 1 leader_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "405f04f35a9b4112b58e09f05a9ea44b" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 33463 } } peers { permanent_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39961 } } peers { permanent_uuid: "c16c1dbd34694d499b77890d7f0d79c9" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42727 } } }
I20260811 08:04:00.731504 24455 tablet_replica.cc:442] T 0b45f3527b1c441aabcd01346d790423 P cfbf3cc525204c3ea2f2fbe2ef6f6926: This TxnStatusTablet replica's current role is: LEADER
I20260811 08:04:00.731588 23828 catalog_manager.cc:5495] T 0b45f3527b1c441aabcd01346d790423 P cfbf3cc525204c3ea2f2fbe2ef6f6926 reported cstate change: term changed from 0 to 1, leader changed from <none> to cfbf3cc525204c3ea2f2fbe2ef6f6926 (127.15.36.194). New cstate: current_term: 1 leader_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "405f04f35a9b4112b58e09f05a9ea44b" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 33463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39961 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c16c1dbd34694d499b77890d7f0d79c9" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42727 } health_report { overall_health: UNKNOWN } } }
I20260811 08:04:00.732128 24457 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 08:04:00.732293 24457 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 08:04:00.756002 24400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:00.752674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54276 (local address 127.15.36.194:39961)
0811 08:04:00.752725 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:00.752728 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:00.752739 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:04:00.752933 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:00.752935 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:00.752965 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:00.753053 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:04:00.753225 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.753814 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.754679 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.755023 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.755123 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:00.755365 (+ 242us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:04:00.755613 (+ 248us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:04:00.755741 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0811 08:04:00.755800 (+ 59us) server_negotiation.cc:299] Negotiation successful
0811 08:04:00.755828 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 08:04:00.756006 24446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:00.752552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.194:39961 (local address 127.0.0.1:54276)
0811 08:04:00.752672 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:00.752687 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:00.752796 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:00.753061 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:00.753063 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:00.753064 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 08:04:00.753133 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:00.753136 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.753918 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.753919 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:00.754574 (+ 655us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:00.754577 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.755124 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.755125 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:00.755195 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:00.755226 (+ 31us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 08:04:00.755734 (+ 508us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 08:04:00.755747 (+ 13us) client_negotiation.cc:769] Sending connection context
0811 08:04:00.755797 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 08:04:00.755863 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":66}
I20260811 08:04:00.757956 24007 raft_consensus.cc:1261] T 0b45f3527b1c441aabcd01346d790423 P 405f04f35a9b4112b58e09f05a9ea44b [term 1 FOLLOWER]: Refusing update from remote peer cfbf3cc525204c3ea2f2fbe2ef6f6926: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:04:00.758713 24321 raft_consensus.cc:1261] T 0b45f3527b1c441aabcd01346d790423 P c16c1dbd34694d499b77890d7f0d79c9 [term 1 FOLLOWER]: Refusing update from remote peer cfbf3cc525204c3ea2f2fbe2ef6f6926: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:04:00.758688 24455 consensus_queue.cc:1035] T 0b45f3527b1c441aabcd01346d790423 P cfbf3cc525204c3ea2f2fbe2ef6f6926 [LEADER]: Connected to new peer: Peer: permanent_uuid: "405f04f35a9b4112b58e09f05a9ea44b" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 33463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:04:00.759696 24455 consensus_queue.cc:1035] T 0b45f3527b1c441aabcd01346d790423 P cfbf3cc525204c3ea2f2fbe2ef6f6926 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c16c1dbd34694d499b77890d7f0d79c9" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:04:00.760353 24411 tablet_replica.cc:439] T 0b45f3527b1c441aabcd01346d790423 P 405f04f35a9b4112b58e09f05a9ea44b: TxnStatusTablet state changed. Reason: New leader cfbf3cc525204c3ea2f2fbe2ef6f6926. Latest consensus state: current_term: 1 leader_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "405f04f35a9b4112b58e09f05a9ea44b" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 33463 } } peers { permanent_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39961 } } peers { permanent_uuid: "c16c1dbd34694d499b77890d7f0d79c9" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42727 } } }
I20260811 08:04:00.760475 24411 tablet_replica.cc:442] T 0b45f3527b1c441aabcd01346d790423 P 405f04f35a9b4112b58e09f05a9ea44b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 08:04:00.761579 24455 tablet_replica.cc:439] T 0b45f3527b1c441aabcd01346d790423 P cfbf3cc525204c3ea2f2fbe2ef6f6926: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "405f04f35a9b4112b58e09f05a9ea44b" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 33463 } } peers { permanent_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39961 } } peers { permanent_uuid: "c16c1dbd34694d499b77890d7f0d79c9" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42727 } } }
I20260811 08:04:00.761685 24455 tablet_replica.cc:442] T 0b45f3527b1c441aabcd01346d790423 P cfbf3cc525204c3ea2f2fbe2ef6f6926: This TxnStatusTablet replica's current role is: LEADER
I20260811 08:04:00.761582 24413 tablet_replica.cc:439] T 0b45f3527b1c441aabcd01346d790423 P c16c1dbd34694d499b77890d7f0d79c9: TxnStatusTablet state changed. Reason: New leader cfbf3cc525204c3ea2f2fbe2ef6f6926. Latest consensus state: current_term: 1 leader_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "405f04f35a9b4112b58e09f05a9ea44b" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 33463 } } peers { permanent_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39961 } } peers { permanent_uuid: "c16c1dbd34694d499b77890d7f0d79c9" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42727 } } }
I20260811 08:04:00.761797 24413 tablet_replica.cc:442] T 0b45f3527b1c441aabcd01346d790423 P c16c1dbd34694d499b77890d7f0d79c9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 08:04:00.762668 24410 tablet_replica.cc:439] T 0b45f3527b1c441aabcd01346d790423 P cfbf3cc525204c3ea2f2fbe2ef6f6926: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "405f04f35a9b4112b58e09f05a9ea44b" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 33463 } } peers { permanent_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39961 } } peers { permanent_uuid: "c16c1dbd34694d499b77890d7f0d79c9" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42727 } } }
I20260811 08:04:00.762773 24410 tablet_replica.cc:442] T 0b45f3527b1c441aabcd01346d790423 P cfbf3cc525204c3ea2f2fbe2ef6f6926: This TxnStatusTablet replica's current role is: LEADER
I20260811 08:04:00.763331 24413 tablet_replica.cc:439] T 0b45f3527b1c441aabcd01346d790423 P c16c1dbd34694d499b77890d7f0d79c9: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "405f04f35a9b4112b58e09f05a9ea44b" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 33463 } } peers { permanent_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39961 } } peers { permanent_uuid: "c16c1dbd34694d499b77890d7f0d79c9" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42727 } } }
I20260811 08:04:00.763448 24413 tablet_replica.cc:442] T 0b45f3527b1c441aabcd01346d790423 P c16c1dbd34694d499b77890d7f0d79c9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 08:04:00.763394 24411 tablet_replica.cc:439] T 0b45f3527b1c441aabcd01346d790423 P 405f04f35a9b4112b58e09f05a9ea44b: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "405f04f35a9b4112b58e09f05a9ea44b" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 33463 } } peers { permanent_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39961 } } peers { permanent_uuid: "c16c1dbd34694d499b77890d7f0d79c9" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42727 } } }
I20260811 08:04:00.763485 24411 tablet_replica.cc:442] T 0b45f3527b1c441aabcd01346d790423 P 405f04f35a9b4112b58e09f05a9ea44b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 08:04:00.763345 24416 mvcc.cc:205] Tried to move back new op lower bound from 7317239565341548544 to 7317239565233336320. Current Snapshot: MvccSnapshot[applied={T|T < 7317239565341548544 or (T in {7317239565341548544})}]
I20260811 08:04:00.768214 24398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:00.764926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46804 (local address 127.15.36.193:33463)
0811 08:04:00.764978 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:00.764981 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:00.765048 (+ 67us) server_negotiation.cc:407] Connection header received
0811 08:04:00.765140 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:00.765141 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:00.765167 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:00.765241 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:04:00.765480 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.766207 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.767193 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.767510 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.767587 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:00.767781 (+ 194us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:04:00.767934 (+ 153us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:04:00.768013 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 08:04:00.768096 (+ 83us) server_negotiation.cc:299] Negotiation successful
0811 08:04:00.768123 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 08:04:00.783161 24400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:00.772341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:54143 (local address 127.15.36.194:39961)
0811 08:04:00.772396 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:00.772399 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:00.772574 (+ 175us) server_negotiation.cc:407] Connection header received
0811 08:04:00.772702 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:00.772703 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:00.772716 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:00.778962 (+ 6246us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:04:00.779067 (+ 105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.779796 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.781147 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.782162 (+ 1015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.782228 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:00.782800 (+ 572us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:04:00.782858 (+ 58us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:04:00.782892 (+ 34us) server_negotiation.cc:1035] Waiting for connection context
0811 08:04:00.783032 (+ 140us) server_negotiation.cc:299] Negotiation successful
0811 08:04:00.783063 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 08:04:00.783635 24465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:00.772076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.194:39961 (local address 127.15.36.193:54143)
0811 08:04:00.772504 (+ 428us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:00.772517 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:00.772607 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:00.773236 (+ 629us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:00.773238 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:00.773240 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 08:04:00.773571 (+ 331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:00.773575 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.779949 (+ 6374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.779951 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:00.781023 (+ 1072us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:00.781029 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.782563 (+ 1534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.782564 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:00.782646 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:00.782684 (+ 38us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 08:04:00.782939 (+ 255us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 08:04:00.782941 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 08:04:00.783283 (+ 342us) client_negotiation.cc:240] Negotiation successful
0811 08:04:00.783501 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":367,"thread_start_us":93,"threads_started":1}
I20260811 08:04:00.786989 24166 raft_consensus.cc:1261] T f9e6d9fb379b4ed59584d3edd83101e4 P cfbf3cc525204c3ea2f2fbe2ef6f6926 [term 1 FOLLOWER]: Refusing update from remote peer 405f04f35a9b4112b58e09f05a9ea44b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:04:00.787065 24321 raft_consensus.cc:1261] T f9e6d9fb379b4ed59584d3edd83101e4 P c16c1dbd34694d499b77890d7f0d79c9 [term 1 FOLLOWER]: Refusing update from remote peer 405f04f35a9b4112b58e09f05a9ea44b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:04:00.787266 24411 consensus_queue.cc:1035] T f9e6d9fb379b4ed59584d3edd83101e4 P 405f04f35a9b4112b58e09f05a9ea44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:04:00.787736 24438 consensus_queue.cc:1035] T f9e6d9fb379b4ed59584d3edd83101e4 P 405f04f35a9b4112b58e09f05a9ea44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c16c1dbd34694d499b77890d7f0d79c9" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:04:00.801921 24398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:00.797397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:56659 (local address 127.15.36.193:33463)
0811 08:04:00.797481 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:00.797484 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:00.797492 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:04:00.797518 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:00.797519 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:00.797530 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:00.797581 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:04:00.797828 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.798565 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.800117 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.800596 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.800653 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:00.801291 (+ 638us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:04:00.801346 (+ 55us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:04:00.801386 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0811 08:04:00.801538 (+ 152us) server_negotiation.cc:299] Negotiation successful
0811 08:04:00.801569 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 08:04:00.802577 24470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:00.797139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.193:33463 (local address 127.15.36.194:56659)
0811 08:04:00.797357 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:00.797369 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:00.797423 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:00.797634 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:00.797635 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:00.797648 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 08:04:00.797725 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:00.797728 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.798685 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.798686 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:00.799866 (+ 1180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:00.799871 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.800727 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.800728 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:00.800811 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:00.800837 (+ 26us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 08:04:00.801453 (+ 616us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 08:04:00.801455 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 08:04:00.802288 (+ 833us) client_negotiation.cc:240] Negotiation successful
0811 08:04:00.802432 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":132,"threads_started":1}
I20260811 08:04:00.819965 23828 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59792:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:04:00.820139 23828 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59792:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:04:00.821347 23828 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7e3bec8f0c164e9aae3ea98efe747f43: Sending DeleteTablet for 3 replicas of tablet f9e6d9fb379b4ed59584d3edd83101e4
I20260811 08:04:00.821724 23982 tablet_service.cc:1514] Processing DeleteTablet for tablet f9e6d9fb379b4ed59584d3edd83101e4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:04:00 UTC) from {username='oryx', principal='oryx/127.15.36.254@KRBTEST.COM'} at 127.0.0.1:46792
I20260811 08:04:00.821841 24428 tablet_replica.cc:330] T f9e6d9fb379b4ed59584d3edd83101e4 P 405f04f35a9b4112b58e09f05a9ea44b: stopping tablet replica
I20260811 08:04:00.821902 24428 raft_consensus.cc:2229] T f9e6d9fb379b4ed59584d3edd83101e4 P 405f04f35a9b4112b58e09f05a9ea44b [term 1 LEADER]: Raft consensus shutting down.
I20260811 08:04:00.822016 24428 raft_consensus.cc:2258] T f9e6d9fb379b4ed59584d3edd83101e4 P 405f04f35a9b4112b58e09f05a9ea44b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:04:00.822351 24299 tablet_service.cc:1514] Processing DeleteTablet for tablet f9e6d9fb379b4ed59584d3edd83101e4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:04:00 UTC) from {username='oryx', principal='oryx/127.15.36.254@KRBTEST.COM'} at 127.0.0.1:34306
I20260811 08:04:00.822611 24428 ts_tablet_manager.cc:1905] T f9e6d9fb379b4ed59584d3edd83101e4 P 405f04f35a9b4112b58e09f05a9ea44b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:04:00.823033 24429 tablet_replica.cc:330] T f9e6d9fb379b4ed59584d3edd83101e4 P c16c1dbd34694d499b77890d7f0d79c9: stopping tablet replica
I20260811 08:04:00.823114 24429 raft_consensus.cc:2229] T f9e6d9fb379b4ed59584d3edd83101e4 P c16c1dbd34694d499b77890d7f0d79c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:04:00.823165 24429 raft_consensus.cc:2258] T f9e6d9fb379b4ed59584d3edd83101e4 P c16c1dbd34694d499b77890d7f0d79c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:04:00.823583 24429 ts_tablet_manager.cc:1905] T f9e6d9fb379b4ed59584d3edd83101e4 P c16c1dbd34694d499b77890d7f0d79c9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:04:00.826892 24141 tablet_service.cc:1514] Processing DeleteTablet for tablet f9e6d9fb379b4ed59584d3edd83101e4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:04:00 UTC) from {username='oryx', principal='oryx/127.15.36.254@KRBTEST.COM'} at 127.0.0.1:54268
I20260811 08:04:00.827101 24430 tablet_replica.cc:330] T f9e6d9fb379b4ed59584d3edd83101e4 P cfbf3cc525204c3ea2f2fbe2ef6f6926: stopping tablet replica
I20260811 08:04:00.827143 24429 ts_tablet_manager.cc:1918] T f9e6d9fb379b4ed59584d3edd83101e4 P c16c1dbd34694d499b77890d7f0d79c9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 08:04:00.827201 24430 raft_consensus.cc:2229] T f9e6d9fb379b4ed59584d3edd83101e4 P cfbf3cc525204c3ea2f2fbe2ef6f6926 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:04:00.827230 24429 log.cc:1196] T f9e6d9fb379b4ed59584d3edd83101e4 P c16c1dbd34694d499b77890d7f0d79c9: Deleting WAL directory at /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/ts-2/wal/wals/f9e6d9fb379b4ed59584d3edd83101e4
I20260811 08:04:00.827251 24430 raft_consensus.cc:2258] T f9e6d9fb379b4ed59584d3edd83101e4 P cfbf3cc525204c3ea2f2fbe2ef6f6926 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:04:00.827504 24429 ts_tablet_manager.cc:1939] T f9e6d9fb379b4ed59584d3edd83101e4 P c16c1dbd34694d499b77890d7f0d79c9: Deleting consensus metadata
I20260811 08:04:00.827705 24430 ts_tablet_manager.cc:1905] T f9e6d9fb379b4ed59584d3edd83101e4 P cfbf3cc525204c3ea2f2fbe2ef6f6926: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:04:00.828002 24428 ts_tablet_manager.cc:1918] T f9e6d9fb379b4ed59584d3edd83101e4 P 405f04f35a9b4112b58e09f05a9ea44b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 08:04:00.828073 24428 log.cc:1196] T f9e6d9fb379b4ed59584d3edd83101e4 P 405f04f35a9b4112b58e09f05a9ea44b: Deleting WAL directory at /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/ts-0/wal/wals/f9e6d9fb379b4ed59584d3edd83101e4
I20260811 08:04:00.828320 24428 ts_tablet_manager.cc:1939] T f9e6d9fb379b4ed59584d3edd83101e4 P 405f04f35a9b4112b58e09f05a9ea44b: Deleting consensus metadata
I20260811 08:04:00.828639 23810 catalog_manager.cc:4841] TS c16c1dbd34694d499b77890d7f0d79c9 (127.15.36.195:42727): tablet f9e6d9fb379b4ed59584d3edd83101e4 (table test-table [id=d273f624f87f4294b478e382c3b55946]) successfully deleted
I20260811 08:04:00.829413 23811 catalog_manager.cc:4841] TS 405f04f35a9b4112b58e09f05a9ea44b (127.15.36.193:33463): tablet f9e6d9fb379b4ed59584d3edd83101e4 (table test-table [id=d273f624f87f4294b478e382c3b55946]) successfully deleted
I20260811 08:04:00.829703 24430 ts_tablet_manager.cc:1918] T f9e6d9fb379b4ed59584d3edd83101e4 P cfbf3cc525204c3ea2f2fbe2ef6f6926: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 08:04:00.829777 24430 log.cc:1196] T f9e6d9fb379b4ed59584d3edd83101e4 P cfbf3cc525204c3ea2f2fbe2ef6f6926: Deleting WAL directory at /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/ts-1/wal/wals/f9e6d9fb379b4ed59584d3edd83101e4
I20260811 08:04:00.830034 24430 ts_tablet_manager.cc:1939] T f9e6d9fb379b4ed59584d3edd83101e4 P cfbf3cc525204c3ea2f2fbe2ef6f6926: Deleting consensus metadata
I20260811 08:04:00.830421 23813 catalog_manager.cc:4841] TS cfbf3cc525204c3ea2f2fbe2ef6f6926 (127.15.36.194:39961): tablet f9e6d9fb379b4ed59584d3edd83101e4 (table test-table [id=d273f624f87f4294b478e382c3b55946]) successfully deleted
Aug 11 08:04:00 dist-test-slave-2w3w krb5kdc[23777](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435440, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 08:04:00 dist-test-slave-2w3w krb5kdc[23777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:04:00 dist-test-slave-2w3w krb5kdc[23777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
W20260811 08:04:00.879531 23890 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:04:00.865996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59802 (local address 127.15.36.254:39763)
0811 08:04:00.866052 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:00.866054 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:00.866216 (+ 162us) server_negotiation.cc:407] Connection header received
0811 08:04:00.866418 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:00.866419 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:00.866434 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:00.866517 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:00.867639 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.869208 (+ 1569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.871465 (+ 2257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.872375 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.872486 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:00.879434 (+ 6948us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59802: BlockingRecv error: recv got EOF from 127.0.0.1:59802 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
Aug 11 08:04:00 dist-test-slave-2w3w krb5kdc[23777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435440, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM
I20260811 08:04:00.892455 23890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:00.881087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59814 (local address 127.15.36.254:39763)
0811 08:04:00.881135 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:00.881138 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:00.881364 (+ 226us) server_negotiation.cc:407] Connection header received
0811 08:04:00.881578 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:00.881580 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:00.881594 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:00.881631 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:00.883000 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.884097 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.885373 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.885585 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.885672 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:00.888970 (+ 3298us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:04:00.888972 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:04:00.888973 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:04:00.888990 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:04:00.890756 (+ 1766us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:04:00.891326 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:04:00.891332 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:04:00.891332 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:04:00.891396 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:04:00.891633 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:04:00.891634 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:04:00.891635 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:04:00.891779 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:04:00.891908 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0811 08:04:00.892168 (+ 260us) server_negotiation.cc:299] Negotiation successful
0811 08:04:00.892272 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 08:04:00.896116 23828 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59814:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:04:00.897246 23828 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:04:00.899698 24299 tablet_service.cc:1467] Processing CreateTablet for tablet 00d2c71153d34070a1679a5e5c46b32d (DEFAULT_TABLE table=test-table [id=f48e3c66703e47b9b5b17dbc66053f29]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:04:00.899698 23982 tablet_service.cc:1467] Processing CreateTablet for tablet 00d2c71153d34070a1679a5e5c46b32d (DEFAULT_TABLE table=test-table [id=f48e3c66703e47b9b5b17dbc66053f29]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:04:00.899734 24141 tablet_service.cc:1467] Processing CreateTablet for tablet 00d2c71153d34070a1679a5e5c46b32d (DEFAULT_TABLE table=test-table [id=f48e3c66703e47b9b5b17dbc66053f29]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:04:00.899868 23982 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00d2c71153d34070a1679a5e5c46b32d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:04:00.899868 24299 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00d2c71153d34070a1679a5e5c46b32d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:04:00.899879 24141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00d2c71153d34070a1679a5e5c46b32d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:04:00.901558 24401 tablet_bootstrap.cc:492] T 00d2c71153d34070a1679a5e5c46b32d P c16c1dbd34694d499b77890d7f0d79c9: Bootstrap starting.
I20260811 08:04:00.901997 24401 tablet_bootstrap.cc:654] T 00d2c71153d34070a1679a5e5c46b32d P c16c1dbd34694d499b77890d7f0d79c9: Neither blocks nor log segments found. Creating new log.
I20260811 08:04:00.902400 24402 tablet_bootstrap.cc:492] T 00d2c71153d34070a1679a5e5c46b32d P 405f04f35a9b4112b58e09f05a9ea44b: Bootstrap starting.
I20260811 08:04:00.902410 24404 tablet_bootstrap.cc:492] T 00d2c71153d34070a1679a5e5c46b32d P cfbf3cc525204c3ea2f2fbe2ef6f6926: Bootstrap starting.
I20260811 08:04:00.902823 24404 tablet_bootstrap.cc:654] T 00d2c71153d34070a1679a5e5c46b32d P cfbf3cc525204c3ea2f2fbe2ef6f6926: Neither blocks nor log segments found. Creating new log.
I20260811 08:04:00.902863 24402 tablet_bootstrap.cc:654] T 00d2c71153d34070a1679a5e5c46b32d P 405f04f35a9b4112b58e09f05a9ea44b: Neither blocks nor log segments found. Creating new log.
I20260811 08:04:00.903440 24401 tablet_bootstrap.cc:492] T 00d2c71153d34070a1679a5e5c46b32d P c16c1dbd34694d499b77890d7f0d79c9: No bootstrap required, opened a new log
I20260811 08:04:00.903505 24401 ts_tablet_manager.cc:1397] T 00d2c71153d34070a1679a5e5c46b32d P c16c1dbd34694d499b77890d7f0d79c9: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 08:04:00.903599 24404 tablet_bootstrap.cc:492] T 00d2c71153d34070a1679a5e5c46b32d P cfbf3cc525204c3ea2f2fbe2ef6f6926: No bootstrap required, opened a new log
I20260811 08:04:00.903643 24404 ts_tablet_manager.cc:1397] T 00d2c71153d34070a1679a5e5c46b32d P cfbf3cc525204c3ea2f2fbe2ef6f6926: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 08:04:00.903640 24401 raft_consensus.cc:348] T 00d2c71153d34070a1679a5e5c46b32d P c16c1dbd34694d499b77890d7f0d79c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "405f04f35a9b4112b58e09f05a9ea44b" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 33463 } } peers { permanent_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39961 } } peers { permanent_uuid: "c16c1dbd34694d499b77890d7f0d79c9" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42727 } }
I20260811 08:04:00.903726 24401 raft_consensus.cc:374] T 00d2c71153d34070a1679a5e5c46b32d P c16c1dbd34694d499b77890d7f0d79c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:04:00.903765 24401 raft_consensus.cc:729] T 00d2c71153d34070a1679a5e5c46b32d P c16c1dbd34694d499b77890d7f0d79c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c16c1dbd34694d499b77890d7f0d79c9, State: Initialized, Role: FOLLOWER
I20260811 08:04:00.903815 24401 consensus_queue.cc:260] T 00d2c71153d34070a1679a5e5c46b32d P c16c1dbd34694d499b77890d7f0d79c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "405f04f35a9b4112b58e09f05a9ea44b" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 33463 } } peers { permanent_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39961 } } peers { permanent_uuid: "c16c1dbd34694d499b77890d7f0d79c9" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42727 } }
I20260811 08:04:00.903820 24404 raft_consensus.cc:348] T 00d2c71153d34070a1679a5e5c46b32d P cfbf3cc525204c3ea2f2fbe2ef6f6926 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "405f04f35a9b4112b58e09f05a9ea44b" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 33463 } } peers { permanent_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39961 } } peers { permanent_uuid: "c16c1dbd34694d499b77890d7f0d79c9" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42727 } }
I20260811 08:04:00.903894 24404 raft_consensus.cc:374] T 00d2c71153d34070a1679a5e5c46b32d P cfbf3cc525204c3ea2f2fbe2ef6f6926 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:04:00.903916 24404 raft_consensus.cc:729] T 00d2c71153d34070a1679a5e5c46b32d P cfbf3cc525204c3ea2f2fbe2ef6f6926 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfbf3cc525204c3ea2f2fbe2ef6f6926, State: Initialized, Role: FOLLOWER
I20260811 08:04:00.903927 24401 ts_tablet_manager.cc:1428] T 00d2c71153d34070a1679a5e5c46b32d P c16c1dbd34694d499b77890d7f0d79c9: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 08:04:00.903963 24404 consensus_queue.cc:260] T 00d2c71153d34070a1679a5e5c46b32d P cfbf3cc525204c3ea2f2fbe2ef6f6926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "405f04f35a9b4112b58e09f05a9ea44b" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 33463 } } peers { permanent_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39961 } } peers { permanent_uuid: "c16c1dbd34694d499b77890d7f0d79c9" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42727 } }
I20260811 08:04:00.904076 24404 ts_tablet_manager.cc:1428] T 00d2c71153d34070a1679a5e5c46b32d P cfbf3cc525204c3ea2f2fbe2ef6f6926: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 08:04:00.907589 24402 tablet_bootstrap.cc:492] T 00d2c71153d34070a1679a5e5c46b32d P 405f04f35a9b4112b58e09f05a9ea44b: No bootstrap required, opened a new log
I20260811 08:04:00.907694 24402 ts_tablet_manager.cc:1397] T 00d2c71153d34070a1679a5e5c46b32d P 405f04f35a9b4112b58e09f05a9ea44b: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260811 08:04:00.907907 24402 raft_consensus.cc:348] T 00d2c71153d34070a1679a5e5c46b32d P 405f04f35a9b4112b58e09f05a9ea44b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "405f04f35a9b4112b58e09f05a9ea44b" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 33463 } } peers { permanent_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39961 } } peers { permanent_uuid: "c16c1dbd34694d499b77890d7f0d79c9" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42727 } }
I20260811 08:04:00.908025 24402 raft_consensus.cc:374] T 00d2c71153d34070a1679a5e5c46b32d P 405f04f35a9b4112b58e09f05a9ea44b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:04:00.908063 24402 raft_consensus.cc:729] T 00d2c71153d34070a1679a5e5c46b32d P 405f04f35a9b4112b58e09f05a9ea44b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 405f04f35a9b4112b58e09f05a9ea44b, State: Initialized, Role: FOLLOWER
I20260811 08:04:00.908115 24402 consensus_queue.cc:260] T 00d2c71153d34070a1679a5e5c46b32d P 405f04f35a9b4112b58e09f05a9ea44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "405f04f35a9b4112b58e09f05a9ea44b" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 33463 } } peers { permanent_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39961 } } peers { permanent_uuid: "c16c1dbd34694d499b77890d7f0d79c9" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42727 } }
I20260811 08:04:00.908248 24402 ts_tablet_manager.cc:1428] T 00d2c71153d34070a1679a5e5c46b32d P 405f04f35a9b4112b58e09f05a9ea44b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 08:04:00.975144 24438 raft_consensus.cc:482] T 00d2c71153d34070a1679a5e5c46b32d P 405f04f35a9b4112b58e09f05a9ea44b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:04:00.975266 24438 raft_consensus.cc:504] T 00d2c71153d34070a1679a5e5c46b32d P 405f04f35a9b4112b58e09f05a9ea44b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "405f04f35a9b4112b58e09f05a9ea44b" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 33463 } } peers { permanent_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39961 } } peers { permanent_uuid: "c16c1dbd34694d499b77890d7f0d79c9" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42727 } }
I20260811 08:04:00.975462 24438 leader_election.cc:288] T 00d2c71153d34070a1679a5e5c46b32d P 405f04f35a9b4112b58e09f05a9ea44b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfbf3cc525204c3ea2f2fbe2ef6f6926 (127.15.36.194:39961), c16c1dbd34694d499b77890d7f0d79c9 (127.15.36.195:42727)
I20260811 08:04:00.975687 24166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d2c71153d34070a1679a5e5c46b32d" candidate_uuid: "405f04f35a9b4112b58e09f05a9ea44b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" is_pre_election: true
I20260811 08:04:00.975709 24321 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d2c71153d34070a1679a5e5c46b32d" candidate_uuid: "405f04f35a9b4112b58e09f05a9ea44b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c16c1dbd34694d499b77890d7f0d79c9" is_pre_election: true
I20260811 08:04:00.975790 24166 raft_consensus.cc:2454] T 00d2c71153d34070a1679a5e5c46b32d P cfbf3cc525204c3ea2f2fbe2ef6f6926 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 405f04f35a9b4112b58e09f05a9ea44b in term 0.
I20260811 08:04:00.975808 24321 raft_consensus.cc:2454] T 00d2c71153d34070a1679a5e5c46b32d P c16c1dbd34694d499b77890d7f0d79c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 405f04f35a9b4112b58e09f05a9ea44b in term 0.
I20260811 08:04:00.976022 23929 leader_election.cc:302] T 00d2c71153d34070a1679a5e5c46b32d P 405f04f35a9b4112b58e09f05a9ea44b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 405f04f35a9b4112b58e09f05a9ea44b, c16c1dbd34694d499b77890d7f0d79c9; no voters:
I20260811 08:04:00.976181 24438 raft_consensus.cc:2781] T 00d2c71153d34070a1679a5e5c46b32d P 405f04f35a9b4112b58e09f05a9ea44b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:04:00.976241 24438 raft_consensus.cc:482] T 00d2c71153d34070a1679a5e5c46b32d P 405f04f35a9b4112b58e09f05a9ea44b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:04:00.976263 24438 raft_consensus.cc:3037] T 00d2c71153d34070a1679a5e5c46b32d P 405f04f35a9b4112b58e09f05a9ea44b [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:04:00.977433 24438 raft_consensus.cc:504] T 00d2c71153d34070a1679a5e5c46b32d P 405f04f35a9b4112b58e09f05a9ea44b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "405f04f35a9b4112b58e09f05a9ea44b" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 33463 } } peers { permanent_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39961 } } peers { permanent_uuid: "c16c1dbd34694d499b77890d7f0d79c9" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42727 } }
I20260811 08:04:00.977612 24438 leader_election.cc:288] T 00d2c71153d34070a1679a5e5c46b32d P 405f04f35a9b4112b58e09f05a9ea44b [CANDIDATE]: Term 1 election: Requested vote from peers cfbf3cc525204c3ea2f2fbe2ef6f6926 (127.15.36.194:39961), c16c1dbd34694d499b77890d7f0d79c9 (127.15.36.195:42727)
I20260811 08:04:00.977927 24321 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d2c71153d34070a1679a5e5c46b32d" candidate_uuid: "405f04f35a9b4112b58e09f05a9ea44b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c16c1dbd34694d499b77890d7f0d79c9"
I20260811 08:04:00.978017 24321 raft_consensus.cc:3037] T 00d2c71153d34070a1679a5e5c46b32d P c16c1dbd34694d499b77890d7f0d79c9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:04:00.978113 24166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d2c71153d34070a1679a5e5c46b32d" candidate_uuid: "405f04f35a9b4112b58e09f05a9ea44b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926"
I20260811 08:04:00.978202 24166 raft_consensus.cc:3037] T 00d2c71153d34070a1679a5e5c46b32d P cfbf3cc525204c3ea2f2fbe2ef6f6926 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:04:00.979079 24166 raft_consensus.cc:2454] T 00d2c71153d34070a1679a5e5c46b32d P cfbf3cc525204c3ea2f2fbe2ef6f6926 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 405f04f35a9b4112b58e09f05a9ea44b in term 1.
I20260811 08:04:00.979084 24321 raft_consensus.cc:2454] T 00d2c71153d34070a1679a5e5c46b32d P c16c1dbd34694d499b77890d7f0d79c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 405f04f35a9b4112b58e09f05a9ea44b in term 1.
I20260811 08:04:00.979313 23929 leader_election.cc:302] T 00d2c71153d34070a1679a5e5c46b32d P 405f04f35a9b4112b58e09f05a9ea44b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 405f04f35a9b4112b58e09f05a9ea44b, c16c1dbd34694d499b77890d7f0d79c9; no voters:
I20260811 08:04:00.979419 24438 raft_consensus.cc:2781] T 00d2c71153d34070a1679a5e5c46b32d P 405f04f35a9b4112b58e09f05a9ea44b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:04:00.979468 24438 raft_consensus.cc:686] T 00d2c71153d34070a1679a5e5c46b32d P 405f04f35a9b4112b58e09f05a9ea44b [term 1 LEADER]: Becoming Leader. State: Replica: 405f04f35a9b4112b58e09f05a9ea44b, State: Running, Role: LEADER
I20260811 08:04:00.979524 24438 consensus_queue.cc:237] T 00d2c71153d34070a1679a5e5c46b32d P 405f04f35a9b4112b58e09f05a9ea44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "405f04f35a9b4112b58e09f05a9ea44b" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 33463 } } peers { permanent_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39961 } } peers { permanent_uuid: "c16c1dbd34694d499b77890d7f0d79c9" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42727 } }
I20260811 08:04:00.980348 23828 catalog_manager.cc:5495] T 00d2c71153d34070a1679a5e5c46b32d P 405f04f35a9b4112b58e09f05a9ea44b reported cstate change: term changed from 0 to 1, leader changed from <none> to 405f04f35a9b4112b58e09f05a9ea44b (127.15.36.193). New cstate: current_term: 1 leader_uuid: "405f04f35a9b4112b58e09f05a9ea44b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "405f04f35a9b4112b58e09f05a9ea44b" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 33463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c16c1dbd34694d499b77890d7f0d79c9" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42727 } health_report { overall_health: UNKNOWN } } }
I20260811 08:04:00.987612 24398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:00.984343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46816 (local address 127.15.36.193:33463)
0811 08:04:00.984399 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:00.984401 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:00.984413 (+ 12us) server_negotiation.cc:407] Connection header received
0811 08:04:00.984441 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:00.984442 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:00.984455 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:00.984516 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:04:00.984702 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.985340 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.986598 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:00.986856 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:00.986937 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:00.987253 (+ 316us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:04:00.987302 (+ 49us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:04:00.987384 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 08:04:00.987482 (+ 98us) server_negotiation.cc:299] Negotiation successful
0811 08:04:00.987514 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 08:04:00.988776 24166 raft_consensus.cc:1261] T 00d2c71153d34070a1679a5e5c46b32d P cfbf3cc525204c3ea2f2fbe2ef6f6926 [term 1 FOLLOWER]: Refusing update from remote peer 405f04f35a9b4112b58e09f05a9ea44b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:04:00.988799 24321 raft_consensus.cc:1261] T 00d2c71153d34070a1679a5e5c46b32d P c16c1dbd34694d499b77890d7f0d79c9 [term 1 FOLLOWER]: Refusing update from remote peer 405f04f35a9b4112b58e09f05a9ea44b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:04:00.989058 24438 consensus_queue.cc:1035] T 00d2c71153d34070a1679a5e5c46b32d P 405f04f35a9b4112b58e09f05a9ea44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c16c1dbd34694d499b77890d7f0d79c9" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:04:00.989210 24411 consensus_queue.cc:1035] T 00d2c71153d34070a1679a5e5c46b32d P 405f04f35a9b4112b58e09f05a9ea44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:04:00.993089 23827 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59814:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:04:00.993242 23827 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59814:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:04:00.994324 23827 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7e3bec8f0c164e9aae3ea98efe747f43: Sending DeleteTablet for 3 replicas of tablet 00d2c71153d34070a1679a5e5c46b32d
I20260811 08:04:00.995738 24299 tablet_service.cc:1514] Processing DeleteTablet for tablet 00d2c71153d34070a1679a5e5c46b32d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:04:00 UTC) from {username='oryx', principal='oryx/127.15.36.254@KRBTEST.COM'} at 127.0.0.1:34306
I20260811 08:04:00.995883 24429 tablet_replica.cc:330] T 00d2c71153d34070a1679a5e5c46b32d P c16c1dbd34694d499b77890d7f0d79c9: stopping tablet replica
I20260811 08:04:00.995939 24429 raft_consensus.cc:2229] T 00d2c71153d34070a1679a5e5c46b32d P c16c1dbd34694d499b77890d7f0d79c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:04:00.995990 24429 raft_consensus.cc:2258] T 00d2c71153d34070a1679a5e5c46b32d P c16c1dbd34694d499b77890d7f0d79c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:04:00.996788 24429 ts_tablet_manager.cc:1905] T 00d2c71153d34070a1679a5e5c46b32d P c16c1dbd34694d499b77890d7f0d79c9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:04:00.996822 24141 tablet_service.cc:1514] Processing DeleteTablet for tablet 00d2c71153d34070a1679a5e5c46b32d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:04:00 UTC) from {username='oryx', principal='oryx/127.15.36.254@KRBTEST.COM'} at 127.0.0.1:54268
I20260811 08:04:00.997148 23982 tablet_service.cc:1514] Processing DeleteTablet for tablet 00d2c71153d34070a1679a5e5c46b32d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:04:00 UTC) from {username='oryx', principal='oryx/127.15.36.254@KRBTEST.COM'} at 127.0.0.1:46792
I20260811 08:04:00.997289 24428 tablet_replica.cc:330] T 00d2c71153d34070a1679a5e5c46b32d P 405f04f35a9b4112b58e09f05a9ea44b: stopping tablet replica
I20260811 08:04:00.996960 24430 tablet_replica.cc:330] T 00d2c71153d34070a1679a5e5c46b32d P cfbf3cc525204c3ea2f2fbe2ef6f6926: stopping tablet replica
I20260811 08:04:00.997361 24428 raft_consensus.cc:2229] T 00d2c71153d34070a1679a5e5c46b32d P 405f04f35a9b4112b58e09f05a9ea44b [term 1 LEADER]: Raft consensus shutting down.
I20260811 08:04:00.997404 24430 raft_consensus.cc:2229] T 00d2c71153d34070a1679a5e5c46b32d P cfbf3cc525204c3ea2f2fbe2ef6f6926 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:04:00.997438 24428 raft_consensus.cc:2258] T 00d2c71153d34070a1679a5e5c46b32d P 405f04f35a9b4112b58e09f05a9ea44b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:04:00.997506 24430 raft_consensus.cc:2258] T 00d2c71153d34070a1679a5e5c46b32d P cfbf3cc525204c3ea2f2fbe2ef6f6926 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:04:00.997855 24428 ts_tablet_manager.cc:1905] T 00d2c71153d34070a1679a5e5c46b32d P 405f04f35a9b4112b58e09f05a9ea44b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:04:00.997956 24430 ts_tablet_manager.cc:1905] T 00d2c71153d34070a1679a5e5c46b32d P cfbf3cc525204c3ea2f2fbe2ef6f6926: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:04:01.000231 24429 ts_tablet_manager.cc:1918] T 00d2c71153d34070a1679a5e5c46b32d P c16c1dbd34694d499b77890d7f0d79c9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:04:01.000334 24429 log.cc:1196] T 00d2c71153d34070a1679a5e5c46b32d P c16c1dbd34694d499b77890d7f0d79c9: Deleting WAL directory at /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/ts-2/wal/wals/00d2c71153d34070a1679a5e5c46b32d
I20260811 08:04:01.000586 24429 ts_tablet_manager.cc:1939] T 00d2c71153d34070a1679a5e5c46b32d P c16c1dbd34694d499b77890d7f0d79c9: Deleting consensus metadata
I20260811 08:04:01.000658 24430 ts_tablet_manager.cc:1918] T 00d2c71153d34070a1679a5e5c46b32d P cfbf3cc525204c3ea2f2fbe2ef6f6926: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:04:01.000715 24430 log.cc:1196] T 00d2c71153d34070a1679a5e5c46b32d P cfbf3cc525204c3ea2f2fbe2ef6f6926: Deleting WAL directory at /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/ts-1/wal/wals/00d2c71153d34070a1679a5e5c46b32d
I20260811 08:04:01.000814 23827 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59814:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 08:04:01.001051 24430 ts_tablet_manager.cc:1939] T 00d2c71153d34070a1679a5e5c46b32d P cfbf3cc525204c3ea2f2fbe2ef6f6926: Deleting consensus metadata
W20260811 08:04:01.001138 23827 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:04:01.001893 23813 catalog_manager.cc:4841] TS cfbf3cc525204c3ea2f2fbe2ef6f6926 (127.15.36.194:39961): tablet 00d2c71153d34070a1679a5e5c46b32d (table test-table [id=f48e3c66703e47b9b5b17dbc66053f29]) successfully deleted
I20260811 08:04:01.002208 24428 ts_tablet_manager.cc:1918] T 00d2c71153d34070a1679a5e5c46b32d P 405f04f35a9b4112b58e09f05a9ea44b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:04:01.002291 24428 log.cc:1196] T 00d2c71153d34070a1679a5e5c46b32d P 405f04f35a9b4112b58e09f05a9ea44b: Deleting WAL directory at /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/ts-0/wal/wals/00d2c71153d34070a1679a5e5c46b32d
I20260811 08:04:01.002722 24428 ts_tablet_manager.cc:1939] T 00d2c71153d34070a1679a5e5c46b32d P 405f04f35a9b4112b58e09f05a9ea44b: Deleting consensus metadata
I20260811 08:04:01.002815 24141 tablet_service.cc:1467] Processing CreateTablet for tablet 238376614fe54205b8c56c8dc72f96a1 (DEFAULT_TABLE table=test-table [id=ce7ad68f8eeb48f689b313d51a258ed6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:04:01.002815 23982 tablet_service.cc:1467] Processing CreateTablet for tablet 238376614fe54205b8c56c8dc72f96a1 (DEFAULT_TABLE table=test-table [id=ce7ad68f8eeb48f689b313d51a258ed6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:04:01.003130 23982 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 238376614fe54205b8c56c8dc72f96a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:04:01.003130 24141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 238376614fe54205b8c56c8dc72f96a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:04:01.004231 23811 catalog_manager.cc:4841] TS 405f04f35a9b4112b58e09f05a9ea44b (127.15.36.193:33463): tablet 00d2c71153d34070a1679a5e5c46b32d (table test-table [id=f48e3c66703e47b9b5b17dbc66053f29]) successfully deleted
I20260811 08:04:01.004621 24404 tablet_bootstrap.cc:492] T 238376614fe54205b8c56c8dc72f96a1 P cfbf3cc525204c3ea2f2fbe2ef6f6926: Bootstrap starting.
I20260811 08:04:01.004721 24402 tablet_bootstrap.cc:492] T 238376614fe54205b8c56c8dc72f96a1 P 405f04f35a9b4112b58e09f05a9ea44b: Bootstrap starting.
I20260811 08:04:01.005149 24404 tablet_bootstrap.cc:654] T 238376614fe54205b8c56c8dc72f96a1 P cfbf3cc525204c3ea2f2fbe2ef6f6926: Neither blocks nor log segments found. Creating new log.
I20260811 08:04:01.005259 24402 tablet_bootstrap.cc:654] T 238376614fe54205b8c56c8dc72f96a1 P 405f04f35a9b4112b58e09f05a9ea44b: Neither blocks nor log segments found. Creating new log.
I20260811 08:04:01.008689 24299 tablet_service.cc:1467] Processing CreateTablet for tablet 238376614fe54205b8c56c8dc72f96a1 (DEFAULT_TABLE table=test-table [id=ce7ad68f8eeb48f689b313d51a258ed6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:04:01.008888 24299 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 238376614fe54205b8c56c8dc72f96a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:04:01.010192 24401 tablet_bootstrap.cc:492] T 238376614fe54205b8c56c8dc72f96a1 P c16c1dbd34694d499b77890d7f0d79c9: Bootstrap starting.
I20260811 08:04:01.010250 23810 catalog_manager.cc:4841] TS c16c1dbd34694d499b77890d7f0d79c9 (127.15.36.195:42727): tablet 00d2c71153d34070a1679a5e5c46b32d (table test-table [id=f48e3c66703e47b9b5b17dbc66053f29]) successfully deleted
I20260811 08:04:01.010596 24401 tablet_bootstrap.cc:654] T 238376614fe54205b8c56c8dc72f96a1 P c16c1dbd34694d499b77890d7f0d79c9: Neither blocks nor log segments found. Creating new log.
I20260811 08:04:01.011255 24404 tablet_bootstrap.cc:492] T 238376614fe54205b8c56c8dc72f96a1 P cfbf3cc525204c3ea2f2fbe2ef6f6926: No bootstrap required, opened a new log
I20260811 08:04:01.011332 24404 ts_tablet_manager.cc:1397] T 238376614fe54205b8c56c8dc72f96a1 P cfbf3cc525204c3ea2f2fbe2ef6f6926: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.001s
I20260811 08:04:01.011473 24404 raft_consensus.cc:348] T 238376614fe54205b8c56c8dc72f96a1 P cfbf3cc525204c3ea2f2fbe2ef6f6926 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "405f04f35a9b4112b58e09f05a9ea44b" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 33463 } } peers { permanent_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39961 } } peers { permanent_uuid: "c16c1dbd34694d499b77890d7f0d79c9" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42727 } }
I20260811 08:04:01.011579 24404 raft_consensus.cc:374] T 238376614fe54205b8c56c8dc72f96a1 P cfbf3cc525204c3ea2f2fbe2ef6f6926 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:04:01.011603 24404 raft_consensus.cc:729] T 238376614fe54205b8c56c8dc72f96a1 P cfbf3cc525204c3ea2f2fbe2ef6f6926 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfbf3cc525204c3ea2f2fbe2ef6f6926, State: Initialized, Role: FOLLOWER
I20260811 08:04:01.011655 24404 consensus_queue.cc:260] T 238376614fe54205b8c56c8dc72f96a1 P cfbf3cc525204c3ea2f2fbe2ef6f6926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "405f04f35a9b4112b58e09f05a9ea44b" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 33463 } } peers { permanent_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39961 } } peers { permanent_uuid: "c16c1dbd34694d499b77890d7f0d79c9" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42727 } }
I20260811 08:04:01.011763 24404 ts_tablet_manager.cc:1428] T 238376614fe54205b8c56c8dc72f96a1 P cfbf3cc525204c3ea2f2fbe2ef6f6926: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 08:04:01.016338 24402 tablet_bootstrap.cc:492] T 238376614fe54205b8c56c8dc72f96a1 P 405f04f35a9b4112b58e09f05a9ea44b: No bootstrap required, opened a new log
I20260811 08:04:01.016485 24401 tablet_bootstrap.cc:492] T 238376614fe54205b8c56c8dc72f96a1 P c16c1dbd34694d499b77890d7f0d79c9: No bootstrap required, opened a new log
I20260811 08:04:01.016485 24402 ts_tablet_manager.cc:1397] T 238376614fe54205b8c56c8dc72f96a1 P 405f04f35a9b4112b58e09f05a9ea44b: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.000s
I20260811 08:04:01.016534 24401 ts_tablet_manager.cc:1397] T 238376614fe54205b8c56c8dc72f96a1 P c16c1dbd34694d499b77890d7f0d79c9: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20260811 08:04:01.016669 24401 raft_consensus.cc:348] T 238376614fe54205b8c56c8dc72f96a1 P c16c1dbd34694d499b77890d7f0d79c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "405f04f35a9b4112b58e09f05a9ea44b" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 33463 } } peers { permanent_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39961 } } peers { permanent_uuid: "c16c1dbd34694d499b77890d7f0d79c9" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42727 } }
I20260811 08:04:01.016695 24402 raft_consensus.cc:348] T 238376614fe54205b8c56c8dc72f96a1 P 405f04f35a9b4112b58e09f05a9ea44b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "405f04f35a9b4112b58e09f05a9ea44b" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 33463 } } peers { permanent_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39961 } } peers { permanent_uuid: "c16c1dbd34694d499b77890d7f0d79c9" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42727 } }
I20260811 08:04:01.016749 24401 raft_consensus.cc:374] T 238376614fe54205b8c56c8dc72f96a1 P c16c1dbd34694d499b77890d7f0d79c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:04:01.016772 24401 raft_consensus.cc:729] T 238376614fe54205b8c56c8dc72f96a1 P c16c1dbd34694d499b77890d7f0d79c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c16c1dbd34694d499b77890d7f0d79c9, State: Initialized, Role: FOLLOWER
I20260811 08:04:01.016770 24402 raft_consensus.cc:374] T 238376614fe54205b8c56c8dc72f96a1 P 405f04f35a9b4112b58e09f05a9ea44b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:04:01.016799 24402 raft_consensus.cc:729] T 238376614fe54205b8c56c8dc72f96a1 P 405f04f35a9b4112b58e09f05a9ea44b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 405f04f35a9b4112b58e09f05a9ea44b, State: Initialized, Role: FOLLOWER
I20260811 08:04:01.016824 24401 consensus_queue.cc:260] T 238376614fe54205b8c56c8dc72f96a1 P c16c1dbd34694d499b77890d7f0d79c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "405f04f35a9b4112b58e09f05a9ea44b" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 33463 } } peers { permanent_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39961 } } peers { permanent_uuid: "c16c1dbd34694d499b77890d7f0d79c9" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42727 } }
I20260811 08:04:01.016848 24402 consensus_queue.cc:260] T 238376614fe54205b8c56c8dc72f96a1 P 405f04f35a9b4112b58e09f05a9ea44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "405f04f35a9b4112b58e09f05a9ea44b" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 33463 } } peers { permanent_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39961 } } peers { permanent_uuid: "c16c1dbd34694d499b77890d7f0d79c9" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42727 } }
I20260811 08:04:01.016938 24401 ts_tablet_manager.cc:1428] T 238376614fe54205b8c56c8dc72f96a1 P c16c1dbd34694d499b77890d7f0d79c9: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 08:04:01.016954 24402 ts_tablet_manager.cc:1428] T 238376614fe54205b8c56c8dc72f96a1 P 405f04f35a9b4112b58e09f05a9ea44b: Time spent starting tablet: real 0.000s user 0.001s sys 0.001s
I20260811 08:04:01.143800 24413 raft_consensus.cc:482] T 238376614fe54205b8c56c8dc72f96a1 P c16c1dbd34694d499b77890d7f0d79c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:04:01.143919 24413 raft_consensus.cc:504] T 238376614fe54205b8c56c8dc72f96a1 P c16c1dbd34694d499b77890d7f0d79c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "405f04f35a9b4112b58e09f05a9ea44b" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 33463 } } peers { permanent_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39961 } } peers { permanent_uuid: "c16c1dbd34694d499b77890d7f0d79c9" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42727 } }
I20260811 08:04:01.144119 24413 leader_election.cc:288] T 238376614fe54205b8c56c8dc72f96a1 P c16c1dbd34694d499b77890d7f0d79c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 405f04f35a9b4112b58e09f05a9ea44b (127.15.36.193:33463), cfbf3cc525204c3ea2f2fbe2ef6f6926 (127.15.36.194:39961)
I20260811 08:04:01.144364 24007 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "238376614fe54205b8c56c8dc72f96a1" candidate_uuid: "c16c1dbd34694d499b77890d7f0d79c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "405f04f35a9b4112b58e09f05a9ea44b" is_pre_election: true
I20260811 08:04:01.144394 24166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "238376614fe54205b8c56c8dc72f96a1" candidate_uuid: "c16c1dbd34694d499b77890d7f0d79c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" is_pre_election: true
I20260811 08:04:01.144495 24007 raft_consensus.cc:2454] T 238376614fe54205b8c56c8dc72f96a1 P 405f04f35a9b4112b58e09f05a9ea44b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c16c1dbd34694d499b77890d7f0d79c9 in term 0.
I20260811 08:04:01.144513 24166 raft_consensus.cc:2454] T 238376614fe54205b8c56c8dc72f96a1 P cfbf3cc525204c3ea2f2fbe2ef6f6926 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c16c1dbd34694d499b77890d7f0d79c9 in term 0.
I20260811 08:04:01.144678 24246 leader_election.cc:302] T 238376614fe54205b8c56c8dc72f96a1 P c16c1dbd34694d499b77890d7f0d79c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 405f04f35a9b4112b58e09f05a9ea44b, c16c1dbd34694d499b77890d7f0d79c9; no voters:
I20260811 08:04:01.144811 24413 raft_consensus.cc:2781] T 238376614fe54205b8c56c8dc72f96a1 P c16c1dbd34694d499b77890d7f0d79c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:04:01.144862 24413 raft_consensus.cc:482] T 238376614fe54205b8c56c8dc72f96a1 P c16c1dbd34694d499b77890d7f0d79c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:04:01.144889 24413 raft_consensus.cc:3037] T 238376614fe54205b8c56c8dc72f96a1 P c16c1dbd34694d499b77890d7f0d79c9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:04:01.145807 24413 raft_consensus.cc:504] T 238376614fe54205b8c56c8dc72f96a1 P c16c1dbd34694d499b77890d7f0d79c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "405f04f35a9b4112b58e09f05a9ea44b" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 33463 } } peers { permanent_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39961 } } peers { permanent_uuid: "c16c1dbd34694d499b77890d7f0d79c9" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42727 } }
I20260811 08:04:01.146054 24413 leader_election.cc:288] T 238376614fe54205b8c56c8dc72f96a1 P c16c1dbd34694d499b77890d7f0d79c9 [CANDIDATE]: Term 1 election: Requested vote from peers 405f04f35a9b4112b58e09f05a9ea44b (127.15.36.193:33463), cfbf3cc525204c3ea2f2fbe2ef6f6926 (127.15.36.194:39961)
I20260811 08:04:01.146216 24007 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "238376614fe54205b8c56c8dc72f96a1" candidate_uuid: "c16c1dbd34694d499b77890d7f0d79c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "405f04f35a9b4112b58e09f05a9ea44b"
I20260811 08:04:01.146358 24007 raft_consensus.cc:3037] T 238376614fe54205b8c56c8dc72f96a1 P 405f04f35a9b4112b58e09f05a9ea44b [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:04:01.146323 24166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "238376614fe54205b8c56c8dc72f96a1" candidate_uuid: "c16c1dbd34694d499b77890d7f0d79c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926"
I20260811 08:04:01.146449 24166 raft_consensus.cc:3037] T 238376614fe54205b8c56c8dc72f96a1 P cfbf3cc525204c3ea2f2fbe2ef6f6926 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:04:01.147248 24166 raft_consensus.cc:2454] T 238376614fe54205b8c56c8dc72f96a1 P cfbf3cc525204c3ea2f2fbe2ef6f6926 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c16c1dbd34694d499b77890d7f0d79c9 in term 1.
I20260811 08:04:01.147398 24007 raft_consensus.cc:2454] T 238376614fe54205b8c56c8dc72f96a1 P 405f04f35a9b4112b58e09f05a9ea44b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c16c1dbd34694d499b77890d7f0d79c9 in term 1.
I20260811 08:04:01.147490 24248 leader_election.cc:302] T 238376614fe54205b8c56c8dc72f96a1 P c16c1dbd34694d499b77890d7f0d79c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c16c1dbd34694d499b77890d7f0d79c9, cfbf3cc525204c3ea2f2fbe2ef6f6926; no voters:
I20260811 08:04:01.147631 24413 raft_consensus.cc:2781] T 238376614fe54205b8c56c8dc72f96a1 P c16c1dbd34694d499b77890d7f0d79c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:04:01.147766 24413 raft_consensus.cc:686] T 238376614fe54205b8c56c8dc72f96a1 P c16c1dbd34694d499b77890d7f0d79c9 [term 1 LEADER]: Becoming Leader. State: Replica: c16c1dbd34694d499b77890d7f0d79c9, State: Running, Role: LEADER
I20260811 08:04:01.147838 24413 consensus_queue.cc:237] T 238376614fe54205b8c56c8dc72f96a1 P c16c1dbd34694d499b77890d7f0d79c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "405f04f35a9b4112b58e09f05a9ea44b" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 33463 } } peers { permanent_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39961 } } peers { permanent_uuid: "c16c1dbd34694d499b77890d7f0d79c9" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42727 } }
I20260811 08:04:01.148699 23827 catalog_manager.cc:5495] T 238376614fe54205b8c56c8dc72f96a1 P c16c1dbd34694d499b77890d7f0d79c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to c16c1dbd34694d499b77890d7f0d79c9 (127.15.36.195). New cstate: current_term: 1 leader_uuid: "c16c1dbd34694d499b77890d7f0d79c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "405f04f35a9b4112b58e09f05a9ea44b" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 33463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c16c1dbd34694d499b77890d7f0d79c9" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 42727 } health_report { overall_health: HEALTHY } } }
I20260811 08:04:01.178028 24397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:01.175548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34322 (local address 127.15.36.195:42727)
0811 08:04:01.175595 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:01.175597 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:01.175607 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:04:01.175730 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:01.175731 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:01.175741 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:01.175806 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:04:01.175959 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:01.176513 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:01.177250 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:01.177509 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:01.177592 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:01.177743 (+ 151us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:04:01.177786 (+ 43us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:04:01.177840 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 08:04:01.177919 (+ 79us) server_negotiation.cc:299] Negotiation successful
0811 08:04:01.177940 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 08:04:01.185464 24400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:01.181917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:58287 (local address 127.15.36.194:39961)
0811 08:04:01.182000 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:01.182002 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:01.182130 (+ 128us) server_negotiation.cc:407] Connection header received
0811 08:04:01.182164 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:01.182165 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:01.182177 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:01.182229 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:04:01.182539 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:01.183223 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:01.184583 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:01.184809 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:01.184878 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:01.185148 (+ 270us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:04:01.185186 (+ 38us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:04:01.185248 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 08:04:01.185357 (+ 109us) server_negotiation.cc:299] Negotiation successful
0811 08:04:01.185384 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 08:04:01.185519 24502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:01.181740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.194:39961 (local address 127.15.36.195:58287)
0811 08:04:01.181967 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:01.181993 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:01.182069 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:01.182254 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:01.182255 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:01.182257 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 08:04:01.182420 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:01.182424 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:01.183307 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:01.183308 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:01.184438 (+ 1130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:01.184443 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:01.184902 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:01.184903 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:01.184979 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:01.185010 (+ 31us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 08:04:01.185264 (+ 254us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 08:04:01.185266 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 08:04:01.185320 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 08:04:01.185385 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":121,"threads_started":1}
I20260811 08:04:01.188436 24166 raft_consensus.cc:1261] T 238376614fe54205b8c56c8dc72f96a1 P cfbf3cc525204c3ea2f2fbe2ef6f6926 [term 1 FOLLOWER]: Refusing update from remote peer c16c1dbd34694d499b77890d7f0d79c9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:04:01.188841 24007 raft_consensus.cc:1261] T 238376614fe54205b8c56c8dc72f96a1 P 405f04f35a9b4112b58e09f05a9ea44b [term 1 FOLLOWER]: Refusing update from remote peer c16c1dbd34694d499b77890d7f0d79c9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:04:01.188792 24413 consensus_queue.cc:1035] T 238376614fe54205b8c56c8dc72f96a1 P c16c1dbd34694d499b77890d7f0d79c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfbf3cc525204c3ea2f2fbe2ef6f6926" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:04:01.189205 24413 consensus_queue.cc:1035] T 238376614fe54205b8c56c8dc72f96a1 P c16c1dbd34694d499b77890d7f0d79c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "405f04f35a9b4112b58e09f05a9ea44b" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 33463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:04:01.202541 24470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:01.197158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.195:42727 (local address 127.15.36.194:34365)
0811 08:04:01.197210 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:01.197221 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:01.197262 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:01.197497 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:01.197498 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:01.197500 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 08:04:01.197554 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:01.197556 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:01.199820 (+ 2264us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:01.199821 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:01.200455 (+ 634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:01.200457 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:01.201223 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:01.201224 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:01.201994 (+ 770us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:01.202010 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 08:04:01.202276 (+ 266us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 08:04:01.202278 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 08:04:01.202326 (+ 48us) client_negotiation.cc:240] Negotiation successful
0811 08:04:01.202399 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260811 08:04:01.202860 24397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:01.197320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:34365 (local address 127.15.36.195:42727)
0811 08:04:01.197375 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:01.197377 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:01.197384 (+ 7us) server_negotiation.cc:407] Connection header received
0811 08:04:01.197406 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:01.197407 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:01.197417 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:01.197493 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:04:01.197606 (+ 113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:01.199647 (+ 2041us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:01.200568 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:01.201087 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:01.201176 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:01.202138 (+ 962us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:04:01.202192 (+ 54us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:04:01.202248 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 08:04:01.202700 (+ 452us) server_negotiation.cc:299] Negotiation successful
0811 08:04:01.202736 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 08:04:01.215317 23830 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59814:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:04:01.215528 23830 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59814:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:04:01.217021 23830 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7e3bec8f0c164e9aae3ea98efe747f43: Sending DeleteTablet for 3 replicas of tablet 238376614fe54205b8c56c8dc72f96a1
I20260811 08:04:01.217583 24141 tablet_service.cc:1514] Processing DeleteTablet for tablet 238376614fe54205b8c56c8dc72f96a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:04:01 UTC) from {username='oryx', principal='oryx/127.15.36.254@KRBTEST.COM'} at 127.0.0.1:54268
I20260811 08:04:01.217722 24430 tablet_replica.cc:330] T 238376614fe54205b8c56c8dc72f96a1 P cfbf3cc525204c3ea2f2fbe2ef6f6926: stopping tablet replica
I20260811 08:04:01.217787 24430 raft_consensus.cc:2229] T 238376614fe54205b8c56c8dc72f96a1 P cfbf3cc525204c3ea2f2fbe2ef6f6926 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:04:01.217836 24430 raft_consensus.cc:2258] T 238376614fe54205b8c56c8dc72f96a1 P cfbf3cc525204c3ea2f2fbe2ef6f6926 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:04:01.217809 23982 tablet_service.cc:1514] Processing DeleteTablet for tablet 238376614fe54205b8c56c8dc72f96a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:04:01 UTC) from {username='oryx', principal='oryx/127.15.36.254@KRBTEST.COM'} at 127.0.0.1:46792
I20260811 08:04:01.218030 24428 tablet_replica.cc:330] T 238376614fe54205b8c56c8dc72f96a1 P 405f04f35a9b4112b58e09f05a9ea44b: stopping tablet replica
I20260811 08:04:01.218354 24428 raft_consensus.cc:2229] T 238376614fe54205b8c56c8dc72f96a1 P 405f04f35a9b4112b58e09f05a9ea44b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:04:01.218449 24428 raft_consensus.cc:2258] T 238376614fe54205b8c56c8dc72f96a1 P 405f04f35a9b4112b58e09f05a9ea44b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:04:01.219070 24430 ts_tablet_manager.cc:1905] T 238376614fe54205b8c56c8dc72f96a1 P cfbf3cc525204c3ea2f2fbe2ef6f6926: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:04:01.222769 24430 ts_tablet_manager.cc:1918] T 238376614fe54205b8c56c8dc72f96a1 P cfbf3cc525204c3ea2f2fbe2ef6f6926: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 08:04:01.222878 24430 log.cc:1196] T 238376614fe54205b8c56c8dc72f96a1 P cfbf3cc525204c3ea2f2fbe2ef6f6926: Deleting WAL directory at /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/ts-1/wal/wals/238376614fe54205b8c56c8dc72f96a1
I20260811 08:04:01.223230 24428 ts_tablet_manager.cc:1905] T 238376614fe54205b8c56c8dc72f96a1 P 405f04f35a9b4112b58e09f05a9ea44b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:04:01.225189 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 23912
I20260811 08:04:01.225340 24428 ts_tablet_manager.cc:1918] T 238376614fe54205b8c56c8dc72f96a1 P 405f04f35a9b4112b58e09f05a9ea44b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 08:04:01.225409 24428 log.cc:1196] T 238376614fe54205b8c56c8dc72f96a1 P 405f04f35a9b4112b58e09f05a9ea44b: Deleting WAL directory at /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/ts-0/wal/wals/238376614fe54205b8c56c8dc72f96a1
I20260811 08:04:01.225442 24299 tablet_service.cc:1514] Processing DeleteTablet for tablet 238376614fe54205b8c56c8dc72f96a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:04:01 UTC) from {username='oryx', principal='oryx/127.15.36.254@KRBTEST.COM'} at 127.0.0.1:34306
I20260811 08:04:01.225612 24429 tablet_replica.cc:330] T 238376614fe54205b8c56c8dc72f96a1 P c16c1dbd34694d499b77890d7f0d79c9: stopping tablet replica
I20260811 08:04:01.225673 24428 ts_tablet_manager.cc:1939] T 238376614fe54205b8c56c8dc72f96a1 P 405f04f35a9b4112b58e09f05a9ea44b: Deleting consensus metadata
I20260811 08:04:01.225690 24429 raft_consensus.cc:2229] T 238376614fe54205b8c56c8dc72f96a1 P c16c1dbd34694d499b77890d7f0d79c9 [term 1 LEADER]: Raft consensus shutting down.
I20260811 08:04:01.225790 24429 raft_consensus.cc:2258] T 238376614fe54205b8c56c8dc72f96a1 P c16c1dbd34694d499b77890d7f0d79c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:04:01.226244 24429 ts_tablet_manager.cc:1905] T 238376614fe54205b8c56c8dc72f96a1 P c16c1dbd34694d499b77890d7f0d79c9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:04:01.228696 24429 ts_tablet_manager.cc:1918] T 238376614fe54205b8c56c8dc72f96a1 P c16c1dbd34694d499b77890d7f0d79c9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 08:04:01.228783 24429 log.cc:1196] T 238376614fe54205b8c56c8dc72f96a1 P c16c1dbd34694d499b77890d7f0d79c9: Deleting WAL directory at /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786435400844580-15507-0/minicluster-data/ts-2/wal/wals/238376614fe54205b8c56c8dc72f96a1
I20260811 08:04:01.228830 24430 ts_tablet_manager.cc:1939] T 238376614fe54205b8c56c8dc72f96a1 P cfbf3cc525204c3ea2f2fbe2ef6f6926: Deleting consensus metadata
I20260811 08:04:01.229010 24429 ts_tablet_manager.cc:1939] T 238376614fe54205b8c56c8dc72f96a1 P c16c1dbd34694d499b77890d7f0d79c9: Deleting consensus metadata
I20260811 08:04:01.229295 23813 catalog_manager.cc:4841] TS cfbf3cc525204c3ea2f2fbe2ef6f6926 (127.15.36.194:39961): tablet 238376614fe54205b8c56c8dc72f96a1 (table test-table [id=ce7ad68f8eeb48f689b313d51a258ed6]) successfully deleted
I20260811 08:04:01.229876 23810 catalog_manager.cc:4841] TS c16c1dbd34694d499b77890d7f0d79c9 (127.15.36.195:42727): tablet 238376614fe54205b8c56c8dc72f96a1 (table test-table [id=ce7ad68f8eeb48f689b313d51a258ed6]) successfully deleted
W20260811 08:04:01.239037 23811 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.36.193:33463 (error 108)
I20260811 08:04:01.239349 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 24067
I20260811 08:04:01.240770 24507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:01.239451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.193:33463 (local address 127.0.0.1:46830)
0811 08:04:01.240666 (+ 1215us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:01.240726 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.193:33463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1195,"thread_start_us":46,"threads_started":1}
W20260811 08:04:01.240914 23811 catalog_manager.cc:4584] TS 405f04f35a9b4112b58e09f05a9ea44b (127.15.36.193:33463): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 238376614fe54205b8c56c8dc72f96a1: Network error: Client connection negotiation failed: client connection to 127.15.36.193:33463: connect: Connection refused (error 111)
I20260811 08:04:01.249687 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 24228
I20260811 08:04:01.259452 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 23791
2026-08-11T08:04:01Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3240 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786435400844580-15507-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:04:01 dist-test-slave-2w3w krb5kdc[24510](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:04:01 dist-test-slave-2w3w krb5kdc[24510](info): set up 2 sockets
Aug 11 08:04:01 dist-test-slave-2w3w krb5kdc[24510](info): commencing operation
krb5kdc: starting...
W20260811 08:04:02.471671 15507 mini_kdc.cc:121] Time spent starting KDC: real 1.187s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Aug 11 08:04:02 dist-test-slave-2w3w krb5kdc[24510](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435442, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:04:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:04:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.36.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab.
Entry for principal kudu/127.15.36.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab.
I20260811 08:04:02.657732 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786435400844580-15507-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786435400844580-15507-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786435400844580-15507-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:43513
--webserver_interface=127.15.36.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=kudu/127.15.36.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:46121
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.36.254:43513
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:04:02.761238 24525 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:04:02.761494 24525 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:04:02.761520 24525 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:04:02.763075 24525 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:04:02.763152 24525 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:04:02.763167 24525 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:04:02.763245 24525 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:04:02.763478 24525 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:04:02.765756 24525 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:46121
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786435400844580-15507-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786435400844580-15507-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.36.254:43513
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:43513
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.36.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24525
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786435400844580-15507-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:04:02.766064 24525 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:04:02.766273 24525 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:04:02.772229 24531 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:04:02.772229 24533 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:04:02.773425 24525 server_base.cc:1034] running on GCE node
W20260811 08:04:02.773356 24530 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:04:02.773874 24525 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:04:02.774276 24525 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:04:02.775482 24525 hybrid_clock.cc:648] HybridClock initialized: now 1786435442775449 us; error 57 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-11T08:04:02Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1525 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:04:02 dist-test-slave-2w3w krb5kdc[24539](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:04:02 dist-test-slave-2w3w krb5kdc[24539](info): set up 2 sockets
Aug 11 08:04:02 dist-test-slave-2w3w krb5kdc[24539](info): commencing operation
krb5kdc: starting...
W20260811 08:04:04.092564 15507 mini_kdc.cc:121] Time spent starting KDC: real 1.282s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Aug 11 08:04:04 dist-test-slave-2w3w krb5kdc[24539](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435444, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:04:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:04:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.36.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab.
Entry for principal kudu/127.15.36.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab.
I20260811 08:04:04.260037 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:32881
--webserver_interface=127.15.36.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=kudu/127.15.36.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:46689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.36.254:32881
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:04:04.370801 24556 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:04:04.371138 24556 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:04:04.371186 24556 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:04:04.372536 24556 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:04:04.372628 24556 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:04:04.372653 24556 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:04:04.372674 24556 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:04:04.372709 24556 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:04:04.374476 24556 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:46689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.36.254:32881
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=kudu/127.15.36.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:32881
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.36.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24556
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:04:04.374847 24556 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:04:04.375144 24556 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:04:04.386322 24564 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:04:04.386531 24556 server_base.cc:1034] running on GCE node
W20260811 08:04:04.386675 24562 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:04:04.386678 24561 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:04:04.387207 24556 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:04:04.387605 24556 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:04:04.388797 24556 hybrid_clock.cc:648] HybridClock initialized: now 1786435444388728 us; error 122 us; skew 500 ppm
Aug 11 08:04:04 dist-test-slave-2w3w krb5kdc[24539](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435444, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:04:04.392076 24556 init.cc:377] Logged in from keytab as kudu/127.15.36.254@KRBTEST.COM (short username kudu)
I20260811 08:04:04.392714 24556 webserver.cc:460] Webserver started at http://127.15.36.254:40209/ using document root <none> and password file <none>
I20260811 08:04:04.392984 24556 fs_manager.cc:359] Metadata directory not provided
I20260811 08:04:04.393036 24556 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:04:04.393174 24556 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:04:04.394598 24556 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/master-0/data/instance:
uuid: "45ce68f9cf424d48a201e88b51801429"
format_stamp: "Formatted at 2026-08-11 08:04:04 on dist-test-slave-2w3w"
server_key: "c33bd94fe13b7873b6f66bc88a61c5e5"
server_key_iv: "3fa577fa02978b9fed47d807546cd77a"
server_key_version: "encryptionkey@0"
I20260811 08:04:04.395117 24556 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/master-0/wal/instance:
uuid: "45ce68f9cf424d48a201e88b51801429"
format_stamp: "Formatted at 2026-08-11 08:04:04 on dist-test-slave-2w3w"
server_key: "c33bd94fe13b7873b6f66bc88a61c5e5"
server_key_iv: "3fa577fa02978b9fed47d807546cd77a"
server_key_version: "encryptionkey@0"
I20260811 08:04:04.397397 24556 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260811 08:04:04.398528 24572 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:04:04.399431 24556 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.002s sys 0.000s
I20260811 08:04:04.399591 24556 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/master-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/master-0/wal
uuid: "45ce68f9cf424d48a201e88b51801429"
format_stamp: "Formatted at 2026-08-11 08:04:04 on dist-test-slave-2w3w"
server_key: "c33bd94fe13b7873b6f66bc88a61c5e5"
server_key_iv: "3fa577fa02978b9fed47d807546cd77a"
server_key_version: "encryptionkey@0"
I20260811 08:04:04.399701 24556 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:04:04.433322 24556 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:04:04.437845 24556 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:04:04.438508 24556 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:04:04.444968 24556 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.254:32881
I20260811 08:04:04.445007 24634 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.254:32881 every 8 connection(s)
I20260811 08:04:04.445436 24556 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
I20260811 08:04:04.446359 24636 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:04:04.447856 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 24556
I20260811 08:04:04.448002 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/master-0/wal/instance
I20260811 08:04:04.448248 15507 external_mini_cluster.cc:1428] Setting key e911f365cb1152599cdc41e2a04befcf
I20260811 08:04:04.449534 24636 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45ce68f9cf424d48a201e88b51801429: Bootstrap starting.
I20260811 08:04:04.450378 24636 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 45ce68f9cf424d48a201e88b51801429: Neither blocks nor log segments found. Creating new log.
I20260811 08:04:04.450744 24636 log.cc:824] T 00000000000000000000000000000000 P 45ce68f9cf424d48a201e88b51801429: Log is configured to *not* fsync() on all Append() calls
I20260811 08:04:04.451892 24636 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45ce68f9cf424d48a201e88b51801429: No bootstrap required, opened a new log
I20260811 08:04:04.454862 24636 raft_consensus.cc:348] T 00000000000000000000000000000000 P 45ce68f9cf424d48a201e88b51801429 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45ce68f9cf424d48a201e88b51801429" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 32881 } }
I20260811 08:04:04.455243 24636 raft_consensus.cc:374] T 00000000000000000000000000000000 P 45ce68f9cf424d48a201e88b51801429 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:04:04.455341 24636 raft_consensus.cc:729] T 00000000000000000000000000000000 P 45ce68f9cf424d48a201e88b51801429 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ce68f9cf424d48a201e88b51801429, State: Initialized, Role: FOLLOWER
I20260811 08:04:04.455533 24636 consensus_queue.cc:260] T 00000000000000000000000000000000 P 45ce68f9cf424d48a201e88b51801429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45ce68f9cf424d48a201e88b51801429" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 32881 } }
I20260811 08:04:04.455648 24636 raft_consensus.cc:388] T 00000000000000000000000000000000 P 45ce68f9cf424d48a201e88b51801429 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:04:04.455691 24636 raft_consensus.cc:482] T 00000000000000000000000000000000 P 45ce68f9cf424d48a201e88b51801429 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:04:04.455753 24636 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 45ce68f9cf424d48a201e88b51801429 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:04:04.456880 24636 raft_consensus.cc:504] T 00000000000000000000000000000000 P 45ce68f9cf424d48a201e88b51801429 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45ce68f9cf424d48a201e88b51801429" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 32881 } }
I20260811 08:04:04.457018 24636 leader_election.cc:302] T 00000000000000000000000000000000 P 45ce68f9cf424d48a201e88b51801429 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 45ce68f9cf424d48a201e88b51801429; no voters:
I20260811 08:04:04.457247 24636 leader_election.cc:288] T 00000000000000000000000000000000 P 45ce68f9cf424d48a201e88b51801429 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:04:04.457327 24641 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 45ce68f9cf424d48a201e88b51801429 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:04:04.457517 24641 raft_consensus.cc:686] T 00000000000000000000000000000000 P 45ce68f9cf424d48a201e88b51801429 [term 1 LEADER]: Becoming Leader. State: Replica: 45ce68f9cf424d48a201e88b51801429, State: Running, Role: LEADER
I20260811 08:04:04.457579 24636 sys_catalog.cc:564] T 00000000000000000000000000000000 P 45ce68f9cf424d48a201e88b51801429 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:04:04.457638 24641 consensus_queue.cc:237] T 00000000000000000000000000000000 P 45ce68f9cf424d48a201e88b51801429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45ce68f9cf424d48a201e88b51801429" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 32881 } }
Aug 11 08:04:04 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435444, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:04:04.458140 24641 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45ce68f9cf424d48a201e88b51801429 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 45ce68f9cf424d48a201e88b51801429. Latest consensus state: current_term: 1 leader_uuid: "45ce68f9cf424d48a201e88b51801429" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45ce68f9cf424d48a201e88b51801429" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 32881 } } }
I20260811 08:04:04.458241 24641 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45ce68f9cf424d48a201e88b51801429 [sys.catalog]: This master's current role is: LEADER
I20260811 08:04:04.458577 24651 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:04:04.459091 24651 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:04:04.458158 24642 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45ce68f9cf424d48a201e88b51801429 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "45ce68f9cf424d48a201e88b51801429" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45ce68f9cf424d48a201e88b51801429" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 32881 } } }
I20260811 08:04:04.460681 24642 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45ce68f9cf424d48a201e88b51801429 [sys.catalog]: This master's current role is: LEADER
I20260811 08:04:04.464301 24651 catalog_manager.cc:1347] Generated new cluster ID: 97e66e3ef736447dbb872333e0d85b44
I20260811 08:04:04.464377 24651 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:04:04.467533 24639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:04.449004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52674 (local address 127.15.36.254:32881)
0811 08:04:04.449288 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:04.449297 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:04.449323 (+ 26us) server_negotiation.cc:407] Connection header received
0811 08:04:04.449872 (+ 549us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:04.449883 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:04.449954 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:04.450115 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:04.451017 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:04.452786 (+ 1769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:04.453665 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:04.454475 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:04.454623 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:04.458622 (+ 3999us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:04:04.458628 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:04:04.458629 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:04:04.458648 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:04:04.462317 (+ 3669us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:04:04.463040 (+ 723us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:04:04.463043 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:04:04.463044 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:04:04.463152 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:04:04.463607 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:04:04.463609 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:04:04.463609 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:04:04.463999 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:04:04.464194 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0811 08:04:04.467187 (+ 2993us) server_negotiation.cc:299] Negotiation successful
0811 08:04:04.467350 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":225,"thread_start_us":96,"threads_started":1}
I20260811 08:04:04.477684 24651 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:04:04.478652 24651 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:04:04.488785 24651 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 45ce68f9cf424d48a201e88b51801429: Generated new TSK 0
I20260811 08:04:04.489076 24651 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.36.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab.
Entry for principal kudu/127.15.36.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab.
I20260811 08:04:04.539772 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.193:0
--local_ip_for_outbound_sockets=127.15.36.193
--webserver_interface=127.15.36.193
--webserver_port=0
--tserver_master_addrs=127.15.36.254:32881
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab
--principal=kudu/127.15.36.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:46689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:04:04.647290 24666 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:04:04.647578 24666 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:04:04.647620 24666 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:04:04.649004 24666 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:04:04.649104 24666 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:04:04.649233 24666 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.193
I20260811 08:04:04.651166 24666 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:46689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab
--principal=kudu/127.15.36.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.36.193
--webserver_port=0
--tserver_master_addrs=127.15.36.254:32881
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24666
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.193
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:04:04.651499 24666 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:04:04.651780 24666 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:04:04.658308 24673 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:04:04.658664 24672 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:04:04.658763 24675 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:04:04.659600 24666 server_base.cc:1034] running on GCE node
I20260811 08:04:04.659873 24666 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:04:04.660534 24666 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:04:04.661829 24666 hybrid_clock.cc:648] HybridClock initialized: now 1786435444661786 us; error 67 us; skew 500 ppm
Aug 11 08:04:04 dist-test-slave-2w3w krb5kdc[24539](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435444, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:04:04.665014 24666 init.cc:377] Logged in from keytab as kudu/127.15.36.193@KRBTEST.COM (short username kudu)
I20260811 08:04:04.665596 24666 webserver.cc:460] Webserver started at http://127.15.36.193:41345/ using document root <none> and password file <none>
I20260811 08:04:04.665921 24666 fs_manager.cc:359] Metadata directory not provided
I20260811 08:04:04.665980 24666 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:04:04.666092 24666 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:04:04.667712 24666 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-0/data/instance:
uuid: "d68b6dfb04f44587b154bc790368673d"
format_stamp: "Formatted at 2026-08-11 08:04:04 on dist-test-slave-2w3w"
server_key: "c354e32490bb85aebddcb23499ef5cf2"
server_key_iv: "6d06d7bac35a7c5158b9bb00c2206056"
server_key_version: "encryptionkey@0"
I20260811 08:04:04.668164 24666 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-0/wal/instance:
uuid: "d68b6dfb04f44587b154bc790368673d"
format_stamp: "Formatted at 2026-08-11 08:04:04 on dist-test-slave-2w3w"
server_key: "c354e32490bb85aebddcb23499ef5cf2"
server_key_iv: "6d06d7bac35a7c5158b9bb00c2206056"
server_key_version: "encryptionkey@0"
I20260811 08:04:04.669879 24666 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 08:04:04.671365 24683 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:04:04.671700 24666 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:04:04.672187 24666 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-0/wal
uuid: "d68b6dfb04f44587b154bc790368673d"
format_stamp: "Formatted at 2026-08-11 08:04:04 on dist-test-slave-2w3w"
server_key: "c354e32490bb85aebddcb23499ef5cf2"
server_key_iv: "6d06d7bac35a7c5158b9bb00c2206056"
server_key_version: "encryptionkey@0"
I20260811 08:04:04.672323 24666 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:04:04.703089 24666 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:04:04.706895 24666 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:04:04.707149 24666 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:04:04.707464 24666 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:04:04.707850 24666 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:04:04.707908 24666 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:04:04.707947 24666 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:04:04.707974 24666 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:04:04.714774 24666 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.193:37391
I20260811 08:04:04.714840 24811 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.193:37391 every 8 connection(s)
I20260811 08:04:04.715271 24666 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
I20260811 08:04:04.718767 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 24666
I20260811 08:04:04.718892 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-0/wal/instance
I20260811 08:04:04.719154 15507 external_mini_cluster.cc:1428] Setting key e97ec90eba91af8497f6981eb3c576d8
Aug 11 08:04:04 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435444, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.193@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:04:04.726539 24639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:04.716193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:50965 (local address 127.15.36.254:32881)
0811 08:04:04.716263 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:04.716265 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:04.716525 (+ 260us) server_negotiation.cc:407] Connection header received
0811 08:04:04.717104 (+ 579us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:04.717105 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:04.717118 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:04.717171 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:04.718297 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:04.719030 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:04.720302 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:04.720644 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:04.720728 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:04.723425 (+ 2697us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:04:04.723427 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:04:04.723427 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:04:04.723443 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:04:04.724970 (+ 1527us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:04:04.725445 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:04:04.725446 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:04:04.725447 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:04:04.725516 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:04:04.725789 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:04:04.725790 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:04:04.725791 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:04:04.725933 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:04:04.726008 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 08:04:04.726325 (+ 317us) server_negotiation.cc:299] Negotiation successful
0811 08:04:04.726427 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 08:04:04.726781 24814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:04.716185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32881 (local address 127.15.36.193:50965)
0811 08:04:04.716391 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:04.716432 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:04.716985 (+ 553us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:04.717253 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:04.717257 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:04.717959 (+ 702us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:04:04.718180 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:04.718187 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:04.719161 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:04.719162 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:04.720206 (+ 1044us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:04.720210 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:04.720789 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:04.720791 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:04.720918 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:04.721625 (+ 707us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:04:04.721638 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:04:04.723301 (+ 1663us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:04:04.725075 (+ 1774us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:04:04.725086 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:04:04.725089 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:04:04.725361 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:04:04.725588 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:04:04.725589 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:04:04.725589 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:04:04.725710 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:04:04.726009 (+ 299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:04:04.726019 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:04:04.726182 (+ 163us) client_negotiation.cc:769] Sending connection context
0811 08:04:04.726293 (+ 111us) client_negotiation.cc:240] Negotiation successful
0811 08:04:04.726532 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":72,"threads_started":1}
I20260811 08:04:04.727512 24812 heartbeater.cc:347] Connected to a master server at 127.15.36.254:32881
I20260811 08:04:04.727644 24812 heartbeater.cc:464] Registering TS with master...
I20260811 08:04:04.727865 24812 heartbeater.cc:511] Master 127.15.36.254:32881 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.15.36.194@KRBTEST.COM; defaulting to no policy
I20260811 08:04:04.728499 24592 ts_manager.cc:194] Registered new tserver with Master: d68b6dfb04f44587b154bc790368673d (127.15.36.193:37391)
I20260811 08:04:04.729204 24592 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.36.193@KRBTEST.COM'} at 127.15.36.193:50965
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab.
Entry for principal kudu/127.15.36.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab.
I20260811 08:04:04.756882 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.194:0
--local_ip_for_outbound_sockets=127.15.36.194
--webserver_interface=127.15.36.194
--webserver_port=0
--tserver_master_addrs=127.15.36.254:32881
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab
--principal=kudu/127.15.36.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:46689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:04:04.853564 24821 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:04:04.853812 24821 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:04:04.853843 24821 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:04:04.855370 24821 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:04:04.855433 24821 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:04:04.855465 24821 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.194
I20260811 08:04:04.857787 24821 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:46689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab
--principal=kudu/127.15.36.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.36.194
--webserver_port=0
--tserver_master_addrs=127.15.36.254:32881
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24821
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.194
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:04:04.858067 24821 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:04:04.858280 24821 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:04:04.865278 24827 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:04:04.865286 24826 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:04:04.865293 24829 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:04:04.865697 24821 server_base.cc:1034] running on GCE node
I20260811 08:04:04.866046 24821 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:04:04.866353 24821 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:04:04.867552 24821 hybrid_clock.cc:648] HybridClock initialized: now 1786435444867508 us; error 64 us; skew 500 ppm
Aug 11 08:04:04 dist-test-slave-2w3w krb5kdc[24539](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435444, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:04:04.871943 24821 init.cc:377] Logged in from keytab as kudu/127.15.36.194@KRBTEST.COM (short username kudu)
I20260811 08:04:04.872669 24821 webserver.cc:460] Webserver started at http://127.15.36.194:39365/ using document root <none> and password file <none>
I20260811 08:04:04.873136 24821 fs_manager.cc:359] Metadata directory not provided
I20260811 08:04:04.873222 24821 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:04:04.873406 24821 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:04:04.874697 24821 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-1/data/instance:
uuid: "73f602c14c044b64ac02517730789cbd"
format_stamp: "Formatted at 2026-08-11 08:04:04 on dist-test-slave-2w3w"
server_key: "1e6598d14c82a1c35c51d8e5f72c335f"
server_key_iv: "3db54ecf71b5053bd589de57f602f6e9"
server_key_version: "encryptionkey@0"
I20260811 08:04:04.875208 24821 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-1/wal/instance:
uuid: "73f602c14c044b64ac02517730789cbd"
format_stamp: "Formatted at 2026-08-11 08:04:04 on dist-test-slave-2w3w"
server_key: "1e6598d14c82a1c35c51d8e5f72c335f"
server_key_iv: "3db54ecf71b5053bd589de57f602f6e9"
server_key_version: "encryptionkey@0"
I20260811 08:04:04.876964 24821 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.001s
I20260811 08:04:04.878443 24836 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:04:04.878901 24821 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260811 08:04:04.879176 24821 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-1/wal
uuid: "73f602c14c044b64ac02517730789cbd"
format_stamp: "Formatted at 2026-08-11 08:04:04 on dist-test-slave-2w3w"
server_key: "1e6598d14c82a1c35c51d8e5f72c335f"
server_key_iv: "3db54ecf71b5053bd589de57f602f6e9"
server_key_version: "encryptionkey@0"
I20260811 08:04:04.879292 24821 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:04:04.894610 24821 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:04:04.898046 24821 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:04:04.898288 24821 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:04:04.898603 24821 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:04:04.899379 24821 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:04:04.899454 24821 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:04:04.899510 24821 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:04:04.899524 24821 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:04:04.907297 24821 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.194:42895
I20260811 08:04:04.907384 24967 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.194:42895 every 8 connection(s)
I20260811 08:04:04.907750 24821 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
I20260811 08:04:04.914652 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 24821
I20260811 08:04:04.914773 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-1/wal/instance
I20260811 08:04:04.915156 15507 external_mini_cluster.cc:1428] Setting key 344fb2fb66a88be9767bf2cfdd061975
Aug 11 08:04:04 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435444, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.194@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:04:04.919965 24639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:04.909250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:34113 (local address 127.15.36.254:32881)
0811 08:04:04.909370 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:04.909372 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:04.909505 (+ 133us) server_negotiation.cc:407] Connection header received
0811 08:04:04.910025 (+ 520us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:04.910026 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:04.910037 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:04.910100 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:04.911431 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:04.912529 (+ 1098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:04.913594 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:04.913834 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:04.913900 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:04.916749 (+ 2849us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:04:04.916751 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:04:04.916752 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:04:04.916762 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:04:04.918322 (+ 1560us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:04:04.918808 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:04:04.918809 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:04:04.918809 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:04:04.918876 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:04:04.919210 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:04:04.919211 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:04:04.919211 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:04:04.919357 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:04:04.919448 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 08:04:04.919755 (+ 307us) server_negotiation.cc:299] Negotiation successful
0811 08:04:04.919851 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260811 08:04:04.920185 24971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:04.908885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32881 (local address 127.15.36.194:34113)
0811 08:04:04.909275 (+ 390us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:04.909327 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:04.909900 (+ 573us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:04.910233 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:04.910237 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:04.910865 (+ 628us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:04:04.911246 (+ 381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:04.911253 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:04.912628 (+ 1375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:04.912629 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:04.913476 (+ 847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:04.913479 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:04.913955 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:04.913956 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:04.914073 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:04.914825 (+ 752us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:04:04.914836 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:04:04.916637 (+ 1801us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:04:04.918437 (+ 1800us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:04:04.918449 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:04:04.918452 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:04:04.918720 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:04:04.918993 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:04:04.918994 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:04:04.918994 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:04:04.919121 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:04:04.919434 (+ 313us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:04:04.919442 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:04:04.919605 (+ 163us) client_negotiation.cc:769] Sending connection context
0811 08:04:04.919716 (+ 111us) client_negotiation.cc:240] Negotiation successful
0811 08:04:04.919909 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":326,"thread_start_us":101,"threads_started":1}
I20260811 08:04:04.920732 24968 heartbeater.cc:347] Connected to a master server at 127.15.36.254:32881
I20260811 08:04:04.920864 24968 heartbeater.cc:464] Registering TS with master...
I20260811 08:04:04.921092 24968 heartbeater.cc:511] Master 127.15.36.254:32881 requested a full tablet report, sending...
I20260811 08:04:04.921620 24592 ts_manager.cc:194] Registered new tserver with Master: 73f602c14c044b64ac02517730789cbd (127.15.36.194:42895)
I20260811 08:04:04.922201 24592 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.36.194@KRBTEST.COM'} at 127.15.36.194:34113
WARNING: no policy specified for kudu/127.15.36.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab.
Entry for principal kudu/127.15.36.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab.
I20260811 08:04:04.948390 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.195:0
--local_ip_for_outbound_sockets=127.15.36.195
--webserver_interface=127.15.36.195
--webserver_port=0
--tserver_master_addrs=127.15.36.254:32881
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab
--principal=kudu/127.15.36.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:46689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:04:05.051357 24974 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:04:05.051785 24974 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:04:05.051859 24974 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:04:05.054682 24974 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:04:05.054796 24974 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:04:05.054858 24974 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.195
I20260811 08:04:05.056964 24974 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:46689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab
--principal=kudu/127.15.36.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.36.195
--webserver_port=0
--tserver_master_addrs=127.15.36.254:32881
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24974
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.195
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:04:05.057344 24974 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:04:05.057636 24974 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:04:05.064122 24980 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:04:05.064242 24974 server_base.cc:1034] running on GCE node
W20260811 08:04:05.064177 24983 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:04:05.064178 24979 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:04:05.064720 24974 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:04:05.065007 24974 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:04:05.066236 24974 hybrid_clock.cc:648] HybridClock initialized: now 1786435445066196 us; error 48 us; skew 500 ppm
Aug 11 08:04:05 dist-test-slave-2w3w krb5kdc[24539](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435445, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:04:05.069442 24974 init.cc:377] Logged in from keytab as kudu/127.15.36.195@KRBTEST.COM (short username kudu)
I20260811 08:04:05.069995 24974 webserver.cc:460] Webserver started at http://127.15.36.195:36691/ using document root <none> and password file <none>
I20260811 08:04:05.070273 24974 fs_manager.cc:359] Metadata directory not provided
I20260811 08:04:05.070361 24974 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:04:05.070546 24974 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:04:05.071784 24974 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-2/data/instance:
uuid: "db376d1be9cf4b7698d40b5854a8ced5"
format_stamp: "Formatted at 2026-08-11 08:04:05 on dist-test-slave-2w3w"
server_key: "571522b47318d86102b762e191b51afb"
server_key_iv: "0bd7ac897c50c04ee5d9b72be7ac9656"
server_key_version: "encryptionkey@0"
I20260811 08:04:05.072180 24974 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-2/wal/instance:
uuid: "db376d1be9cf4b7698d40b5854a8ced5"
format_stamp: "Formatted at 2026-08-11 08:04:05 on dist-test-slave-2w3w"
server_key: "571522b47318d86102b762e191b51afb"
server_key_iv: "0bd7ac897c50c04ee5d9b72be7ac9656"
server_key_version: "encryptionkey@0"
I20260811 08:04:05.074190 24974 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.001s
I20260811 08:04:05.075595 24990 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:04:05.075857 24974 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 08:04:05.075991 24974 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-2/wal
uuid: "db376d1be9cf4b7698d40b5854a8ced5"
format_stamp: "Formatted at 2026-08-11 08:04:05 on dist-test-slave-2w3w"
server_key: "571522b47318d86102b762e191b51afb"
server_key_iv: "0bd7ac897c50c04ee5d9b72be7ac9656"
server_key_version: "encryptionkey@0"
I20260811 08:04:05.076104 24974 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:04:05.088653 24974 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:04:05.091797 24974 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:04:05.092020 24974 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:04:05.092324 24974 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:04:05.093029 24974 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:04:05.093206 24974 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:04:05.093302 24974 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:04:05.093333 24974 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:04:05.101104 24974 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.195:43229
I20260811 08:04:05.101181 25118 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.195:43229 every 8 connection(s)
I20260811 08:04:05.101539 24974 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
I20260811 08:04:05.105573 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 24974
I20260811 08:04:05.105840 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-2/wal/instance
I20260811 08:04:05.106063 15507 external_mini_cluster.cc:1428] Setting key 7d3f089e5932f24b289d48cbbb9f30d1
Aug 11 08:04:05 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435445, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.195@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:04:05.117077 24639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:05.102536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:55789 (local address 127.15.36.254:32881)
0811 08:04:05.102697 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:05.102700 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:05.102904 (+ 204us) server_negotiation.cc:407] Connection header received
0811 08:04:05.103488 (+ 584us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:05.103490 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:05.103504 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:05.103568 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:05.105431 (+ 1863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:05.106189 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:05.107667 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:05.108037 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:05.108240 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:05.112695 (+ 4455us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:04:05.112698 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:04:05.112698 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:04:05.112711 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:04:05.115076 (+ 2365us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:04:05.115737 (+ 661us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:04:05.115740 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:04:05.115740 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:04:05.115877 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:04:05.116335 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:04:05.116338 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:04:05.116338 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:04:05.116494 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:04:05.116557 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 08:04:05.116900 (+ 343us) server_negotiation.cc:299] Negotiation successful
0811 08:04:05.116997 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105}
I20260811 08:04:05.117241 25121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:05.102306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32881 (local address 127.15.36.195:55789)
0811 08:04:05.102733 (+ 427us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:05.102782 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:05.103335 (+ 553us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:05.103756 (+ 421us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:05.103762 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:05.104925 (+ 1163us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:04:05.105245 (+ 320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:05.105254 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:05.106335 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:05.106337 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:05.107441 (+ 1104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:05.107445 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:05.108370 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:05.108372 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:05.108569 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:05.109582 (+ 1013us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:04:05.109593 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:04:05.112349 (+ 2756us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:04:05.115219 (+ 2870us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:04:05.115233 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:04:05.115249 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:04:05.115547 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:04:05.115980 (+ 433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:04:05.115981 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:04:05.115982 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:04:05.116218 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:04:05.116567 (+ 349us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:04:05.116573 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:04:05.116720 (+ 147us) client_negotiation.cc:769] Sending connection context
0811 08:04:05.116812 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 08:04:05.116986 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":379,"thread_start_us":315,"threads_started":1}
I20260811 08:04:05.117837 25119 heartbeater.cc:347] Connected to a master server at 127.15.36.254:32881
I20260811 08:04:05.117969 25119 heartbeater.cc:464] Registering TS with master...
I20260811 08:04:05.118170 25119 heartbeater.cc:511] Master 127.15.36.254:32881 requested a full tablet report, sending...
I20260811 08:04:05.118825 24592 ts_manager.cc:194] Registered new tserver with Master: db376d1be9cf4b7698d40b5854a8ced5 (127.15.36.195:43229)
I20260811 08:04:05.119424 24592 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.36.195@KRBTEST.COM'} at 127.15.36.195:55789
I20260811 08:04:05.119527 15507 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.15.36.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.36.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.36.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/krb5kdc/oryx_127.15.36.193.keytab.
Entry for principal oryx/127.15.36.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/krb5kdc/oryx_127.15.36.193.keytab.
WARNING: no policy specified for oryx/127.15.36.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.36.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.36.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/krb5kdc/oryx_127.15.36.194.keytab.
Entry for principal oryx/127.15.36.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/krb5kdc/oryx_127.15.36.194.keytab.
WARNING: no policy specified for oryx/127.15.36.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.36.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.36.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/krb5kdc/oryx_127.15.36.195.keytab.
Entry for principal oryx/127.15.36.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/krb5kdc/oryx_127.15.36.195.keytab.
I20260811 08:04:05.239619 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 24666
I20260811 08:04:05.247789 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 24821
I20260811 08:04:05.256700 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 24974
I20260811 08:04:05.264462 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 24556
I20260811 08:04:05.274752 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:32881
--webserver_interface=127.15.36.254
--webserver_port=40209
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=kudu/127.15.36.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:46689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.36.254:32881
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:04:05.371708 25129 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:04:05.372115 25129 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:04:05.372164 25129 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:04:05.373885 25129 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:04:05.374037 25129 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:04:05.374068 25129 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:04:05.374089 25129 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:04:05.374117 25129 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:04:05.376039 25129 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:46689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.36.254:32881
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=kudu/127.15.36.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:32881
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.36.254
--webserver_port=40209
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25129
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:04:05.376405 25129 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:04:05.376673 25129 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:04:05.382753 25136 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:04:05.382753 25138 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:04:05.383109 25135 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:04:05.383677 25129 server_base.cc:1034] running on GCE node
I20260811 08:04:05.384187 25129 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:04:05.384570 25129 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:04:05.385797 25129 hybrid_clock.cc:648] HybridClock initialized: now 1786435445385766 us; error 48 us; skew 500 ppm
Aug 11 08:04:05 dist-test-slave-2w3w krb5kdc[24539](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435445, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:04:05.389483 25129 init.cc:377] Logged in from keytab as kudu/127.15.36.254@KRBTEST.COM (short username kudu)
I20260811 08:04:05.390002 25129 webserver.cc:460] Webserver started at http://127.15.36.254:40209/ using document root <none> and password file <none>
I20260811 08:04:05.390272 25129 fs_manager.cc:359] Metadata directory not provided
I20260811 08:04:05.390344 25129 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:04:05.392360 25129 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:04:05.393481 25147 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:04:05.393839 25129 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:04:05.393985 25129 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/master-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/master-0/wal
uuid: "45ce68f9cf424d48a201e88b51801429"
format_stamp: "Formatted at 2026-08-11 08:04:04 on dist-test-slave-2w3w"
server_key: "c33bd94fe13b7873b6f66bc88a61c5e5"
server_key_iv: "3fa577fa02978b9fed47d807546cd77a"
server_key_version: "encryptionkey@0"
I20260811 08:04:05.394445 25129 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:04:05.421241 25129 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:04:05.424026 25129 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:04:05.424242 25129 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:04:05.429709 25129 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.254:32881
I20260811 08:04:05.429782 25206 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.254:32881 every 8 connection(s)
I20260811 08:04:05.430203 25129 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
I20260811 08:04:05.431921 25207 sys_catalog.cc:263] Verifying existing consensus state
I20260811 08:04:05.432638 25207 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45ce68f9cf424d48a201e88b51801429: Bootstrap starting.
I20260811 08:04:05.433596 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 25129
I20260811 08:04:05.434005 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.193:37391
--local_ip_for_outbound_sockets=127.15.36.193
--tserver_master_addrs=127.15.36.254:32881
--webserver_port=41345
--webserver_interface=127.15.36.193
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab
--principal=kudu/127.15.36.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:46689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.15.36.193
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/krb5kdc/oryx_127.15.36.193.keytab with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 08:04:05.443409 25207 log.cc:824] T 00000000000000000000000000000000 P 45ce68f9cf424d48a201e88b51801429: Log is configured to *not* fsync() on all Append() calls
I20260811 08:04:05.445585 25207 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45ce68f9cf424d48a201e88b51801429: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 08:04:05.445976 25207 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45ce68f9cf424d48a201e88b51801429: Bootstrap complete.
I20260811 08:04:05.448637 25207 raft_consensus.cc:348] T 00000000000000000000000000000000 P 45ce68f9cf424d48a201e88b51801429 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45ce68f9cf424d48a201e88b51801429" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 32881 } }
I20260811 08:04:05.448908 25207 raft_consensus.cc:729] T 00000000000000000000000000000000 P 45ce68f9cf424d48a201e88b51801429 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ce68f9cf424d48a201e88b51801429, State: Initialized, Role: FOLLOWER
I20260811 08:04:05.449139 25207 consensus_queue.cc:260] T 00000000000000000000000000000000 P 45ce68f9cf424d48a201e88b51801429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45ce68f9cf424d48a201e88b51801429" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 32881 } }
I20260811 08:04:05.449221 25207 raft_consensus.cc:388] T 00000000000000000000000000000000 P 45ce68f9cf424d48a201e88b51801429 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:04:05.449275 25207 raft_consensus.cc:482] T 00000000000000000000000000000000 P 45ce68f9cf424d48a201e88b51801429 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:04:05.449331 25207 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 45ce68f9cf424d48a201e88b51801429 [term 1 FOLLOWER]: Advancing to term 2
I20260811 08:04:05.450489 25207 raft_consensus.cc:504] T 00000000000000000000000000000000 P 45ce68f9cf424d48a201e88b51801429 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45ce68f9cf424d48a201e88b51801429" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 32881 } }
I20260811 08:04:05.450626 25207 leader_election.cc:302] T 00000000000000000000000000000000 P 45ce68f9cf424d48a201e88b51801429 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 45ce68f9cf424d48a201e88b51801429; no voters:
I20260811 08:04:05.450865 25207 leader_election.cc:288] T 00000000000000000000000000000000 P 45ce68f9cf424d48a201e88b51801429 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 08:04:05.450908 25212 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 45ce68f9cf424d48a201e88b51801429 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 08:04:05.451067 25212 raft_consensus.cc:686] T 00000000000000000000000000000000 P 45ce68f9cf424d48a201e88b51801429 [term 2 LEADER]: Becoming Leader. State: Replica: 45ce68f9cf424d48a201e88b51801429, State: Running, Role: LEADER
I20260811 08:04:05.451201 25207 sys_catalog.cc:564] T 00000000000000000000000000000000 P 45ce68f9cf424d48a201e88b51801429 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:04:05.451197 25212 consensus_queue.cc:237] T 00000000000000000000000000000000 P 45ce68f9cf424d48a201e88b51801429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45ce68f9cf424d48a201e88b51801429" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 32881 } }
I20260811 08:04:05.452575 25214 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45ce68f9cf424d48a201e88b51801429 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 45ce68f9cf424d48a201e88b51801429. Latest consensus state: current_term: 2 leader_uuid: "45ce68f9cf424d48a201e88b51801429" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45ce68f9cf424d48a201e88b51801429" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 32881 } } }
I20260811 08:04:05.452724 25214 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45ce68f9cf424d48a201e88b51801429 [sys.catalog]: This master's current role is: LEADER
I20260811 08:04:05.453235 25213 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45ce68f9cf424d48a201e88b51801429 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "45ce68f9cf424d48a201e88b51801429" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45ce68f9cf424d48a201e88b51801429" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 32881 } } }
I20260811 08:04:05.453320 25213 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45ce68f9cf424d48a201e88b51801429 [sys.catalog]: This master's current role is: LEADER
I20260811 08:04:05.454559 25230 catalog_manager.cc:1259] Loaded cluster ID: 97e66e3ef736447dbb872333e0d85b44
I20260811 08:04:05.454609 25230 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 45ce68f9cf424d48a201e88b51801429: loading cluster ID for follower catalog manager: success
I20260811 08:04:05.456248 25230 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 45ce68f9cf424d48a201e88b51801429: acquiring CA information for follower catalog manager: success
I20260811 08:04:05.456648 25230 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 45ce68f9cf424d48a201e88b51801429: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 08:04:05.456722 25229 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:04:05.456858 25229 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:04:05.456936 25229 catalog_manager.cc:1259] Loaded cluster ID: 97e66e3ef736447dbb872333e0d85b44
I20260811 08:04:05.456966 25229 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:04:05.457134 25229 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:04:05.457219 25229 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 45ce68f9cf424d48a201e88b51801429: Loaded TSK: 0
I20260811 08:04:05.457346 25229 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 08:04:05.538079 25209 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:04:05.538335 25209 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:04:05.538364 25209 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:04:05.539896 25209 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:04:05.539970 25209 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:04:05.540004 25209 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.193
I20260811 08:04:05.541863 25209 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:46689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/krb5kdc/oryx_127.15.36.193.keytab
--principal=oryx/127.15.36.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.193:37391
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.36.193
--webserver_port=41345
--tserver_master_addrs=127.15.36.254:32881
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25209
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.193
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:04:05.542189 25209 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:04:05.542490 25209 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:04:05.549208 25236 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:04:05.549237 25242 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:04:05.549239 25237 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:04:05.551213 25209 server_base.cc:1034] running on GCE node
I20260811 08:04:05.551507 25209 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:04:05.551801 25209 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:04:05.552990 25209 hybrid_clock.cc:648] HybridClock initialized: now 1786435445552956 us; error 54 us; skew 500 ppm
Aug 11 08:04:05 dist-test-slave-2w3w krb5kdc[24539](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435445, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.36.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:04:05.556118 25209 init.cc:377] Logged in from keytab as oryx/127.15.36.193@KRBTEST.COM (short username oryx)
I20260811 08:04:05.556907 25209 webserver.cc:460] Webserver started at http://127.15.36.193:41345/ using document root <none> and password file <none>
I20260811 08:04:05.557202 25209 fs_manager.cc:359] Metadata directory not provided
I20260811 08:04:05.557319 25209 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:04:05.558889 25209 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 08:04:05.559649 25251 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:04:05.560307 25209 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:04:05.560448 25209 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-0/wal
uuid: "d68b6dfb04f44587b154bc790368673d"
format_stamp: "Formatted at 2026-08-11 08:04:04 on dist-test-slave-2w3w"
server_key: "c354e32490bb85aebddcb23499ef5cf2"
server_key_iv: "6d06d7bac35a7c5158b9bb00c2206056"
server_key_version: "encryptionkey@0"
I20260811 08:04:05.561079 25209 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:04:05.613780 25209 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:04:05.616845 25209 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:04:05.616997 25209 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:04:05.617385 25209 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:04:05.617806 25209 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:04:05.617858 25209 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:04:05.617885 25209 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:04:05.617939 25209 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:04:05.625994 25209 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.193:37391
I20260811 08:04:05.626042 25381 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.193:37391 every 8 connection(s)
I20260811 08:04:05.626509 25209 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
I20260811 08:04:05.633052 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 25209
I20260811 08:04:05.633431 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.194:42895
--local_ip_for_outbound_sockets=127.15.36.194
--tserver_master_addrs=127.15.36.254:32881
--webserver_port=39365
--webserver_interface=127.15.36.194
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab
--principal=kudu/127.15.36.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:46689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.15.36.194
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/krb5kdc/oryx_127.15.36.194.keytab with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 08:04:05 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.193@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:04:05 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.193@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:04:05.639019 25385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:05.627570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32881 (local address 127.15.36.193:57015)
0811 08:04:05.627793 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:05.627833 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:05.628686 (+ 853us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:05.629259 (+ 573us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:05.629263 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:05.629922 (+ 659us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:04:05.630136 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:05.630141 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:05.631609 (+ 1468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:05.631610 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:05.632514 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:05.632518 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:05.633775 (+ 1257us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:05.633776 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:05.633995 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:05.634999 (+ 1004us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:04:05.635013 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:04:05.638685 (+ 3672us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.36.254:32881: Server oryx/127.15.36.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":116,"threads_started":1}
W20260811 08:04:05.639413 25383 heartbeater.cc:644] Failed to heartbeat to 127.15.36.254:32881 (0 consecutive failures): Not authorized: Failed to ping master at 127.15.36.254:32881: Client connection negotiation failed: client connection to 127.15.36.254:32881: Server oryx/127.15.36.254@KRBTEST.COM not found in Kerberos database
W20260811 08:04:05.639614 25387 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:04:05.627731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:57015 (local address 127.15.36.254:32881)
0811 08:04:05.627970 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:05.627980 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:05.628026 (+ 46us) server_negotiation.cc:407] Connection header received
0811 08:04:05.629004 (+ 978us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:05.629013 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:05.629070 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:05.629219 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:05.630282 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:05.631462 (+ 1180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:05.632628 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:05.633613 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:05.633797 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:05.639334 (+ 5537us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.36.193:57015: BlockingRecv error: recv got EOF from 127.15.36.193:57015 (error 108)
Metrics: {"server-negotiator.queue_time_us":183,"thread_start_us":113,"threads_started":1}
Aug 11 08:04:05 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.193@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:04:05 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.193@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:04:05.647378 25385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:05.639684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32881 (local address 127.15.36.193:37143)
0811 08:04:05.639748 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:05.639761 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:05.639809 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:05.640276 (+ 467us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:05.640277 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:05.640452 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:04:05.640517 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:05.640520 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:05.641683 (+ 1163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:05.641684 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:05.643083 (+ 1399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:05.643088 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:05.643839 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:05.643841 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:05.643963 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:05.644769 (+ 806us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:04:05.644777 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:04:05.647267 (+ 2490us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.36.254:32881: Server oryx/127.15.36.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":44}
W20260811 08:04:05.647572 25387 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:04:05.639755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:37143 (local address 127.15.36.254:32881)
0811 08:04:05.639988 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:05.639991 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:05.640002 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:04:05.640050 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:05.640051 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:05.640072 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:05.640138 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:05.640622 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:05.641487 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:05.643207 (+ 1720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:05.643653 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:05.643920 (+ 267us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:05.647477 (+ 3557us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.36.193:37143: BlockingRecv error: recv got EOF from 127.15.36.193:37143 (error 108)
Metrics: {"server-negotiator.queue_time_us":207}
Aug 11 08:04:05 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.193@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:04:05 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.193@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:04:05.654192 25385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:05.647708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32881 (local address 127.15.36.193:42547)
0811 08:04:05.647912 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:05.647924 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:05.647985 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:05.648180 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:05.648181 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:05.648359 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:04:05.648415 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:05.648418 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:05.649175 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:05.649176 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:05.650258 (+ 1082us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:05.650263 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:05.650707 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:05.650708 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:05.650786 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:05.651481 (+ 695us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:04:05.651487 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:04:05.654091 (+ 2604us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.36.254:32881: Server oryx/127.15.36.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":132,"threads_started":1}
W20260811 08:04:05.654296 25387 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:04:05.647779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:42547 (local address 127.15.36.254:32881)
0811 08:04:05.647817 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:05.647819 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:05.648034 (+ 215us) server_negotiation.cc:407] Connection header received
0811 08:04:05.648076 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:05.648077 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:05.648089 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:05.648151 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:05.648495 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:05.648991 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:05.650405 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:05.650611 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:05.650685 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:05.654225 (+ 3540us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.36.193:42547: BlockingRecv error: recv got EOF from 127.15.36.193:42547 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260811 08:04:05.654418 25383 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 08:04:05.731305 25388 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:04:05.731577 25388 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:04:05.731623 25388 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:04:05.732914 25388 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:04:05.733098 25388 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:04:05.733209 25388 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.194
I20260811 08:04:05.735076 25388 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:46689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/krb5kdc/oryx_127.15.36.194.keytab
--principal=oryx/127.15.36.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.194:42895
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.36.194
--webserver_port=39365
--tserver_master_addrs=127.15.36.254:32881
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25388
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.194
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:04:05.735394 25388 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:04:05.735667 25388 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:04:05.741452 25397 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:04:05.741477 25395 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:04:05.741586 25388 server_base.cc:1034] running on GCE node
W20260811 08:04:05.741890 25394 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:04:05.742339 25388 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:04:05.742671 25388 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:04:05.743892 25388 hybrid_clock.cc:648] HybridClock initialized: now 1786435445743862 us; error 48 us; skew 500 ppm
Aug 11 08:04:05 dist-test-slave-2w3w krb5kdc[24539](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435445, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.36.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:04:05.747179 25388 init.cc:377] Logged in from keytab as oryx/127.15.36.194@KRBTEST.COM (short username oryx)
I20260811 08:04:05.747687 25388 webserver.cc:460] Webserver started at http://127.15.36.194:39365/ using document root <none> and password file <none>
I20260811 08:04:05.747891 25388 fs_manager.cc:359] Metadata directory not provided
I20260811 08:04:05.747962 25388 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:04:05.749598 25388 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:04:05.750411 25405 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:04:05.750876 25388 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:04:05.751174 25388 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-1/wal
uuid: "73f602c14c044b64ac02517730789cbd"
format_stamp: "Formatted at 2026-08-11 08:04:04 on dist-test-slave-2w3w"
server_key: "1e6598d14c82a1c35c51d8e5f72c335f"
server_key_iv: "3db54ecf71b5053bd589de57f602f6e9"
server_key_version: "encryptionkey@0"
I20260811 08:04:05.751693 25388 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:04:05.769121 25388 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:04:05.771780 25388 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:04:05.771914 25388 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:04:05.772223 25388 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:04:05.772583 25388 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:04:05.772640 25388 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:04:05.772686 25388 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:04:05.772714 25388 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:04:05.780411 25388 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.194:42895
I20260811 08:04:05.780494 25538 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.194:42895 every 8 connection(s)
I20260811 08:04:05.780938 25388 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
I20260811 08:04:05.782671 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 25388
I20260811 08:04:05.783259 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.195:43229
--local_ip_for_outbound_sockets=127.15.36.195
--tserver_master_addrs=127.15.36.254:32881
--webserver_port=36691
--webserver_interface=127.15.36.195
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab
--principal=kudu/127.15.36.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:46689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.15.36.195
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/krb5kdc/oryx_127.15.36.195.keytab with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 08:04:05 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.194@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:04:05 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.194@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:04:05.795773 25541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:05.782197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32881 (local address 127.15.36.194:46905)
0811 08:04:05.782420 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:05.782468 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:05.784506 (+ 2038us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:05.785044 (+ 538us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:05.785110 (+ 66us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:05.785697 (+ 587us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:04:05.786255 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:05.786272 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:05.787749 (+ 1477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:05.787751 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:05.789443 (+ 1692us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:05.789450 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:05.790090 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:05.790091 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:05.790308 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:05.791574 (+ 1266us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:04:05.791588 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:04:05.795574 (+ 3986us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.36.254:32881: Server oryx/127.15.36.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":96,"threads_started":1}
W20260811 08:04:05.795830 25387 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:04:05.782304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:46905 (local address 127.15.36.254:32881)
0811 08:04:05.782441 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:05.782445 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:05.782624 (+ 179us) server_negotiation.cc:407] Connection header received
0811 08:04:05.784673 (+ 2049us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:05.784675 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:05.784697 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:05.784786 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:05.786565 (+ 1779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:05.787584 (+ 1019us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:05.789598 (+ 2014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:05.789943 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:05.790046 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:05.795743 (+ 5697us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.36.194:46905: BlockingRecv error: recv got EOF from 127.15.36.194:46905 (error 108)
Metrics: {"server-negotiator.queue_time_us":98}
W20260811 08:04:05.796092 25539 heartbeater.cc:644] Failed to heartbeat to 127.15.36.254:32881 (0 consecutive failures): Not authorized: Failed to ping master at 127.15.36.254:32881: Client connection negotiation failed: client connection to 127.15.36.254:32881: Server oryx/127.15.36.254@KRBTEST.COM not found in Kerberos database
Aug 11 08:04:05 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.194@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:04:05 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.194@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:04:05.803335 25541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:05.796450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32881 (local address 127.15.36.194:38447)
0811 08:04:05.796527 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:05.796548 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:05.796606 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:05.796824 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:05.796825 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:05.796996 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:04:05.797067 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:05.797069 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:05.797859 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:05.797861 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:05.798498 (+ 637us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:05.798500 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:05.798917 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:05.798918 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:05.799040 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:05.799630 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:04:05.799636 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:04:05.803272 (+ 3636us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.36.254:32881: Server oryx/127.15.36.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":41}
W20260811 08:04:05.803532 25387 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:04:05.796519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:38447 (local address 127.15.36.254:32881)
0811 08:04:05.796577 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:05.796579 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:05.796591 (+ 12us) server_negotiation.cc:407] Connection header received
0811 08:04:05.796705 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:05.796706 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:05.796717 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:05.796796 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:05.797162 (+ 366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:05.797746 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:05.798596 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:05.798815 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:05.798906 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:05.803462 (+ 4556us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.36.194:38447: BlockingRecv error: recv got EOF from 127.15.36.194:38447 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
Aug 11 08:04:05 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.194@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:04:05 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.194@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:04:05.814522 25541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:05.804376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32881 (local address 127.15.36.194:40241)
0811 08:04:05.804454 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:05.804469 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:05.804536 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:05.805059 (+ 523us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:05.805061 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:05.805203 (+ 142us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:04:05.805252 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:05.805253 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:05.806912 (+ 1659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:05.806913 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:05.807934 (+ 1021us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:05.807939 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:05.808800 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:05.808801 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:05.808857 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:05.809441 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:04:05.809446 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:04:05.814454 (+ 5008us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.36.254:32881: Server oryx/127.15.36.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":53}
W20260811 08:04:05.814671 25387 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:04:05.804568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:40241 (local address 127.15.36.254:32881)
0811 08:04:05.804702 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:05.804704 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:05.804723 (+ 19us) server_negotiation.cc:407] Connection header received
0811 08:04:05.804829 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:05.804830 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:05.804842 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:05.804918 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:05.805526 (+ 608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:05.806513 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:05.808278 (+ 1765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:05.808649 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:05.808763 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:05.814601 (+ 5838us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.36.194:40241: BlockingRecv error: recv got EOF from 127.15.36.194:40241 (error 108)
Metrics: {"server-negotiator.queue_time_us":108}
W20260811 08:04:05.815044 25539 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 08:04:05.894133 25542 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:04:05.894423 25542 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:04:05.894455 25542 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:04:05.896282 25542 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:04:05.896360 25542 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:04:05.896396 25542 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.195
I20260811 08:04:05.898742 25542 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:46689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/krb5kdc/oryx_127.15.36.195.keytab
--principal=oryx/127.15.36.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.195:43229
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.36.195
--webserver_port=36691
--tserver_master_addrs=127.15.36.254:32881
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25542
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.195
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:04:05.899078 25542 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:04:05.899298 25542 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:04:05.905618 25548 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:04:05.906064 25550 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:04:05.906522 25547 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:04:05.906522 25542 server_base.cc:1034] running on GCE node
I20260811 08:04:05.906803 25542 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:04:05.907200 25542 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:04:05.908500 25542 hybrid_clock.cc:648] HybridClock initialized: now 1786435445908458 us; error 67 us; skew 500 ppm
Aug 11 08:04:05 dist-test-slave-2w3w krb5kdc[24539](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435445, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.36.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:04:05.911976 25542 init.cc:377] Logged in from keytab as oryx/127.15.36.195@KRBTEST.COM (short username oryx)
I20260811 08:04:05.912528 25542 webserver.cc:460] Webserver started at http://127.15.36.195:36691/ using document root <none> and password file <none>
I20260811 08:04:05.912811 25542 fs_manager.cc:359] Metadata directory not provided
I20260811 08:04:05.913328 25542 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:04:05.915807 25542 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 08:04:05.916963 25558 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:04:05.917245 25542 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:04:05.917367 25542 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-2/wal
uuid: "db376d1be9cf4b7698d40b5854a8ced5"
format_stamp: "Formatted at 2026-08-11 08:04:05 on dist-test-slave-2w3w"
server_key: "571522b47318d86102b762e191b51afb"
server_key_iv: "0bd7ac897c50c04ee5d9b72be7ac9656"
server_key_version: "encryptionkey@0"
I20260811 08:04:05.917831 25542 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:04:05.946228 25542 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:04:05.949232 25542 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:04:05.949452 25542 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:04:05.949755 25542 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:04:05.950145 25542 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:04:05.950207 25542 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:04:05.950259 25542 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:04:05.950292 25542 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:04:05.958176 25542 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.195:43229
I20260811 08:04:05.958467 25691 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.195:43229 every 8 connection(s)
I20260811 08:04:05.958685 25542 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
I20260811 08:04:05.962769 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 25542
Aug 11 08:04:05 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.195@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:04:05 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.195@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
W20260811 08:04:05.969755 25387 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:04:05.959774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:59327 (local address 127.15.36.254:32881)
0811 08:04:05.959985 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:05.959987 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:05.960158 (+ 171us) server_negotiation.cc:407] Connection header received
0811 08:04:05.960725 (+ 567us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:05.960726 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:05.960741 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:05.960794 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:05.961844 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:05.962358 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:05.964099 (+ 1741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:05.964592 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:05.964733 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:05.969696 (+ 4963us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.36.195:59327: BlockingRecv error: recv got EOF from 127.15.36.195:59327 (error 108)
Metrics: {"server-negotiator.queue_time_us":166}
I20260811 08:04:05.969856 25695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:05.959658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32881 (local address 127.15.36.195:59327)
0811 08:04:05.960013 (+ 355us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:05.960070 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:05.960602 (+ 532us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:05.960867 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:05.960871 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:05.961518 (+ 647us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:04:05.961730 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:05.961735 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:05.962473 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:05.962474 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:05.963888 (+ 1414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:05.963900 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:05.964771 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:05.964772 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:05.964908 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:05.965648 (+ 740us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:04:05.965660 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:04:05.969577 (+ 3917us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.36.254:32881: Server oryx/127.15.36.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":305,"thread_start_us":116,"threads_started":1}
W20260811 08:04:05.970185 25692 heartbeater.cc:644] Failed to heartbeat to 127.15.36.254:32881 (0 consecutive failures): Not authorized: Failed to ping master at 127.15.36.254:32881: Client connection negotiation failed: client connection to 127.15.36.254:32881: Server oryx/127.15.36.254@KRBTEST.COM not found in Kerberos database
I20260811 08:04:05.974311 25697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:05.963834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52688 (local address 127.15.36.254:32881)
0811 08:04:05.964028 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:05.964031 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:05.964043 (+ 12us) server_negotiation.cc:407] Connection header received
0811 08:04:05.964126 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:05.964127 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:05.964138 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:05.964641 (+ 503us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:05.965578 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:05.966709 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:05.968027 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:05.968240 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:05.968340 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:05.970321 (+ 1981us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:04:05.970327 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:04:05.970327 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:04:05.970343 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:04:05.972663 (+ 2320us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:04:05.973112 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:04:05.973116 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:04:05.973117 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:04:05.973224 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:04:05.973455 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:04:05.973456 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:04:05.973457 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:04:05.973765 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:04:05.973933 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0811 08:04:05.974059 (+ 126us) server_negotiation.cc:299] Negotiation successful
0811 08:04:05.974191 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":99,"threads_started":1}
Aug 11 08:04:05 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.195@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:04:05 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.195@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:04:05.976763 25695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:05.970484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32881 (local address 127.15.36.195:54857)
0811 08:04:05.970531 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:05.970543 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:05.970612 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:05.971066 (+ 454us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:05.971067 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:05.971220 (+ 153us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:04:05.971281 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:05.971282 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:05.972362 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:05.972363 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:05.972957 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:05.972959 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:05.973424 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:05.973425 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:05.973541 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:05.974045 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:04:05.974050 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:04:05.976707 (+ 2657us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.36.254:32881: Server oryx/127.15.36.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":27}
W20260811 08:04:05.977068 25387 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:04:05.970541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:54857 (local address 127.15.36.254:32881)
0811 08:04:05.970605 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:05.970607 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:05.970616 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:04:05.970926 (+ 310us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:05.970927 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:05.970938 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:05.971056 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:05.971439 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:05.972221 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:05.973100 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:05.973320 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:05.973422 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:05.976955 (+ 3533us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.36.195:54857: BlockingRecv error: recv got EOF from 127.15.36.195:54857 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 11 08:04:05 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.195@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:04:05 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.195@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:04:05.982784 25695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:05.977132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32881 (local address 127.15.36.195:48283)
0811 08:04:05.977194 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:05.977204 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:05.977265 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:05.977420 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:05.977421 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:05.977588 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:04:05.977629 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:05.977631 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:05.978383 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:05.978384 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:05.979088 (+ 704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:05.979092 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:05.979878 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:05.979879 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:05.979942 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:05.980507 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:04:05.980513 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:04:05.982723 (+ 2210us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.36.254:32881: Server oryx/127.15.36.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":35}
W20260811 08:04:05.983067 25387 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:04:05.977215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:48283 (local address 127.15.36.254:32881)
0811 08:04:05.977282 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:05.977285 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:05.977294 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:04:05.977321 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:05.977322 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:05.977332 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:05.977415 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:05.977728 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:05.978266 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:05.979533 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:05.979753 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:05.979937 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:05.982959 (+ 3022us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.36.195:48283: BlockingRecv error: recv got EOF from 127.15.36.195:48283 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
W20260811 08:04:05.983166 25692 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 11 08:04:06 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.193@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:04:06 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.193@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:04:06.663041 25698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:06.655360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32881 (local address 127.15.36.193:44849)
0811 08:04:06.655504 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:06.655516 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:06.655618 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:06.656149 (+ 531us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:06.656150 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:06.656348 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:04:06.656406 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:06.656407 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:06.657628 (+ 1221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:06.657629 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:06.658731 (+ 1102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:06.658736 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:06.659395 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:06.659396 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:06.659451 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:06.660201 (+ 750us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:04:06.660206 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:04:06.662934 (+ 2728us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.36.254:32881: Server oryx/127.15.36.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":72,"threads_started":1}
W20260811 08:04:06.663291 25699 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:04:06.655434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:44849 (local address 127.15.36.254:32881)
0811 08:04:06.655651 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:06.655656 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:06.655665 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:04:06.655690 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:06.655691 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:06.655701 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:06.655832 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:06.656705 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:06.657395 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:06.658870 (+ 1475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:06.659180 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:06.659251 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:06.663222 (+ 3971us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.36.193:44849: BlockingRecv error: recv got EOF from 127.15.36.193:44849 (error 108)
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":158,"threads_started":1}
Aug 11 08:04:06 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.194@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:04:06 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.194@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:04:06.821470 25700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:06.815605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32881 (local address 127.15.36.194:46591)
0811 08:04:06.815773 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:06.815789 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:06.815861 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:06.816167 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:06.816168 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:06.816371 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:04:06.816432 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:06.816434 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:06.817144 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:06.817145 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:06.817699 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:06.817701 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:06.818078 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:06.818079 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:06.818140 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:06.818693 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:04:06.818698 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:04:06.821364 (+ 2666us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.36.254:32881: Server oryx/127.15.36.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":103,"threads_started":1}
W20260811 08:04:06.821656 25699 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:04:06.815747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:46591 (local address 127.15.36.254:32881)
0811 08:04:06.815834 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:06.815836 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:06.815849 (+ 13us) server_negotiation.cc:407] Connection header received
0811 08:04:06.815966 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:06.815967 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:06.815983 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:06.816158 (+ 175us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:06.816530 (+ 372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:06.817040 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:06.817795 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:06.817997 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:06.818079 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:06.821520 (+ 3441us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.36.194:46591: BlockingRecv error: recv got EOF from 127.15.36.194:46591 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 11 08:04:06 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.195@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:04:06 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.195@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:04:06.989323 25701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:06.983685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32881 (local address 127.15.36.195:47871)
0811 08:04:06.983840 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:06.983851 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:06.983909 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:06.984236 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:06.984237 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:06.984419 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:04:06.984472 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:06.984473 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:06.985258 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:06.985259 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:06.985846 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:06.985849 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:06.986285 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:06.986286 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:06.986333 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:06.986939 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:04:06.986944 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:04:06.989209 (+ 2265us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.36.254:32881: Server oryx/127.15.36.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":76,"threads_started":1}
W20260811 08:04:06.989380 25699 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:04:06.983796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:47871 (local address 127.15.36.254:32881)
0811 08:04:06.984020 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:06.984022 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:06.984034 (+ 12us) server_negotiation.cc:407] Connection header received
0811 08:04:06.984071 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:06.984072 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:06.984084 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:06.984150 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:06.984586 (+ 436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:06.985156 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:06.986004 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:06.986205 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:06.986271 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:06.989320 (+ 3049us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.36.195:47871: BlockingRecv error: recv got EOF from 127.15.36.195:47871 (error 108)
Metrics: {"server-negotiator.queue_time_us":195}
Aug 11 08:04:07 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.193@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:04:07 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.193@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:04:07.670883 25702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:07.663749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32881 (local address 127.15.36.193:54711)
0811 08:04:07.663910 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:07.663921 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:07.663977 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:07.664311 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:07.664312 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:07.664495 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:04:07.664548 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:07.664550 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:07.665478 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:07.665479 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:07.666188 (+ 709us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:07.666192 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:07.666780 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:07.666781 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:07.666832 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:07.667663 (+ 831us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:04:07.667670 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:04:07.670757 (+ 3087us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.36.254:32881: Server oryx/127.15.36.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":91,"threads_started":1}
W20260811 08:04:07.671002 25703 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:04:07.663990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:54711 (local address 127.15.36.254:32881)
0811 08:04:07.664134 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:07.664136 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:07.664145 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:04:07.664172 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:07.664172 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:07.664183 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:07.664262 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:07.664673 (+ 411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:07.665329 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:07.666453 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:07.666674 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:07.666746 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:07.670884 (+ 4138us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.36.193:54711: BlockingRecv error: recv got EOF from 127.15.36.193:54711 (error 108)
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":82,"threads_started":1}
Aug 11 08:04:07 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.194@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:04:07 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.194@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:04:07.828812 25704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:07.822147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32881 (local address 127.15.36.194:59647)
0811 08:04:07.822453 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:07.822466 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:07.822546 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:07.822773 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:07.822774 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:07.823031 (+ 257us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:04:07.823086 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:07.823089 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:07.823911 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:07.823912 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:07.824535 (+ 623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:07.824537 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:07.825031 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:07.825032 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:07.825089 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:07.825652 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:04:07.825657 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:04:07.828741 (+ 3084us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.36.254:32881: Server oryx/127.15.36.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":270,"thread_start_us":80,"threads_started":1}
W20260811 08:04:07.828990 25703 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:04:07.822116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:59647 (local address 127.15.36.254:32881)
0811 08:04:07.822176 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:07.822178 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:07.822600 (+ 422us) server_negotiation.cc:407] Connection header received
0811 08:04:07.822629 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:07.822629 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:07.822643 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:07.822700 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:07.823203 (+ 503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:07.823805 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:07.824663 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:07.824904 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:07.824980 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:07.828903 (+ 3923us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.36.194:59647: BlockingRecv error: recv got EOF from 127.15.36.194:59647 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
Aug 11 08:04:07 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.195@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:04:07 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.195@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:04:08.002338 25705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:07.990062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32881 (local address 127.15.36.195:38777)
0811 08:04:07.990240 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:07.990252 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:07.990307 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:07.990608 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:07.990609 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:07.990795 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:04:07.990850 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:07.990852 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:07.991797 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:07.991798 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:07.992389 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:07.992392 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:07.993237 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:07.993238 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:07.993307 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:07.999347 (+ 6040us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:04:07.999355 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:04:08.002214 (+ 2859us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.36.254:32881: Server oryx/127.15.36.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":102,"threads_started":1}
W20260811 08:04:08.002367 25703 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:04:07.990285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:38777 (local address 127.15.36.254:32881)
0811 08:04:07.990369 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:07.990371 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:07.990383 (+ 12us) server_negotiation.cc:407] Connection header received
0811 08:04:07.990424 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:07.990425 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:07.990437 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:07.990511 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:07.991111 (+ 600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:07.991633 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:07.992547 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:07.992973 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:07.993161 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:08.002299 (+ 9138us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.36.195:38777: BlockingRecv error: recv got EOF from 127.15.36.195:38777 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 11 08:04:08 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.193@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:04:08 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.193@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:04:08.680660 25706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:08.671747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32881 (local address 127.15.36.193:37259)
0811 08:04:08.671969 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:08.671984 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:08.672047 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:08.672267 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:08.672268 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:08.672496 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:04:08.672554 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:08.672556 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:08.673525 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:08.673527 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:08.674294 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:08.674298 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:08.675252 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:08.675254 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:08.675330 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:08.676493 (+ 1163us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:04:08.676499 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:04:08.680521 (+ 4022us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.36.254:32881: Server oryx/127.15.36.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":114,"threads_started":1}
W20260811 08:04:08.680759 25707 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:04:08.671915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:37259 (local address 127.15.36.254:32881)
0811 08:04:08.672065 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:08.672067 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:08.672078 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:04:08.672105 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:08.672105 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:08.672117 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:08.672197 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:08.672662 (+ 465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:08.673421 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:08.674580 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:08.674825 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:08.674914 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:08.680693 (+ 5779us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.36.193:37259: BlockingRecv error: recv got EOF from 127.15.36.193:37259 (error 108)
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":90,"threads_started":1}
Aug 11 08:04:08 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.194@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:04:08 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.194@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:04:08.836876 25708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:08.829601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32881 (local address 127.15.36.194:41601)
0811 08:04:08.829762 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:08.829780 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:08.830043 (+ 263us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:08.830494 (+ 451us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:08.830495 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:08.830735 (+ 240us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:04:08.830807 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:08.830809 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:08.831619 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:08.831620 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:08.832181 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:08.832182 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:08.832681 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:08.832683 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:08.832741 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:08.833567 (+ 826us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:04:08.833573 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:04:08.836797 (+ 3224us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.36.254:32881: Server oryx/127.15.36.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":99,"threads_started":1}
W20260811 08:04:08.837273 25707 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:04:08.829889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:41601 (local address 127.15.36.254:32881)
0811 08:04:08.830098 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:08.830101 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:08.830235 (+ 134us) server_negotiation.cc:407] Connection header received
0811 08:04:08.830289 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:08.830291 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:08.830312 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:08.830446 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:08.830915 (+ 469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:08.831507 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:08.832315 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:08.832569 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:08.832648 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:08.837208 (+ 4560us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.36.194:41601: BlockingRecv error: recv got EOF from 127.15.36.194:41601 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 11 08:04:09 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.195@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:04:09 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.195@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:04:09.009339 25709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:09.003227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32881 (local address 127.15.36.195:60177)
0811 08:04:09.003539 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:09.003558 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:09.003655 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:09.003835 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:09.003836 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:09.004162 (+ 326us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:04:09.004221 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:09.004225 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:09.004994 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:09.004995 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:09.005525 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:09.005527 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:09.006143 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:09.006144 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:09.006218 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:09.006798 (+ 580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:04:09.006804 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:04:09.009161 (+ 2357us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.36.254:32881: Server oryx/127.15.36.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":288,"thread_start_us":169,"threads_started":1}
W20260811 08:04:09.009371 25707 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:04:09.003391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:60177 (local address 127.15.36.254:32881)
0811 08:04:09.003533 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:09.003536 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:09.003654 (+ 118us) server_negotiation.cc:407] Connection header received
0811 08:04:09.003727 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:09.003729 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:09.003745 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:09.003823 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:09.004357 (+ 534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:09.004887 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:09.005791 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:09.006074 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:09.006143 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:09.009323 (+ 3180us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.36.195:60177: BlockingRecv error: recv got EOF from 127.15.36.195:60177 (error 108)
Metrics: {"server-negotiator.queue_time_us":100}
Aug 11 08:04:09 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.193@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:04:09 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.193@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:04:09.688525 25710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:09.681664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32881 (local address 127.15.36.193:48411)
0811 08:04:09.681893 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:09.681912 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:09.682088 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:09.682340 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:09.682341 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:09.682677 (+ 336us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:04:09.682736 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:09.682739 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:09.683736 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:09.683737 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:09.684354 (+ 617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:09.684357 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:09.684841 (+ 484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:09.684842 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:09.684897 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:09.685469 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:04:09.685474 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:04:09.688406 (+ 2932us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.36.254:32881: Server oryx/127.15.36.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":101,"threads_started":1}
W20260811 08:04:09.688597 25711 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:04:09.681787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:48411 (local address 127.15.36.254:32881)
0811 08:04:09.682127 (+ 340us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:09.682129 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:09.682141 (+ 12us) server_negotiation.cc:407] Connection header received
0811 08:04:09.682171 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:09.682172 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:09.682183 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:09.682234 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:09.682989 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:09.683583 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:09.684468 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:09.684695 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:09.684763 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:09.688514 (+ 3751us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.36.193:48411: BlockingRecv error: recv got EOF from 127.15.36.193:48411 (error 108)
Metrics: {"server-negotiator.queue_time_us":184,"thread_start_us":153,"threads_started":1}
Aug 11 08:04:09 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.194@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:04:09 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.194@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:04:09.843823 25713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:09.837678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32881 (local address 127.15.36.194:33567)
0811 08:04:09.837894 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:09.837906 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:09.837973 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:09.838345 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:09.838347 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:09.838550 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:04:09.838605 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:09.838607 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:09.839660 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:09.839661 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:09.840270 (+ 609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:09.840273 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:09.840745 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:09.840746 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:09.840808 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:09.841374 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:04:09.841380 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:04:09.843754 (+ 2374us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.36.254:32881: Server oryx/127.15.36.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":166,"threads_started":1}
W20260811 08:04:09.844024 25711 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:04:09.837851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:33567 (local address 127.15.36.254:32881)
0811 08:04:09.838158 (+ 307us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:09.838160 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:09.838180 (+ 20us) server_negotiation.cc:407] Connection header received
0811 08:04:09.838210 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:09.838211 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:09.838222 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:09.838295 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:09.838823 (+ 528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:09.839547 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:09.840409 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:09.840629 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:09.840777 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:09.843961 (+ 3184us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.36.194:33567: BlockingRecv error: recv got EOF from 127.15.36.194:33567 (error 108)
Metrics: {"server-negotiator.queue_time_us":274}
Aug 11 08:04:10 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.195@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:04:10 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.195@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:04:10.016461 25714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:10.010100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32881 (local address 127.15.36.195:41441)
0811 08:04:10.010345 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:10.010361 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:10.010469 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:10.010744 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:10.010745 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:10.011179 (+ 434us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:04:10.011235 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:10.011238 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:10.012061 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:10.012062 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:10.012661 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:10.012663 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:10.013170 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:10.013172 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:10.013244 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:10.013862 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:04:10.013870 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:04:10.016351 (+ 2481us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.36.254:32881: Server oryx/127.15.36.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":121,"threads_started":1}
W20260811 08:04:10.016554 25711 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:04:10.010220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:41441 (local address 127.15.36.254:32881)
0811 08:04:10.010370 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:10.010372 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:10.010448 (+ 76us) server_negotiation.cc:407] Connection header received
0811 08:04:10.010626 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:10.010627 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:10.010644 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:10.010735 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:10.011385 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:10.011961 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:10.012768 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:10.012994 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:10.013181 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:10.016485 (+ 3304us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.36.195:41441: BlockingRecv error: recv got EOF from 127.15.36.195:41441 (error 108)
Metrics: {"server-negotiator.queue_time_us":121}
Aug 11 08:04:10 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.193@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:04:10 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.193@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:04:10.695008 25715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:10.689194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32881 (local address 127.15.36.193:39629)
0811 08:04:10.689448 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:10.689462 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:10.689533 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:10.689829 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:10.689830 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:10.690127 (+ 297us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:04:10.690186 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:10.690189 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:10.691053 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:10.691054 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:10.691731 (+ 677us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:10.691735 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:10.692185 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:10.692186 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:10.692239 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:10.692808 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:04:10.692813 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:04:10.694914 (+ 2101us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.36.254:32881: Server oryx/127.15.36.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":149,"threads_started":1}
W20260811 08:04:10.695355 25716 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:04:10.689333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:39629 (local address 127.15.36.254:32881)
0811 08:04:10.689505 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:10.689507 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:10.689517 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:04:10.689707 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:10.689708 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:10.689720 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:10.689796 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:10.690289 (+ 493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:10.690825 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:10.691877 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:10.692091 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:10.692159 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:10.695238 (+ 3079us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.36.193:39629: BlockingRecv error: recv got EOF from 127.15.36.193:39629 (error 108)
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":111,"threads_started":1}
Aug 11 08:04:10 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.194@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:04:10 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.194@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:04:10.850204 25717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:10.844535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32881 (local address 127.15.36.194:51751)
0811 08:04:10.844734 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:10.844745 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:10.844864 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:10.845083 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:10.845084 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:10.845296 (+ 212us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:04:10.845404 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:10.845406 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:10.846183 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:10.846184 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:10.846722 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:10.846724 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:10.847336 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:10.847337 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:10.847462 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:10.848122 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:04:10.848127 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:04:10.850139 (+ 2012us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.36.254:32881: Server oryx/127.15.36.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":126,"threads_started":1}
W20260811 08:04:10.850445 25716 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:04:10.844755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:51751 (local address 127.15.36.254:32881)
0811 08:04:10.844808 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:10.844810 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:10.844848 (+ 38us) server_negotiation.cc:407] Connection header received
0811 08:04:10.844946 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:10.844947 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:10.844959 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:10.845008 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:10.845529 (+ 521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:10.846050 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:10.846850 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:10.847197 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:10.847285 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:10.850383 (+ 3098us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.36.194:51751: BlockingRecv error: recv got EOF from 127.15.36.194:51751 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
Aug 11 08:04:11 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.195@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:04:11 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.195@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:04:11.024551 25718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:11.017131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32881 (local address 127.15.36.195:33185)
0811 08:04:11.017362 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:11.017380 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:11.017472 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:11.017939 (+ 467us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:11.017940 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:11.018113 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:04:11.018163 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:11.018164 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:11.019180 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:11.019182 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:11.019894 (+ 712us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:11.019897 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:11.020426 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:11.020427 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:11.020489 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:11.021371 (+ 882us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:04:11.021377 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:04:11.024484 (+ 3107us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.36.254:32881: Server oryx/127.15.36.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":80,"threads_started":1}
W20260811 08:04:11.024843 25716 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:04:11.017444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:33185 (local address 127.15.36.254:32881)
0811 08:04:11.017516 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:11.017519 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:11.017629 (+ 110us) server_negotiation.cc:407] Connection header received
0811 08:04:11.017672 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:11.017673 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:11.017687 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:11.017896 (+ 209us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:11.018339 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:11.019079 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:11.020072 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:11.020281 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:11.020363 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:11.024767 (+ 4404us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.36.195:33185: BlockingRecv error: recv got EOF from 127.15.36.195:33185 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 11 08:04:11 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.193@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:04:11 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.193@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:04:11.704447 25719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:11.695755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32881 (local address 127.15.36.193:43949)
0811 08:04:11.696234 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:11.696262 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:11.696383 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:11.696717 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:11.696718 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:11.697118 (+ 400us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:04:11.697174 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:11.697177 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:11.698666 (+ 1489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:11.698667 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:11.699517 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:11.699521 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:11.700042 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:11.700045 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:11.700150 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:11.701415 (+ 1265us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:04:11.701422 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:04:11.704357 (+ 2935us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.36.254:32881: Server oryx/127.15.36.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":81,"threads_started":1}
W20260811 08:04:11.704551 25721 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:04:11.695944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:43949 (local address 127.15.36.254:32881)
0811 08:04:11.696193 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:11.696195 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:11.696378 (+ 183us) server_negotiation.cc:407] Connection header received
0811 08:04:11.696579 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:11.696580 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:11.696592 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:11.696653 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:11.697678 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:11.698494 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:11.699648 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:11.699880 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:11.699966 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:11.704477 (+ 4511us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.36.193:43949: BlockingRecv error: recv got EOF from 127.15.36.193:43949 (error 108)
Metrics: {"server-negotiator.queue_time_us":218,"thread_start_us":194,"threads_started":1}
Aug 11 08:04:11 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.194@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:04:11 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.194@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:04:11.857178 25722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:11.851018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32881 (local address 127.15.36.194:43889)
0811 08:04:11.851254 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:11.851267 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:11.851361 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:11.851579 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:11.851580 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:11.851806 (+ 226us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:04:11.851875 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:11.851878 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:11.852613 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:11.852614 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:11.853266 (+ 652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:11.853268 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:11.853666 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:11.853666 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:11.853731 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:11.854499 (+ 768us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:04:11.854506 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:04:11.857105 (+ 2599us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.36.254:32881: Server oryx/127.15.36.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":81,"threads_started":1}
W20260811 08:04:11.857421 25721 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:04:11.851111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:43889 (local address 127.15.36.254:32881)
0811 08:04:11.851235 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:11.851237 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:11.851339 (+ 102us) server_negotiation.cc:407] Connection header received
0811 08:04:11.851424 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:11.851425 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:11.851486 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:11.851556 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:11.851966 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:11.852524 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:11.853362 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:11.853577 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:11.853655 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:11.857281 (+ 3626us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.36.194:43889: BlockingRecv error: recv got EOF from 127.15.36.194:43889 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
Aug 11 08:04:12 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.195@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:04:12 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.195@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:04:12.031162 25723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:12.025524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32881 (local address 127.15.36.195:52133)
0811 08:04:12.025769 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:12.025787 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:12.025900 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:12.026082 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:12.026084 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:12.026357 (+ 273us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:04:12.026418 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:12.026422 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:12.027236 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:12.027237 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:12.027821 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:12.027823 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:12.028190 (+ 367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:12.028191 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:12.028254 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:12.028768 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:04:12.028774 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:04:12.030949 (+ 2175us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.36.254:32881: Server oryx/127.15.36.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":111,"threads_started":1}
W20260811 08:04:12.031246 25721 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:04:12.025696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:52133 (local address 127.15.36.254:32881)
0811 08:04:12.025809 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:12.025812 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:12.025882 (+ 70us) server_negotiation.cc:407] Connection header received
0811 08:04:12.025985 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:12.025986 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:12.026006 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:12.026074 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:12.026513 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:12.027155 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:12.027912 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:12.028113 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:12.028191 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:12.031178 (+ 2987us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.36.195:52133: BlockingRecv error: recv got EOF from 127.15.36.195:52133 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
Aug 11 08:04:12 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.193@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:04:12 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.193@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:04:12.710650 25724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:12.705351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32881 (local address 127.15.36.193:52889)
0811 08:04:12.705520 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:12.705529 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:12.705578 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:12.705888 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:12.705889 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:12.706090 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:04:12.706147 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:12.706148 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:12.706943 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:12.706944 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:12.707717 (+ 773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:12.707720 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:12.708118 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:12.708119 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:12.708177 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:12.708727 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:04:12.708732 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:04:12.710551 (+ 1819us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.36.254:32881: Server oryx/127.15.36.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":70,"threads_started":1}
W20260811 08:04:12.710736 25725 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:04:12.705503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:52889 (local address 127.15.36.254:32881)
0811 08:04:12.705641 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:12.705643 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:12.705652 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:04:12.705680 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:12.705681 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:12.705692 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:12.705776 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:12.706271 (+ 495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:12.706823 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:12.707804 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:12.708019 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:12.708118 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:12.710659 (+ 2541us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.36.193:52889: BlockingRecv error: recv got EOF from 127.15.36.193:52889 (error 108)
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":75,"threads_started":1}
Aug 11 08:04:12 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.194@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:04:12 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.194@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:04:12.864992 25726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:12.858101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32881 (local address 127.15.36.194:55403)
0811 08:04:12.858314 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:12.858327 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:12.858893 (+ 566us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:12.859134 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:12.859135 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:12.859340 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:04:12.859399 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:12.859401 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:12.860296 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:12.860298 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:12.861180 (+ 882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:12.861183 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:12.861697 (+ 514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:12.861698 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:12.861755 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:12.862450 (+ 695us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:04:12.862456 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:04:12.864907 (+ 2451us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.36.254:32881: Server oryx/127.15.36.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":116,"threads_started":1}
W20260811 08:04:12.865206 25725 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:04:12.858243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:55403 (local address 127.15.36.254:32881)
0811 08:04:12.858514 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:12.858517 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:12.858753 (+ 236us) server_negotiation.cc:407] Connection header received
0811 08:04:12.859037 (+ 284us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:12.859038 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:12.859057 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:12.859126 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:12.859668 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:12.860205 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:12.861389 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:12.861619 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:12.861698 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:12.865138 (+ 3440us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.36.194:55403: BlockingRecv error: recv got EOF from 127.15.36.194:55403 (error 108)
Metrics: {"server-negotiator.queue_time_us":242}
Aug 11 08:04:13 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.195@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:04:13 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.195@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:04:13.043267 25727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:13.031851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32881 (local address 127.15.36.195:37493)
0811 08:04:13.032042 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:13.032056 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:13.032153 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:13.032326 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:13.032327 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:13.032524 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:04:13.032576 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:13.032578 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:13.033271 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:13.033272 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:13.033951 (+ 679us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:13.033955 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:13.034404 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:13.034405 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:13.034480 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:13.040830 (+ 6350us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:04:13.040837 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:04:13.043164 (+ 2327us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.36.254:32881: Server oryx/127.15.36.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":101,"threads_started":1}
W20260811 08:04:13.043395 25725 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:04:13.031994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:37493 (local address 127.15.36.254:32881)
0811 08:04:13.032050 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:13.032054 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:13.032136 (+ 82us) server_negotiation.cc:407] Connection header received
0811 08:04:13.032232 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:13.032233 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:13.032254 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:13.032320 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:13.032662 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:13.033174 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:13.034075 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:13.034304 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:13.034401 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:13.043281 (+ 8880us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.36.195:37493: BlockingRecv error: recv got EOF from 127.15.36.195:37493 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
Aug 11 08:04:13 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.193@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:04:13 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.193@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:04:13.718137 25728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:13.711609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32881 (local address 127.15.36.193:38279)
0811 08:04:13.711833 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:13.711845 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:13.711902 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:13.712139 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:13.712140 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:13.712311 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:04:13.712367 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:13.712369 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:13.713704 (+ 1335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:13.713705 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:13.714257 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:13.714259 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:13.714751 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:13.714752 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:13.714799 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:13.715544 (+ 745us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:04:13.715549 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:04:13.718051 (+ 2502us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.36.254:32881: Server oryx/127.15.36.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":80,"threads_started":1}
W20260811 08:04:13.718374 25729 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:04:13.711789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:38279 (local address 127.15.36.254:32881)
0811 08:04:13.711930 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:13.711932 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:13.711949 (+ 17us) server_negotiation.cc:407] Connection header received
0811 08:04:13.711978 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:13.711978 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:13.711990 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:13.712074 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:13.712631 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:13.713603 (+ 972us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:13.714422 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:13.714646 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:13.714736 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:13.718235 (+ 3499us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.36.193:38279: BlockingRecv error: recv got EOF from 127.15.36.193:38279 (error 108)
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":73,"threads_started":1}
Aug 11 08:04:13 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.194@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:04:13 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.194@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:04:13.872145 25730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:13.865647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32881 (local address 127.15.36.194:47513)
0811 08:04:13.865816 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:13.865831 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:13.865958 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:13.866327 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:13.866328 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:13.866511 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:04:13.866565 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:13.866567 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:13.867684 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:13.867686 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:13.868319 (+ 633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:13.868321 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:13.868724 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:13.868725 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:13.868827 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:13.869434 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:04:13.869439 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:04:13.872074 (+ 2635us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.36.254:32881: Server oryx/127.15.36.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":78,"threads_started":1}
W20260811 08:04:13.872274 25729 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:04:13.865772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:47513 (local address 127.15.36.254:32881)
0811 08:04:13.865849 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:13.865851 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:13.865967 (+ 116us) server_negotiation.cc:407] Connection header received
0811 08:04:13.866087 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:13.866089 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:13.866103 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:13.866191 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:13.866688 (+ 497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:13.867588 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:13.868431 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:13.868644 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:13.868705 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:13.872168 (+ 3463us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.36.194:47513: BlockingRecv error: recv got EOF from 127.15.36.194:47513 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 11 08:04:14 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.195@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:04:14 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.195@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:04:14.049477 25732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:14.043982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32881 (local address 127.15.36.195:58409)
0811 08:04:14.044125 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:14.044136 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:14.044194 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:14.044371 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:14.044372 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:14.044563 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:04:14.044614 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:14.044616 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:14.045540 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:14.045541 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:14.046143 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:14.046145 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:14.046528 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:14.046529 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:14.046581 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:14.047191 (+ 610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:04:14.047197 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:04:14.049396 (+ 2199us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.36.254:32881: Server oryx/127.15.36.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":82,"threads_started":1}
W20260811 08:04:14.049799 25729 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:04:14.044083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:58409 (local address 127.15.36.254:32881)
0811 08:04:14.044128 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:14.044131 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:14.044180 (+ 49us) server_negotiation.cc:407] Connection header received
0811 08:04:14.044249 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:14.044249 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:14.044262 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:14.044324 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:14.044715 (+ 391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:14.045444 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:14.046246 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:14.046445 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:14.046509 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:14.049714 (+ 3205us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.36.195:58409: BlockingRecv error: recv got EOF from 127.15.36.195:58409 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
Aug 11 08:04:14 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.193@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:04:14 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.193@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:04:14.724619 25733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:14.718743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32881 (local address 127.15.36.193:46867)
0811 08:04:14.718891 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:14.718905 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:14.719001 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:14.719284 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:14.719285 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:14.719478 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:04:14.719533 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:14.719535 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:14.720234 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:14.720235 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:14.720890 (+ 655us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:14.720893 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:14.721472 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:14.721474 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:14.721539 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:14.722478 (+ 939us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:04:14.722482 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:04:14.724554 (+ 2072us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.36.254:32881: Server oryx/127.15.36.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":80,"threads_started":1}
W20260811 08:04:14.724841 25734 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:04:14.718805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:46867 (local address 127.15.36.254:32881)
0811 08:04:14.719074 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:14.719076 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:14.719085 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:04:14.719111 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:14.719112 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:14.719125 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:14.719240 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:14.719614 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:14.720136 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:14.721017 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:14.721277 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:14.721351 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:14.724771 (+ 3420us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.36.193:46867: BlockingRecv error: recv got EOF from 127.15.36.193:46867 (error 108)
Metrics: {"server-negotiator.queue_time_us":242,"thread_start_us":71,"threads_started":1}
Aug 11 08:04:14 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.194@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:04:14 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.194@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:04:14.879647 25735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:14.872901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32881 (local address 127.15.36.194:56715)
0811 08:04:14.873295 (+ 394us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:14.873312 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:14.873380 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:14.873701 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:14.873702 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:14.873930 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:04:14.873987 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:14.873988 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:14.874781 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:14.874782 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:14.875436 (+ 654us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:14.875438 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:14.875851 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:14.875853 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:14.875912 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:14.876556 (+ 644us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:04:14.876562 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:04:14.879539 (+ 2977us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.36.254:32881: Server oryx/127.15.36.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":369,"thread_start_us":100,"threads_started":1}
W20260811 08:04:14.879966 25734 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:04:14.873233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:56715 (local address 127.15.36.254:32881)
0811 08:04:14.873383 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:14.873386 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:14.873399 (+ 13us) server_negotiation.cc:407] Connection header received
0811 08:04:14.873434 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:14.873435 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:14.873448 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:14.873517 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:14.874102 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:14.874665 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:14.875553 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:14.875753 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:14.875822 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:14.879897 (+ 4075us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.36.194:56715: BlockingRecv error: recv got EOF from 127.15.36.194:56715 (error 108)
Metrics: {"server-negotiator.queue_time_us":117}
Aug 11 08:04:15 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.195@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:04:15 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.195@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:04:15.057605 25736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:15.050011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32881 (local address 127.15.36.195:55231)
0811 08:04:15.050217 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:15.050237 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:15.050380 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:15.050592 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:15.050593 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:15.050860 (+ 267us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:04:15.050930 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:15.050932 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:15.051716 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:15.051717 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:15.052686 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:15.052690 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:15.053360 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:15.053361 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:15.053425 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:15.054291 (+ 866us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:04:15.054298 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:04:15.057491 (+ 3193us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.36.254:32881: Server oryx/127.15.36.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":94,"threads_started":1}
W20260811 08:04:15.057653 25734 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:04:15.050270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:55231 (local address 127.15.36.254:32881)
0811 08:04:15.050331 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:15.050333 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:15.050362 (+ 29us) server_negotiation.cc:407] Connection header received
0811 08:04:15.050481 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:15.050482 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:15.050497 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:15.050558 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:15.051060 (+ 502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:15.051614 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:15.052809 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:15.053245 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:15.053342 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:15.057584 (+ 4242us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.36.195:55231: BlockingRecv error: recv got EOF from 127.15.36.195:55231 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
Aug 11 08:04:15 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.193@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:04:15 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.193@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:04:15.731743 25737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:15.725215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32881 (local address 127.15.36.193:49243)
0811 08:04:15.725464 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:15.725479 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:15.725560 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:15.725755 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:15.725756 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:15.725970 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:04:15.726025 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:15.726027 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:15.726916 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:15.726917 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:15.727820 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:15.727824 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:15.728683 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:15.728684 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:15.728746 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:15.729308 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:04:15.729313 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:04:15.731661 (+ 2348us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.36.254:32881: Server oryx/127.15.36.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":144,"threads_started":1}
W20260811 08:04:15.731964 25738 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:04:15.725402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:49243 (local address 127.15.36.254:32881)
0811 08:04:15.725581 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:15.725583 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:15.725594 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:04:15.725622 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:15.725623 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:15.725634 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:15.725707 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:15.726182 (+ 475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:15.726761 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:15.727937 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:15.728535 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:15.728684 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:15.731885 (+ 3201us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.36.193:49243: BlockingRecv error: recv got EOF from 127.15.36.193:49243 (error 108)
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":76,"threads_started":1}
Aug 11 08:04:15 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.194@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:04:15 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.194@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:04:15.886790 25739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:15.880484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32881 (local address 127.15.36.194:36647)
0811 08:04:15.880686 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:15.880699 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:15.880791 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:15.881461 (+ 670us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:15.881463 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:15.881699 (+ 236us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:04:15.881773 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:15.881775 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:15.882468 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:15.882469 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:15.883338 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:15.883342 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:15.883784 (+ 442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:15.883785 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:15.883859 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:15.884488 (+ 629us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:04:15.884493 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:04:15.886683 (+ 2190us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.36.254:32881: Server oryx/127.15.36.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":127,"threads_started":1}
W20260811 08:04:15.886885 25738 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:04:15.880819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:36647 (local address 127.15.36.254:32881)
0811 08:04:15.880893 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:15.880895 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:15.880910 (+ 15us) server_negotiation.cc:407] Connection header received
0811 08:04:15.880959 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:15.880960 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:15.880990 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:15.881340 (+ 350us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:15.881850 (+ 510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:15.882365 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:15.883452 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:15.883680 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:15.883829 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:15.886804 (+ 2975us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.36.194:36647: BlockingRecv error: recv got EOF from 127.15.36.194:36647 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
Aug 11 08:04:16 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.195@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:04:16 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.195@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:04:16.065124 25740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:16.058247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32881 (local address 127.15.36.195:35513)
0811 08:04:16.058405 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:16.058423 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:16.058531 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:16.058936 (+ 405us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:16.058937 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:16.059382 (+ 445us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:04:16.059442 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:16.059445 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:16.060326 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:16.060328 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:16.060990 (+ 662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:16.060993 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:16.061981 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:16.061983 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:16.062063 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:16.062764 (+ 701us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:04:16.062768 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:04:16.065058 (+ 2290us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.36.254:32881: Server oryx/127.15.36.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":95,"threads_started":1}
W20260811 08:04:16.065454 25738 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:04:16.058550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:35513 (local address 127.15.36.254:32881)
0811 08:04:16.058688 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:16.058690 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:16.058697 (+ 7us) server_negotiation.cc:407] Connection header received
0811 08:04:16.058773 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:16.058775 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:16.058789 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:16.058873 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:16.059601 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:16.060154 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:16.061158 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:16.061546 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:16.061799 (+ 253us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:16.065371 (+ 3572us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.36.195:35513: BlockingRecv error: recv got EOF from 127.15.36.195:35513 (error 108)
Metrics: {"server-negotiator.queue_time_us":117}
Aug 11 08:04:16 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.193@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:04:16 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.193@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:04:16.738158 25741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:16.732236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32881 (local address 127.15.36.193:41715)
0811 08:04:16.732406 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:16.732418 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:16.732480 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:16.732632 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:16.732633 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:16.732844 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:04:16.732897 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:16.732899 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:16.733673 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:16.733674 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:16.734374 (+ 700us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:16.734377 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:16.734921 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:16.734923 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:16.735058 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:16.735626 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:04:16.735632 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:04:16.738081 (+ 2449us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.36.254:32881: Server oryx/127.15.36.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":108,"threads_started":1}
W20260811 08:04:16.738351 25742 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:04:16.732362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:41715 (local address 127.15.36.254:32881)
0811 08:04:16.732481 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:16.732483 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:16.732491 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:04:16.732537 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:16.732537 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:16.732548 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:16.732615 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:16.733005 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:16.733567 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:16.734567 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:16.734824 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:16.734890 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:16.738238 (+ 3348us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.36.193:41715: BlockingRecv error: recv got EOF from 127.15.36.193:41715 (error 108)
Metrics: {"server-negotiator.queue_time_us":100,"thread_start_us":52,"threads_started":1}
Aug 11 08:04:16 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.194@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:04:16 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.194@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:04:16.893823 25743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:16.887648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32881 (local address 127.15.36.194:47023)
0811 08:04:16.887952 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:16.887962 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:16.888052 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:16.888223 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:16.888224 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:16.888429 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:04:16.888482 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:16.888484 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:16.889170 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:16.889171 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:16.889751 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:16.889753 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:16.890145 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:16.890146 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:16.890210 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:16.890779 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:04:16.890834 (+ 55us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:04:16.893713 (+ 2879us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.36.254:32881: Server oryx/127.15.36.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":204,"threads_started":1}
W20260811 08:04:16.894172 25742 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:04:16.887748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:47023 (local address 127.15.36.254:32881)
0811 08:04:16.887837 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:16.887839 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:16.888036 (+ 197us) server_negotiation.cc:407] Connection header received
0811 08:04:16.888127 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:16.888128 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:16.888143 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:16.888214 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:16.888563 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:16.889075 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:16.889845 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:16.890064 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:16.890145 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:16.893870 (+ 3725us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.36.194:47023: BlockingRecv error: recv got EOF from 127.15.36.194:47023 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 11 08:04:17 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.195@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:04:17 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.195@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:04:17.072466 25744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:17.066120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32881 (local address 127.15.36.195:55433)
0811 08:04:17.066298 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:17.066314 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:17.066389 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:17.066609 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:17.066610 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:17.066806 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:04:17.066855 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:17.066856 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:17.067765 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:17.067766 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:17.068410 (+ 644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:17.068413 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:17.068971 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:17.068972 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:17.069038 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:17.069666 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:04:17.069672 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:04:17.072383 (+ 2711us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.36.254:32881: Server oryx/127.15.36.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":118,"threads_started":1}
W20260811 08:04:17.072674 25742 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:04:17.066250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:55433 (local address 127.15.36.254:32881)
0811 08:04:17.066423 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:17.066425 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:17.066436 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:04:17.066464 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:17.066465 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:17.066477 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:17.066545 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:17.067091 (+ 546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:17.067652 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:17.068568 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:17.068765 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:17.068835 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:17.072582 (+ 3747us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.36.195:55433: BlockingRecv error: recv got EOF from 127.15.36.195:55433 (error 108)
Metrics: {"server-negotiator.queue_time_us":149}
Aug 11 08:04:17 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.193@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:04:17 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.193@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:04:17.745735 25745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:17.738887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32881 (local address 127.15.36.193:56265)
0811 08:04:17.739165 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:17.739178 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:17.739270 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:17.739476 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:17.739478 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:17.739703 (+ 225us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:04:17.739753 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:17.739755 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:17.740960 (+ 1205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:17.740961 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:17.741834 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:17.741837 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:17.742341 (+ 504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:17.742341 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:17.742410 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:17.743055 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:04:17.743061 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:04:17.745668 (+ 2607us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.36.254:32881: Server oryx/127.15.36.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":170,"threads_started":1}
W20260811 08:04:17.745963 25746 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:04:17.739107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:56265 (local address 127.15.36.254:32881)
0811 08:04:17.739236 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:17.739239 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:17.739248 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:04:17.739362 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:17.739363 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:17.739377 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:17.739454 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:17.739867 (+ 413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:17.740830 (+ 963us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:17.742019 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:17.742231 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:17.742301 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:17.745886 (+ 3585us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.36.193:56265: BlockingRecv error: recv got EOF from 127.15.36.193:56265 (error 108)
Metrics: {"server-negotiator.queue_time_us":104,"thread_start_us":67,"threads_started":1}
Aug 11 08:04:17 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.194@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:04:17 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.194@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:04:17.902863 25747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:17.894857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32881 (local address 127.15.36.194:49851)
0811 08:04:17.895026 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:17.895042 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:17.895115 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:17.895796 (+ 681us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:17.895797 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:17.895996 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:04:17.896049 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:17.896050 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:17.897228 (+ 1178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:17.897230 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:17.898305 (+ 1075us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:17.898312 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:17.898840 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:17.898841 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:17.898897 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:17.899867 (+ 970us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:04:17.899874 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:04:17.902594 (+ 2720us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.36.254:32881: Server oryx/127.15.36.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":102,"threads_started":1}
W20260811 08:04:17.902904 25746 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:04:17.895369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:49851 (local address 127.15.36.254:32881)
0811 08:04:17.895471 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:17.895474 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:17.895488 (+ 14us) server_negotiation.cc:407] Connection header received
0811 08:04:17.895521 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:17.895523 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:17.895535 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:17.895608 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:17.896244 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:17.897035 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:17.898461 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:17.898715 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:17.898796 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:17.902857 (+ 4061us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.36.194:49851: BlockingRecv error: recv got EOF from 127.15.36.194:49851 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Aug 11 08:04:18 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.195@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:04:18 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.195@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:04:18.084142 25748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:18.073118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32881 (local address 127.15.36.195:44355)
0811 08:04:18.073334 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:18.073346 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:18.073416 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:18.073610 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:18.073611 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:18.073856 (+ 245us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:04:18.073917 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:18.073920 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:18.074788 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:18.074789 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:18.076109 (+ 1320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:18.076113 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:18.076571 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:18.076572 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:18.076636 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:18.081814 (+ 5178us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:04:18.081822 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:04:18.084053 (+ 2231us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.36.254:32881: Server oryx/127.15.36.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":72,"threads_started":1}
W20260811 08:04:18.084338 25746 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:04:18.073217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:44355 (local address 127.15.36.254:32881)
0811 08:04:18.073306 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:18.073312 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:18.073421 (+ 109us) server_negotiation.cc:407] Connection header received
0811 08:04:18.073501 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:18.073502 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:18.073520 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:18.073593 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:18.074060 (+ 467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:18.074630 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:18.076259 (+ 1629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:18.076479 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:18.076551 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:18.084263 (+ 7712us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.36.195:44355: BlockingRecv error: recv got EOF from 127.15.36.195:44355 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 11 08:04:18 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.193@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:04:18 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.193@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:04:18.752699 25750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:18.746380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32881 (local address 127.15.36.193:57221)
0811 08:04:18.746534 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:18.746551 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:18.746606 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:18.746822 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:18.746823 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:18.747060 (+ 237us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:04:18.747115 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:18.747117 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:18.748036 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:18.748037 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:18.748703 (+ 666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:18.748706 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:18.749220 (+ 514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:18.749222 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:18.749290 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:18.749841 (+ 551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:04:18.749847 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:04:18.752564 (+ 2717us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.36.254:32881: Server oryx/127.15.36.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":94,"threads_started":1}
W20260811 08:04:18.752776 25751 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:04:18.746468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:57221 (local address 127.15.36.254:32881)
0811 08:04:18.746638 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:18.746641 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:18.746651 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:04:18.746683 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:18.746684 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:18.746696 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:18.746767 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:18.747312 (+ 545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:18.747903 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:18.748818 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:18.749095 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:18.749177 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:18.752686 (+ 3509us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.36.193:57221: BlockingRecv error: recv got EOF from 127.15.36.193:57221 (error 108)
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":109,"threads_started":1}
Aug 11 08:04:18 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.194@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:04:18 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.194@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:04:18.909001 25752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:18.903626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32881 (local address 127.15.36.194:35787)
0811 08:04:18.903828 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:18.903839 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:18.903892 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:18.904125 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:18.904127 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:18.904315 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:04:18.904378 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:18.904380 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:18.905379 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:18.905380 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:18.905916 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:18.905917 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:18.906334 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:18.906335 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:18.906384 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:18.907002 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:04:18.907007 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:04:18.908937 (+ 1930us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.36.254:32881: Server oryx/127.15.36.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":82,"threads_started":1}
W20260811 08:04:18.909394 25751 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:04:18.903826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:35787 (local address 127.15.36.254:32881)
0811 08:04:18.903924 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:18.903926 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:18.903939 (+ 13us) server_negotiation.cc:407] Connection header received
0811 08:04:18.903977 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:18.903978 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:18.903990 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:18.904064 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:18.904499 (+ 435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:18.905121 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:18.906032 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:18.906252 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:18.906317 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:18.909310 (+ 2993us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.36.194:35787: BlockingRecv error: recv got EOF from 127.15.36.194:35787 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 11 08:04:19 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.195@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:04:19 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.195@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:04:19.090487 25754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:19.084784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32881 (local address 127.15.36.195:46533)
0811 08:04:19.085117 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:19.085129 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:19.085203 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:19.085469 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:19.085470 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:19.085654 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:04:19.085703 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:19.085704 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:19.086493 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:19.086494 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:19.087195 (+ 701us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:19.087198 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:19.087599 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:19.087600 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:19.087654 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:19.088246 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:04:19.088252 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:04:19.090399 (+ 2147us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.36.254:32881: Server oryx/127.15.36.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":304,"thread_start_us":260,"threads_started":1}
W20260811 08:04:19.090674 25751 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:04:19.084906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:46533 (local address 127.15.36.254:32881)
0811 08:04:19.084983 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:19.084993 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:19.085230 (+ 237us) server_negotiation.cc:407] Connection header received
0811 08:04:19.085266 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:19.085267 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:19.085281 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:19.085376 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:19.085805 (+ 429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:19.086384 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:19.087280 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:19.087507 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:19.087569 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:19.090596 (+ 3027us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.36.195:46533: BlockingRecv error: recv got EOF from 127.15.36.195:46533 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
Aug 11 08:04:19 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.193@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:04:19 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.193@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:04:19.760533 25755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:19.753736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32881 (local address 127.15.36.193:38807)
0811 08:04:19.754068 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:19.754082 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:19.754168 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:19.754420 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:19.754421 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:19.754642 (+ 221us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:04:19.754695 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:19.754698 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:19.755638 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:19.755640 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:19.756734 (+ 1094us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:19.756739 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:19.757430 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:19.757431 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:19.757506 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:19.758336 (+ 830us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:04:19.758342 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:04:19.760465 (+ 2123us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.36.254:32881: Server oryx/127.15.36.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":305,"thread_start_us":251,"threads_started":1}
W20260811 08:04:19.760964 25756 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:04:19.754013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:38807 (local address 127.15.36.254:32881)
0811 08:04:19.754213 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:19.754215 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:19.754231 (+ 16us) server_negotiation.cc:407] Connection header received
0811 08:04:19.754258 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:19.754259 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:19.754270 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:19.754357 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:19.754832 (+ 475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:19.755450 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:19.756873 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:19.757309 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:19.757394 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:19.760869 (+ 3475us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.36.193:38807: BlockingRecv error: recv got EOF from 127.15.36.193:38807 (error 108)
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":138,"threads_started":1}
Aug 11 08:04:19 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.194@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:04:19 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.194@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:04:19.916247 25757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:19.909691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32881 (local address 127.15.36.194:34473)
0811 08:04:19.909870 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:19.909883 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:19.909953 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:19.910264 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:19.910266 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:19.910603 (+ 337us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:04:19.910706 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:19.910708 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:19.911662 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:19.911663 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:19.912236 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:19.912238 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:19.912883 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:19.912884 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:19.912953 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:19.913746 (+ 793us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:04:19.913752 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:04:19.916181 (+ 2429us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.36.254:32881: Server oryx/127.15.36.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":118,"threads_started":1}
W20260811 08:04:19.916431 25756 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:04:19.909894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:34473 (local address 127.15.36.254:32881)
0811 08:04:19.910007 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:19.910009 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:19.910020 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:04:19.910051 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:19.910052 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:19.910063 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:19.910135 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:19.910880 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:19.911506 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:19.912418 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:19.912724 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:19.912796 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:19.916374 (+ 3578us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.36.194:34473: BlockingRecv error: recv got EOF from 127.15.36.194:34473 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
Aug 11 08:04:20 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.195@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:04:20 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.195@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:04:20.097576 25758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:20.091169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32881 (local address 127.15.36.195:33283)
0811 08:04:20.091411 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:20.091427 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:20.091511 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:20.091749 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:20.091750 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:20.091938 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:04:20.091992 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:20.091994 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:20.092723 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:20.092724 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:20.093299 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:20.093302 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:20.093751 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:20.093752 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:20.093805 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:20.094778 (+ 973us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:04:20.094787 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:04:20.097488 (+ 2701us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.36.254:32881: Server oryx/127.15.36.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":111,"threads_started":1}
W20260811 08:04:20.098012 25756 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:04:20.091338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:33283 (local address 127.15.36.254:32881)
0811 08:04:20.091459 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:20.091461 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:20.091492 (+ 31us) server_negotiation.cc:407] Connection header received
0811 08:04:20.091612 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:20.091613 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:20.091626 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:20.091681 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:20.092105 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:20.092626 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:20.093438 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:20.093630 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:20.093701 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:20.097935 (+ 4234us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.36.195:33283: BlockingRecv error: recv got EOF from 127.15.36.195:33283 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
Aug 11 08:04:20 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.193@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:04:20 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.193@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:04:20.768679 25761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:20.761587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32881 (local address 127.15.36.193:40581)
0811 08:04:20.761897 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:20.761914 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:20.762205 (+ 291us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:20.762466 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:20.762467 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:20.762655 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:04:20.762709 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:20.762710 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:20.764054 (+ 1344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:20.764055 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:20.764714 (+ 659us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:20.764717 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:20.765240 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:20.765242 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:20.765311 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:20.766047 (+ 736us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:04:20.766052 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:04:20.768563 (+ 2511us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.36.254:32881: Server oryx/127.15.36.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":281,"thread_start_us":107,"threads_started":1}
W20260811 08:04:20.768752 25762 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:04:20.761692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:40581 (local address 127.15.36.254:32881)
0811 08:04:20.762221 (+ 529us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:20.762223 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:20.762237 (+ 14us) server_negotiation.cc:407] Connection header received
0811 08:04:20.762274 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:20.762275 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:20.762286 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:20.762377 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:20.763077 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:20.763928 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:20.764830 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:20.765121 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:20.765225 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:20.768672 (+ 3447us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.36.193:40581: BlockingRecv error: recv got EOF from 127.15.36.193:40581 (error 108)
Metrics: {"server-negotiator.queue_time_us":489,"thread_start_us":335,"threads_started":1}
Aug 11 08:04:20 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.194@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:04:20 dist-test-slave-2w3w krb5kdc[24539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.36.194@KRBTEST.COM for oryx/127.15.36.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:04:20.924721 25763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:20.917592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32881 (local address 127.15.36.194:52789)
0811 08:04:20.917830 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:20.917847 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:20.917931 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:20.918133 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:20.918134 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:20.918347 (+ 213us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:04:20.918403 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:20.918405 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:20.919228 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:20.919229 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:20.919858 (+ 629us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:20.919860 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:20.920316 (+ 456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:20.920318 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:20.920388 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:20.921266 (+ 878us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:04:20.921272 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:04:20.924468 (+ 3196us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.36.254:32881: Server oryx/127.15.36.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":100,"threads_started":1}
W20260811 08:04:20.924804 25762 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:04:20.917778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:52789 (local address 127.15.36.254:32881)
0811 08:04:20.917875 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:20.917878 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:20.917909 (+ 31us) server_negotiation.cc:407] Connection header received
0811 08:04:20.918026 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:20.918027 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:20.918041 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:20.918126 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:20.918497 (+ 371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:20.919127 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:20.919965 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:20.920206 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:20.920315 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:20.924697 (+ 4382us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.36.194:52789: BlockingRecv error: recv got EOF from 127.15.36.194:52789 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 08:04:20.963973 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 25209
I20260811 08:04:20.986609 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 25388
I20260811 08:04:21.002351 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 25542
I20260811 08:04:21.027609 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 25129
2026-08-11T08:04:21Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (18256 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-11T08:04:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:04:21Z Disabled control of system clock
I20260811 08:04:21.083530 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435400844580-15507-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435400844580-15507-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435400844580-15507-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:34711
--webserver_interface=127.15.36.254
--webserver_port=0
--builtin_ntp_servers=127.15.36.212:38543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.36.254:34711
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260811 08:04:21.223357 25767 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:04:21.223628 25767 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:04:21.223652 25767 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:04:21.225167 25767 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:04:21.225237 25767 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:04:21.225251 25767 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:04:21.225266 25767 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:04:21.225279 25767 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:04:21.227358 25767 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:38543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435400844580-15507-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435400844580-15507-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.36.254:34711
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:34711
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.36.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25767
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435400844580-15507-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:04:21.227773 25767 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:04:21.228202 25767 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:04:21.237217 25776 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:04:21.237217 25773 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:04:21.237224 25774 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:04:21.237170 25767 server_base.cc:1034] running on GCE node
I20260811 08:04:21.238590 25767 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:04:21.239173 25767 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:04:21.240607 25767 hybrid_clock.cc:648] HybridClock initialized: now 1786435461240511 us; error 77 us; skew 500 ppm
I20260811 08:04:21.242915 25767 webserver.cc:460] Webserver started at http://127.15.36.254:33775/ using document root <none> and password file <none>
I20260811 08:04:21.243533 25767 fs_manager.cc:359] Metadata directory not provided
I20260811 08:04:21.243707 25767 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:04:21.243897 25767 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:04:21.245527 25767 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435400844580-15507-0/minicluster-data/master-0/data/instance:
uuid: "2d5d6b7964184f62a9365813f8268edb"
format_stamp: "Formatted at 2026-08-11 08:04:21 on dist-test-slave-2w3w"
server_key: "b20d0429559aaf02bd6ca6d10e77711b"
server_key_iv: "5cb8b93a056c298da7e6a1c6bbf1df7f"
server_key_version: "encryptionkey@0"
I20260811 08:04:21.246054 25767 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435400844580-15507-0/minicluster-data/master-0/wal/instance:
uuid: "2d5d6b7964184f62a9365813f8268edb"
format_stamp: "Formatted at 2026-08-11 08:04:21 on dist-test-slave-2w3w"
server_key: "b20d0429559aaf02bd6ca6d10e77711b"
server_key_iv: "5cb8b93a056c298da7e6a1c6bbf1df7f"
server_key_version: "encryptionkey@0"
I20260811 08:04:21.247753 25767 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260811 08:04:21.248870 25785 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:04:21.249161 25767 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:04:21.249372 25767 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435400844580-15507-0/minicluster-data/master-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435400844580-15507-0/minicluster-data/master-0/wal
uuid: "2d5d6b7964184f62a9365813f8268edb"
format_stamp: "Formatted at 2026-08-11 08:04:21 on dist-test-slave-2w3w"
server_key: "b20d0429559aaf02bd6ca6d10e77711b"
server_key_iv: "5cb8b93a056c298da7e6a1c6bbf1df7f"
server_key_version: "encryptionkey@0"
I20260811 08:04:21.249517 25767 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435400844580-15507-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435400844580-15507-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435400844580-15507-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:04:21.265180 25767 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:04:21.265620 25767 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:04:21.265830 25767 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:04:21.271018 25767 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.254:34711
I20260811 08:04:21.271152 25846 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.254:34711 every 8 connection(s)
I20260811 08:04:21.271667 25767 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
I20260811 08:04:21.273036 25847 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:04:21.273097 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 25767
I20260811 08:04:21.273193 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435400844580-15507-0/minicluster-data/master-0/wal/instance
I20260811 08:04:21.273433 15507 external_mini_cluster.cc:1428] Setting key 98272e037fb0852897468cfb245d5b31
I20260811 08:04:21.277992 25847 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2d5d6b7964184f62a9365813f8268edb: Bootstrap starting.
I20260811 08:04:21.279503 25847 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2d5d6b7964184f62a9365813f8268edb: Neither blocks nor log segments found. Creating new log.
I20260811 08:04:21.279958 25847 log.cc:824] T 00000000000000000000000000000000 P 2d5d6b7964184f62a9365813f8268edb: Log is configured to *not* fsync() on all Append() calls
I20260811 08:04:21.280922 25847 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2d5d6b7964184f62a9365813f8268edb: No bootstrap required, opened a new log
I20260811 08:04:21.283732 25847 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2d5d6b7964184f62a9365813f8268edb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d5d6b7964184f62a9365813f8268edb" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 34711 } }
I20260811 08:04:21.283972 25847 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2d5d6b7964184f62a9365813f8268edb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:04:21.284034 25847 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2d5d6b7964184f62a9365813f8268edb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d5d6b7964184f62a9365813f8268edb, State: Initialized, Role: FOLLOWER
I20260811 08:04:21.284233 25847 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2d5d6b7964184f62a9365813f8268edb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d5d6b7964184f62a9365813f8268edb" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 34711 } }
I20260811 08:04:21.284363 25847 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2d5d6b7964184f62a9365813f8268edb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:04:21.284399 25847 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2d5d6b7964184f62a9365813f8268edb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:04:21.284444 25847 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2d5d6b7964184f62a9365813f8268edb [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:04:21.285542 25847 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2d5d6b7964184f62a9365813f8268edb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d5d6b7964184f62a9365813f8268edb" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 34711 } }
I20260811 08:04:21.285698 25847 leader_election.cc:302] T 00000000000000000000000000000000 P 2d5d6b7964184f62a9365813f8268edb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2d5d6b7964184f62a9365813f8268edb; no voters:
I20260811 08:04:21.285998 25847 leader_election.cc:288] T 00000000000000000000000000000000 P 2d5d6b7964184f62a9365813f8268edb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:04:21.286069 25852 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2d5d6b7964184f62a9365813f8268edb [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:04:21.286398 25847 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2d5d6b7964184f62a9365813f8268edb [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:04:21.286393 25852 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2d5d6b7964184f62a9365813f8268edb [term 1 LEADER]: Becoming Leader. State: Replica: 2d5d6b7964184f62a9365813f8268edb, State: Running, Role: LEADER
I20260811 08:04:21.286701 25852 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2d5d6b7964184f62a9365813f8268edb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d5d6b7964184f62a9365813f8268edb" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 34711 } }
I20260811 08:04:21.287726 25854 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d5d6b7964184f62a9365813f8268edb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2d5d6b7964184f62a9365813f8268edb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d5d6b7964184f62a9365813f8268edb" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 34711 } } }
I20260811 08:04:21.287848 25854 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d5d6b7964184f62a9365813f8268edb [sys.catalog]: This master's current role is: LEADER
I20260811 08:04:21.287940 25850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:21.274415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38984 (local address 127.15.36.254:34711)
0811 08:04:21.274751 (+ 336us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:21.274763 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:21.278956 (+ 4193us) server_negotiation.cc:407] Connection header received
0811 08:04:21.279925 (+ 969us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:21.279935 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:21.280017 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:21.280679 (+ 662us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:21.280940 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:21.282944 (+ 2004us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:21.284155 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:21.284888 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:21.285057 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:21.286064 (+ 1007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:04:21.286069 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:04:21.286070 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:04:21.286322 (+ 252us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:04:21.286372 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:04:21.286390 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:04:21.286475 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 08:04:21.287488 (+ 1013us) server_negotiation.cc:299] Negotiation successful
0811 08:04:21.287599 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":218,"thread_start_us":113,"threads_started":1}
I20260811 08:04:21.288126 25861 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:04:21.287742 25853 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d5d6b7964184f62a9365813f8268edb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2d5d6b7964184f62a9365813f8268edb. Latest consensus state: current_term: 1 leader_uuid: "2d5d6b7964184f62a9365813f8268edb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d5d6b7964184f62a9365813f8268edb" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 34711 } } }
I20260811 08:04:21.288578 25853 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d5d6b7964184f62a9365813f8268edb [sys.catalog]: This master's current role is: LEADER
I20260811 08:04:21.288942 25861 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:04:21.299489 25861 catalog_manager.cc:1347] Generated new cluster ID: 1272cba201a944d18f99bef516a8e634
I20260811 08:04:21.299597 25861 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:04:21.325254 25861 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:04:21.326184 25861 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:04:21.344233 25861 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2d5d6b7964184f62a9365813f8268edb: Generated new TSK 0
I20260811 08:04:21.344619 25861 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:04:21.353253 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.193:0
--local_ip_for_outbound_sockets=127.15.36.193
--webserver_interface=127.15.36.193
--webserver_port=0
--tserver_master_addrs=127.15.36.254:34711
--builtin_ntp_servers=127.15.36.212:38543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260811 08:04:21.484515 25871 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:04:21.484809 25871 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:04:21.484970 25871 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:04:21.486935 25871 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:04:21.487114 25871 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:04:21.487170 25871 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.193
I20260811 08:04:21.489214 25871 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:38543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.36.193
--webserver_port=0
--tserver_master_addrs=127.15.36.254:34711
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25871
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.193
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:04:21.489567 25871 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:04:21.489946 25871 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:04:21.499399 25878 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:04:21.499399 25877 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:04:21.500687 25881 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:04:21.503214 25871 server_base.cc:1034] running on GCE node
I20260811 08:04:21.503691 25871 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:04:21.504087 25871 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:04:21.505337 25871 hybrid_clock.cc:648] HybridClock initialized: now 1786435461505304 us; error 58 us; skew 500 ppm
I20260811 08:04:21.507504 25871 webserver.cc:460] Webserver started at http://127.15.36.193:46439/ using document root <none> and password file <none>
I20260811 08:04:21.507843 25871 fs_manager.cc:359] Metadata directory not provided
I20260811 08:04:21.507905 25871 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:04:21.508072 25871 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:04:21.509387 25871 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-0/data/instance:
uuid: "d8665d2252e74d2487b8410d458694c7"
format_stamp: "Formatted at 2026-08-11 08:04:21 on dist-test-slave-2w3w"
server_key: "2df6c85c5f66c6c3517169f817db9249"
server_key_iv: "cb45e5ad781b895a6b04eb93be441034"
server_key_version: "encryptionkey@0"
I20260811 08:04:21.509829 25871 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-0/wal/instance:
uuid: "d8665d2252e74d2487b8410d458694c7"
format_stamp: "Formatted at 2026-08-11 08:04:21 on dist-test-slave-2w3w"
server_key: "2df6c85c5f66c6c3517169f817db9249"
server_key_iv: "cb45e5ad781b895a6b04eb93be441034"
server_key_version: "encryptionkey@0"
I20260811 08:04:21.511646 25871 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260811 08:04:21.512830 25887 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:04:21.513199 25871 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:04:21.513300 25871 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-0/wal
uuid: "d8665d2252e74d2487b8410d458694c7"
format_stamp: "Formatted at 2026-08-11 08:04:21 on dist-test-slave-2w3w"
server_key: "2df6c85c5f66c6c3517169f817db9249"
server_key_iv: "cb45e5ad781b895a6b04eb93be441034"
server_key_version: "encryptionkey@0"
I20260811 08:04:21.513368 25871 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:04:21.533072 25871 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:04:21.533501 25871 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:04:21.536230 25871 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:04:21.539677 25871 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:04:21.540690 25871 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:04:21.540746 25871 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:04:21.540781 25871 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:04:21.540793 25871 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:04:21.551682 25871 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.193:39107
I20260811 08:04:21.551776 26015 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.193:39107 every 8 connection(s)
I20260811 08:04:21.552204 25871 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
I20260811 08:04:21.561084 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 25871
I20260811 08:04:21.561398 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-0/wal/instance
I20260811 08:04:21.562252 15507 external_mini_cluster.cc:1428] Setting key 07dce276754cece97b5b43d23df1b863
I20260811 08:04:21.564002 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.194:0
--local_ip_for_outbound_sockets=127.15.36.194
--webserver_interface=127.15.36.194
--webserver_port=0
--tserver_master_addrs=127.15.36.254:34711
--builtin_ntp_servers=127.15.36.212:38543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260811 08:04:21.566563 25850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:21.553850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:43627 (local address 127.15.36.254:34711)
0811 08:04:21.553926 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:21.553933 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:21.554149 (+ 216us) server_negotiation.cc:407] Connection header received
0811 08:04:21.558672 (+ 4523us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:21.558673 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:21.558695 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:21.558780 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:21.560771 (+ 1991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:21.562292 (+ 1521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:21.564620 (+ 2328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:21.564954 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:21.565057 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:21.566222 (+ 1165us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:04:21.566224 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:04:21.566224 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:04:21.566230 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:04:21.566244 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:04:21.566247 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:04:21.566331 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 08:04:21.566440 (+ 109us) server_negotiation.cc:299] Negotiation successful
0811 08:04:21.566474 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 08:04:21.566839 26019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:21.553463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:34711 (local address 127.15.36.193:43627)
0811 08:04:21.553892 (+ 429us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:21.553962 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:21.558470 (+ 4508us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:21.559264 (+ 794us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:21.559269 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:21.559281 (+ 12us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:04:21.560173 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:21.560182 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:21.562645 (+ 2463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:21.562647 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:21.564473 (+ 1826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:21.564478 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:21.565108 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:21.565110 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:21.565250 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:21.566024 (+ 774us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 08:04:21.566025 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:04:21.566059 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 08:04:21.566089 (+ 30us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:04:21.566337 (+ 248us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:04:21.566344 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:04:21.566347 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:04:21.566430 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 08:04:21.566560 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":296,"thread_start_us":93,"threads_started":1}
I20260811 08:04:21.567736 26016 heartbeater.cc:347] Connected to a master server at 127.15.36.254:34711
I20260811 08:04:21.567870 26016 heartbeater.cc:464] Registering TS with master...
I20260811 08:04:21.568102 26016 heartbeater.cc:511] Master 127.15.36.254:34711 requested a full tablet report, sending...
I20260811 08:04:21.568827 25804 ts_manager.cc:194] Registered new tserver with Master: d8665d2252e74d2487b8410d458694c7 (127.15.36.193:39107)
I20260811 08:04:21.569567 25804 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.36.193:43627
W20260811 08:04:21.696656 26021 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:04:21.697355 26021 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:04:21.697407 26021 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:04:21.702273 26021 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:04:21.702380 26021 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:04:21.702422 26021 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.194
I20260811 08:04:21.706278 26021 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:38543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.36.194
--webserver_port=0
--tserver_master_addrs=127.15.36.254:34711
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26021
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.194
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:04:21.706584 26021 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:04:21.706918 26021 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:04:21.715247 26031 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:04:21.715550 26021 server_base.cc:1034] running on GCE node
W20260811 08:04:21.715404 26033 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:04:21.715680 26030 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:04:21.715987 26021 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:04:21.716500 26021 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:04:21.717902 26021 hybrid_clock.cc:648] HybridClock initialized: now 1786435461717861 us; error 49 us; skew 500 ppm
I20260811 08:04:21.720649 26021 webserver.cc:460] Webserver started at http://127.15.36.194:33249/ using document root <none> and password file <none>
I20260811 08:04:21.720970 26021 fs_manager.cc:359] Metadata directory not provided
I20260811 08:04:21.721616 26021 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:04:21.721830 26021 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:04:21.723783 26021 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-1/data/instance:
uuid: "37ebc4a1e50341df80bfc2e14ac9f23e"
format_stamp: "Formatted at 2026-08-11 08:04:21 on dist-test-slave-2w3w"
server_key: "e23bbdb2055118e553b920f3b9c73cf2"
server_key_iv: "672d7e9a5ff4fe74a3db4e63a25c72ac"
server_key_version: "encryptionkey@0"
I20260811 08:04:21.724305 26021 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-1/wal/instance:
uuid: "37ebc4a1e50341df80bfc2e14ac9f23e"
format_stamp: "Formatted at 2026-08-11 08:04:21 on dist-test-slave-2w3w"
server_key: "e23bbdb2055118e553b920f3b9c73cf2"
server_key_iv: "672d7e9a5ff4fe74a3db4e63a25c72ac"
server_key_version: "encryptionkey@0"
I20260811 08:04:21.727516 26021 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.003s
I20260811 08:04:21.730046 26039 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:04:21.730659 26021 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260811 08:04:21.730849 26021 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-1/wal
uuid: "37ebc4a1e50341df80bfc2e14ac9f23e"
format_stamp: "Formatted at 2026-08-11 08:04:21 on dist-test-slave-2w3w"
server_key: "e23bbdb2055118e553b920f3b9c73cf2"
server_key_iv: "672d7e9a5ff4fe74a3db4e63a25c72ac"
server_key_version: "encryptionkey@0"
I20260811 08:04:21.730964 26021 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:04:21.760870 26021 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:04:21.762903 26021 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:04:21.763649 26021 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:04:21.763993 26021 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:04:21.764413 26021 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:04:21.764472 26021 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:04:21.764519 26021 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:04:21.764545 26021 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:04:21.773089 26021 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.194:43329
I20260811 08:04:21.773131 26168 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.194:43329 every 8 connection(s)
I20260811 08:04:21.773563 26021 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
I20260811 08:04:21.776024 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 26021
I20260811 08:04:21.776158 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-1/wal/instance
I20260811 08:04:21.776453 15507 external_mini_cluster.cc:1428] Setting key c81197982f7b32cf79930ad993ed16d8
I20260811 08:04:21.777961 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.195:0
--local_ip_for_outbound_sockets=127.15.36.195
--webserver_interface=127.15.36.195
--webserver_port=0
--tserver_master_addrs=127.15.36.254:34711
--builtin_ntp_servers=127.15.36.212:38543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260811 08:04:21.781088 25850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:21.774617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:34715 (local address 127.15.36.254:34711)
0811 08:04:21.774696 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:21.774698 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:21.775074 (+ 376us) server_negotiation.cc:407] Connection header received
0811 08:04:21.775709 (+ 635us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:21.775710 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:21.775726 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:21.775813 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:21.776726 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:21.777424 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:21.779458 (+ 2034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:21.779663 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:21.779762 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:21.780765 (+ 1003us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:04:21.780766 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:04:21.780767 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:04:21.780774 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:04:21.780791 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:04:21.780795 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:04:21.780831 (+ 36us) server_negotiation.cc:1035] Waiting for connection context
0811 08:04:21.780966 (+ 135us) server_negotiation.cc:299] Negotiation successful
0811 08:04:21.781000 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 08:04:21.781730 26171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:21.774601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:34711 (local address 127.15.36.194:34715)
0811 08:04:21.774871 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:21.774918 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:21.775578 (+ 660us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:21.775896 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:21.775903 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:21.775919 (+ 16us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:04:21.776619 (+ 700us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:21.776626 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:21.777567 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:21.777569 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:21.779317 (+ 1748us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:21.779321 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:21.779776 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:21.779777 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:21.779927 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:21.780559 (+ 632us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 08:04:21.780559 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:04:21.780593 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 08:04:21.780620 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:04:21.780871 (+ 251us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:04:21.780876 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:04:21.780879 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:04:21.780953 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 08:04:21.781078 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":135,"threads_started":1}
I20260811 08:04:21.782398 26169 heartbeater.cc:347] Connected to a master server at 127.15.36.254:34711
I20260811 08:04:21.782539 26169 heartbeater.cc:464] Registering TS with master...
I20260811 08:04:21.782825 26169 heartbeater.cc:511] Master 127.15.36.254:34711 requested a full tablet report, sending...
I20260811 08:04:21.783650 25804 ts_manager.cc:194] Registered new tserver with Master: 37ebc4a1e50341df80bfc2e14ac9f23e (127.15.36.194:43329)
I20260811 08:04:21.784245 25804 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.36.194:34715
W20260811 08:04:21.910712 26172 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:04:21.911089 26172 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:04:21.911125 26172 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:04:21.912712 26172 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:04:21.912792 26172 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:04:21.912827 26172 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.195
I20260811 08:04:21.914997 26172 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:38543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.36.195
--webserver_port=0
--tserver_master_addrs=127.15.36.254:34711
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26172
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.195
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:04:21.915385 26172 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:04:21.915817 26172 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:04:21.922492 26180 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:04:21.922715 26177 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:04:21.922724 26178 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:04:21.923118 26172 server_base.cc:1034] running on GCE node
I20260811 08:04:21.923439 26172 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:04:21.923780 26172 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:04:21.925038 26172 hybrid_clock.cc:648] HybridClock initialized: now 1786435461925014 us; error 40 us; skew 500 ppm
I20260811 08:04:21.928395 26172 webserver.cc:460] Webserver started at http://127.15.36.195:38449/ using document root <none> and password file <none>
I20260811 08:04:21.928933 26172 fs_manager.cc:359] Metadata directory not provided
I20260811 08:04:21.929054 26172 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:04:21.929236 26172 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:04:21.931169 26172 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-2/data/instance:
uuid: "b9026a66473f42b59fcf56175d9dddf2"
format_stamp: "Formatted at 2026-08-11 08:04:21 on dist-test-slave-2w3w"
server_key: "c295ddc3f8c6279613e3a1c5029cab22"
server_key_iv: "68cebb21b57063b959bcabdebb4bcb83"
server_key_version: "encryptionkey@0"
I20260811 08:04:21.931715 26172 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-2/wal/instance:
uuid: "b9026a66473f42b59fcf56175d9dddf2"
format_stamp: "Formatted at 2026-08-11 08:04:21 on dist-test-slave-2w3w"
server_key: "c295ddc3f8c6279613e3a1c5029cab22"
server_key_iv: "68cebb21b57063b959bcabdebb4bcb83"
server_key_version: "encryptionkey@0"
I20260811 08:04:21.933398 26172 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 08:04:21.934604 26187 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:04:21.935155 26172 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:04:21.935266 26172 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-2/wal
uuid: "b9026a66473f42b59fcf56175d9dddf2"
format_stamp: "Formatted at 2026-08-11 08:04:21 on dist-test-slave-2w3w"
server_key: "c295ddc3f8c6279613e3a1c5029cab22"
server_key_iv: "68cebb21b57063b959bcabdebb4bcb83"
server_key_version: "encryptionkey@0"
I20260811 08:04:21.935340 26172 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:04:21.956331 26172 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:04:21.956697 26172 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:04:21.956905 26172 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:04:21.957223 26172 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:04:21.957681 26172 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:04:21.957749 26172 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:04:21.957790 26172 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:04:21.957827 26172 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:04:21.968744 26172 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.195:35309
I20260811 08:04:21.968868 26311 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.195:35309 every 8 connection(s)
I20260811 08:04:21.969612 26172 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
I20260811 08:04:21.977080 25850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:21.970758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:50217 (local address 127.15.36.254:34711)
0811 08:04:21.970859 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:21.970860 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:21.971164 (+ 304us) server_negotiation.cc:407] Connection header received
0811 08:04:21.971724 (+ 560us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:21.971725 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:21.971788 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:21.971870 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:21.972748 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:21.973320 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:21.975074 (+ 1754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:21.975306 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:21.975395 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:21.976680 (+ 1285us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:04:21.976682 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:04:21.976683 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:04:21.976690 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:04:21.976718 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:04:21.976723 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:04:21.976789 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 08:04:21.976978 (+ 189us) server_negotiation.cc:299] Negotiation successful
0811 08:04:21.977010 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260811 08:04:21.977501 26315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:21.970698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:34711 (local address 127.15.36.195:50217)
0811 08:04:21.970986 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:21.971034 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:21.971612 (+ 578us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:21.971978 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:21.971983 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:21.971993 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:04:21.972614 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:21.972620 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:21.973648 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:21.973650 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:21.974851 (+ 1201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:21.974856 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:21.975421 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:21.975422 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:21.975602 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:21.976487 (+ 885us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 08:04:21.976488 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:04:21.976523 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 08:04:21.976555 (+ 32us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:04:21.976835 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:04:21.976842 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:04:21.976844 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 08:04:21.976927 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 08:04:21.977163 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":135,"threads_started":1}
I20260811 08:04:21.977545 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 26172
I20260811 08:04:21.977626 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-2/wal/instance
I20260811 08:04:21.977931 15507 external_mini_cluster.cc:1428] Setting key e8bff7e9d2ec0dbc39c98bef28b68108
I20260811 08:04:21.978214 26313 heartbeater.cc:347] Connected to a master server at 127.15.36.254:34711
I20260811 08:04:21.978406 26313 heartbeater.cc:464] Registering TS with master...
I20260811 08:04:21.978677 26313 heartbeater.cc:511] Master 127.15.36.254:34711 requested a full tablet report, sending...
I20260811 08:04:21.979161 25804 ts_manager.cc:194] Registered new tserver with Master: b9026a66473f42b59fcf56175d9dddf2 (127.15.36.195:35309)
I20260811 08:04:21.979575 25804 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.36.195:50217
I20260811 08:04:21.991143 15507 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 08:04:21.994524 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 25871
W20260811 08:04:21.994849 25850 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:04:21.993588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38996 (local address 127.15.36.254:34711)
0811 08:04:21.993753 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:21.993755 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:21.993775 (+ 20us) server_negotiation.cc:407] Connection header received
0811 08:04:21.993817 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:21.993818 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:21.993833 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:21.993941 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:21.994747 (+ 806us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38996: BlockingRecv error: recv got EOF from 127.0.0.1:38996 (error 108)
Metrics: {"server-negotiator.queue_time_us":109}
I20260811 08:04:22.010926 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 26021
I20260811 08:04:22.025883 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 26172
I20260811 08:04:22.036986 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 25767
2026-08-11T08:04:22Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (993 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-11T08:04:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:04:22Z Disabled control of system clock
I20260811 08:04:22.071147 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435400844580-15507-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435400844580-15507-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435400844580-15507-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:46871
--webserver_interface=127.15.36.254
--webserver_port=0
--builtin_ntp_servers=127.15.36.212:34063
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.36.254:46871
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 08:04:22.172498 26324 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:04:22.172744 26324 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:04:22.172767 26324 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:04:22.174052 26324 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:04:22.174104 26324 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:04:22.174117 26324 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:04:22.174130 26324 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:04:22.174144 26324 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:04:22.175822 26324 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:34063
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435400844580-15507-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435400844580-15507-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.36.254:46871
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:46871
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.36.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26324
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435400844580-15507-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:04:22.176131 26324 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:04:22.176476 26324 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:04:22.182682 26335 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:04:22.182682 26330 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:04:22.182782 26324 server_base.cc:1034] running on GCE node
W20260811 08:04:22.182782 26332 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:04:22.183395 26324 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:04:22.183786 26324 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:04:22.185050 26324 hybrid_clock.cc:648] HybridClock initialized: now 1786435462185017 us; error 64 us; skew 500 ppm
I20260811 08:04:22.186695 26324 webserver.cc:460] Webserver started at http://127.15.36.254:33013/ using document root <none> and password file <none>
I20260811 08:04:22.187031 26324 fs_manager.cc:359] Metadata directory not provided
I20260811 08:04:22.187121 26324 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:04:22.187337 26324 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:04:22.188910 26324 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435400844580-15507-0/minicluster-data/master-0/data/instance:
uuid: "6220da82c5994e089815f1f52b2b0cb2"
format_stamp: "Formatted at 2026-08-11 08:04:22 on dist-test-slave-2w3w"
server_key: "a9d5dfeb4cf3efce3dc002e08a0de4ed"
server_key_iv: "14b8840b9c8faa7ea61afbc6ec1ebdca"
server_key_version: "encryptionkey@0"
I20260811 08:04:22.189548 26324 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435400844580-15507-0/minicluster-data/master-0/wal/instance:
uuid: "6220da82c5994e089815f1f52b2b0cb2"
format_stamp: "Formatted at 2026-08-11 08:04:22 on dist-test-slave-2w3w"
server_key: "a9d5dfeb4cf3efce3dc002e08a0de4ed"
server_key_iv: "14b8840b9c8faa7ea61afbc6ec1ebdca"
server_key_version: "encryptionkey@0"
I20260811 08:04:22.191433 26324 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.003s
I20260811 08:04:22.192423 26344 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:04:22.192800 26324 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:04:22.192967 26324 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435400844580-15507-0/minicluster-data/master-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435400844580-15507-0/minicluster-data/master-0/wal
uuid: "6220da82c5994e089815f1f52b2b0cb2"
format_stamp: "Formatted at 2026-08-11 08:04:22 on dist-test-slave-2w3w"
server_key: "a9d5dfeb4cf3efce3dc002e08a0de4ed"
server_key_iv: "14b8840b9c8faa7ea61afbc6ec1ebdca"
server_key_version: "encryptionkey@0"
I20260811 08:04:22.193068 26324 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435400844580-15507-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435400844580-15507-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435400844580-15507-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:04:22.196904 26324 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:04:22.197253 26324 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:04:22.197415 26324 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:04:22.202507 26324 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.254:46871
I20260811 08:04:22.202594 26402 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.254:46871 every 8 connection(s)
I20260811 08:04:22.203493 26324 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
I20260811 08:04:22.204674 26404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:04:22.207381 26404 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6220da82c5994e089815f1f52b2b0cb2: Bootstrap starting.
I20260811 08:04:22.208014 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 26324
I20260811 08:04:22.208108 26404 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6220da82c5994e089815f1f52b2b0cb2: Neither blocks nor log segments found. Creating new log.
I20260811 08:04:22.208168 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435400844580-15507-0/minicluster-data/master-0/wal/instance
I20260811 08:04:22.208433 15507 external_mini_cluster.cc:1428] Setting key 83fff5c166d9c5e417ea28caa027cec7
I20260811 08:04:22.208489 26404 log.cc:824] T 00000000000000000000000000000000 P 6220da82c5994e089815f1f52b2b0cb2: Log is configured to *not* fsync() on all Append() calls
I20260811 08:04:22.209498 26404 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6220da82c5994e089815f1f52b2b0cb2: No bootstrap required, opened a new log
I20260811 08:04:22.211815 26410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:22.209077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44568 (local address 127.15.36.254:46871)
0811 08:04:22.209324 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:22.209334 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:22.209371 (+ 37us) server_negotiation.cc:407] Connection header received
0811 08:04:22.210075 (+ 704us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:22.210086 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:22.210146 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:22.210335 (+ 189us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:22.211207 (+ 872us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:04:22.211211 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:04:22.211212 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:04:22.211217 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:04:22.211278 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:04:22.211296 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:04:22.211414 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 08:04:22.211506 (+ 92us) server_negotiation.cc:299] Negotiation successful
0811 08:04:22.211577 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":87,"threads_started":1}
I20260811 08:04:22.212198 26404 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6220da82c5994e089815f1f52b2b0cb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6220da82c5994e089815f1f52b2b0cb2" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 46871 } }
I20260811 08:04:22.212426 26404 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6220da82c5994e089815f1f52b2b0cb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:04:22.212484 26404 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6220da82c5994e089815f1f52b2b0cb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6220da82c5994e089815f1f52b2b0cb2, State: Initialized, Role: FOLLOWER
I20260811 08:04:22.212632 26404 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6220da82c5994e089815f1f52b2b0cb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6220da82c5994e089815f1f52b2b0cb2" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 46871 } }
I20260811 08:04:22.212747 26404 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6220da82c5994e089815f1f52b2b0cb2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:04:22.212800 26404 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6220da82c5994e089815f1f52b2b0cb2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:04:22.212852 26404 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6220da82c5994e089815f1f52b2b0cb2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:04:22.213904 26404 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6220da82c5994e089815f1f52b2b0cb2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6220da82c5994e089815f1f52b2b0cb2" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 46871 } }
I20260811 08:04:22.214035 26404 leader_election.cc:302] T 00000000000000000000000000000000 P 6220da82c5994e089815f1f52b2b0cb2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6220da82c5994e089815f1f52b2b0cb2; no voters:
I20260811 08:04:22.214263 26404 leader_election.cc:288] T 00000000000000000000000000000000 P 6220da82c5994e089815f1f52b2b0cb2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:04:22.214464 26411 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6220da82c5994e089815f1f52b2b0cb2 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:04:22.214677 26411 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6220da82c5994e089815f1f52b2b0cb2 [term 1 LEADER]: Becoming Leader. State: Replica: 6220da82c5994e089815f1f52b2b0cb2, State: Running, Role: LEADER
I20260811 08:04:22.214830 26404 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6220da82c5994e089815f1f52b2b0cb2 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:04:22.214814 26411 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6220da82c5994e089815f1f52b2b0cb2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6220da82c5994e089815f1f52b2b0cb2" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 46871 } }
I20260811 08:04:22.215356 26413 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6220da82c5994e089815f1f52b2b0cb2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6220da82c5994e089815f1f52b2b0cb2. Latest consensus state: current_term: 1 leader_uuid: "6220da82c5994e089815f1f52b2b0cb2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6220da82c5994e089815f1f52b2b0cb2" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 46871 } } }
I20260811 08:04:22.215464 26413 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6220da82c5994e089815f1f52b2b0cb2 [sys.catalog]: This master's current role is: LEADER
I20260811 08:04:22.215337 26412 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6220da82c5994e089815f1f52b2b0cb2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6220da82c5994e089815f1f52b2b0cb2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6220da82c5994e089815f1f52b2b0cb2" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 46871 } } }
I20260811 08:04:22.215657 26412 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6220da82c5994e089815f1f52b2b0cb2 [sys.catalog]: This master's current role is: LEADER
I20260811 08:04:22.215786 26419 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:04:22.216336 26419 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:04:22.218525 26419 catalog_manager.cc:1347] Generated new cluster ID: 9b67e6105d2c4aa8a21b78ba41178e5b
I20260811 08:04:22.218631 26419 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:04:22.225644 26419 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:04:22.225857 26419 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:04:22.233484 26419 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6220da82c5994e089815f1f52b2b0cb2: Generated new TSK 0
I20260811 08:04:22.233774 26419 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:04:22.239006 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.193:0
--local_ip_for_outbound_sockets=127.15.36.193
--webserver_interface=127.15.36.193
--webserver_port=0
--tserver_master_addrs=127.15.36.254:46871
--builtin_ntp_servers=127.15.36.212:34063
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 08:04:22.340399 26433 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:04:22.340816 26433 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:04:22.340873 26433 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:04:22.342523 26433 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:04:22.342623 26433 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:04:22.342679 26433 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.193
I20260811 08:04:22.344872 26433 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:34063
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.36.193
--webserver_port=0
--tserver_master_addrs=127.15.36.254:46871
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26433
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.193
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:04:22.345301 26433 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:04:22.345713 26433 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:04:22.353219 26439 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:04:22.353219 26443 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:04:22.353219 26440 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:04:22.353901 26433 server_base.cc:1034] running on GCE node
I20260811 08:04:22.354128 26433 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:04:22.354409 26433 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:04:22.355611 26433 hybrid_clock.cc:648] HybridClock initialized: now 1786435462355591 us; error 32 us; skew 500 ppm
I20260811 08:04:22.357254 26433 webserver.cc:460] Webserver started at http://127.15.36.193:46059/ using document root <none> and password file <none>
I20260811 08:04:22.357558 26433 fs_manager.cc:359] Metadata directory not provided
I20260811 08:04:22.357635 26433 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:04:22.357810 26433 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:04:22.359114 26433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-0/data/instance:
uuid: "682c0b089b634772b8bcd66f045c6bb9"
format_stamp: "Formatted at 2026-08-11 08:04:22 on dist-test-slave-2w3w"
server_key: "169077bfc990f80eeade9887a644b336"
server_key_iv: "23642a90df98170baabd8d0ff9f51ffa"
server_key_version: "encryptionkey@0"
I20260811 08:04:22.359701 26433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-0/wal/instance:
uuid: "682c0b089b634772b8bcd66f045c6bb9"
format_stamp: "Formatted at 2026-08-11 08:04:22 on dist-test-slave-2w3w"
server_key: "169077bfc990f80eeade9887a644b336"
server_key_iv: "23642a90df98170baabd8d0ff9f51ffa"
server_key_version: "encryptionkey@0"
I20260811 08:04:22.361578 26433 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260811 08:04:22.362496 26449 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:04:22.363087 26433 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:04:22.363224 26433 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-0/wal
uuid: "682c0b089b634772b8bcd66f045c6bb9"
format_stamp: "Formatted at 2026-08-11 08:04:22 on dist-test-slave-2w3w"
server_key: "169077bfc990f80eeade9887a644b336"
server_key_iv: "23642a90df98170baabd8d0ff9f51ffa"
server_key_version: "encryptionkey@0"
I20260811 08:04:22.363325 26433 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:04:22.367296 26433 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:04:22.367657 26433 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:04:22.367834 26433 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:04:22.368103 26433 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:04:22.368502 26433 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:04:22.368563 26433 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:04:22.368602 26433 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:04:22.368628 26433 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:04:22.376433 26433 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.193:37261
I20260811 08:04:22.376546 26574 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.193:37261 every 8 connection(s)
I20260811 08:04:22.376933 26433 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
I20260811 08:04:22.380456 26410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:22.377914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:36727 (local address 127.15.36.254:46871)
0811 08:04:22.378014 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:22.378017 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:22.378278 (+ 261us) server_negotiation.cc:407] Connection header received
0811 08:04:22.378778 (+ 500us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:22.378779 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:22.378785 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:22.378848 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:22.380162 (+ 1314us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:04:22.380163 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:04:22.380163 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:04:22.380169 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:04:22.380187 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:04:22.380192 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:04:22.380254 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 08:04:22.380368 (+ 114us) server_negotiation.cc:299] Negotiation successful
0811 08:04:22.380387 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 08:04:22.380661 26577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:22.377889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:46871 (local address 127.15.36.193:36727)
0811 08:04:22.378138 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:22.378185 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:22.378689 (+ 504us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:22.378903 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:22.378906 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:22.378915 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:04:22.379957 (+ 1042us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 08:04:22.379958 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:04:22.379991 (+ 33us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 08:04:22.380026 (+ 35us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:04:22.380264 (+ 238us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:04:22.380270 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:04:22.380272 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 08:04:22.380340 (+ 68us) client_negotiation.cc:240] Negotiation successful
0811 08:04:22.380398 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":118,"threads_started":1}
I20260811 08:04:22.381423 26575 heartbeater.cc:347] Connected to a master server at 127.15.36.254:46871
I20260811 08:04:22.381569 26575 heartbeater.cc:464] Registering TS with master...
I20260811 08:04:22.381735 26575 heartbeater.cc:511] Master 127.15.36.254:46871 requested a full tablet report, sending...
I20260811 08:04:22.382455 26363 ts_manager.cc:194] Registered new tserver with Master: 682c0b089b634772b8bcd66f045c6bb9 (127.15.36.193:37261)
I20260811 08:04:22.386401 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 26433
I20260811 08:04:22.386574 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-0/wal/instance
I20260811 08:04:22.386855 15507 external_mini_cluster.cc:1428] Setting key 3cba5d95e3bad224c0f4b2ad8c6e991c
I20260811 08:04:22.388254 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.194:0
--local_ip_for_outbound_sockets=127.15.36.194
--webserver_interface=127.15.36.194
--webserver_port=0
--tserver_master_addrs=127.15.36.254:46871
--builtin_ntp_servers=127.15.36.212:34063
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 08:04:22.486948 26578 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:04:22.487350 26578 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:04:22.487402 26578 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:04:22.489006 26578 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:04:22.489106 26578 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:04:22.489163 26578 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.194
I20260811 08:04:22.491021 26578 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:34063
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.36.194
--webserver_port=0
--tserver_master_addrs=127.15.36.254:46871
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26578
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.194
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:04:22.491382 26578 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:04:22.491773 26578 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 08:04:22.498391 26578 server_base.cc:1034] running on GCE node
W20260811 08:04:22.498361 26589 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:04:22.498361 26586 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:04:22.498385 26585 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:04:22.498827 26578 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:04:22.499181 26578 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:04:22.500372 26578 hybrid_clock.cc:648] HybridClock initialized: now 1786435462500390 us; error 82 us; skew 500 ppm
I20260811 08:04:22.502317 26578 webserver.cc:460] Webserver started at http://127.15.36.194:37805/ using document root <none> and password file <none>
I20260811 08:04:22.502676 26578 fs_manager.cc:359] Metadata directory not provided
I20260811 08:04:22.502779 26578 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:04:22.502949 26578 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:04:22.504380 26578 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-1/data/instance:
uuid: "ac41bb7bced34999a6a90f5bad5e0b60"
format_stamp: "Formatted at 2026-08-11 08:04:22 on dist-test-slave-2w3w"
server_key: "645dc8a2d66c56568f6f45f4525b29a9"
server_key_iv: "3945ee6d3b7e8af998a07c57f9bd5233"
server_key_version: "encryptionkey@0"
I20260811 08:04:22.504881 26578 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-1/wal/instance:
uuid: "ac41bb7bced34999a6a90f5bad5e0b60"
format_stamp: "Formatted at 2026-08-11 08:04:22 on dist-test-slave-2w3w"
server_key: "645dc8a2d66c56568f6f45f4525b29a9"
server_key_iv: "3945ee6d3b7e8af998a07c57f9bd5233"
server_key_version: "encryptionkey@0"
I20260811 08:04:22.506608 26578 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.002s
I20260811 08:04:22.507838 26595 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:04:22.508343 26578 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:04:22.508575 26578 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-1/wal
uuid: "ac41bb7bced34999a6a90f5bad5e0b60"
format_stamp: "Formatted at 2026-08-11 08:04:22 on dist-test-slave-2w3w"
server_key: "645dc8a2d66c56568f6f45f4525b29a9"
server_key_iv: "3945ee6d3b7e8af998a07c57f9bd5233"
server_key_version: "encryptionkey@0"
I20260811 08:04:22.508690 26578 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:04:22.513027 26578 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:04:22.513381 26578 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:04:22.513563 26578 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:04:22.513841 26578 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:04:22.514380 26578 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:04:22.514446 26578 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:04:22.514513 26578 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:04:22.514540 26578 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:04:22.522655 26578 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.194:39215
I20260811 08:04:22.522696 26725 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.194:39215 every 8 connection(s)
I20260811 08:04:22.523411 26578 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
I20260811 08:04:22.525772 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 26578
I20260811 08:04:22.525942 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-1/wal/instance
I20260811 08:04:22.526211 15507 external_mini_cluster.cc:1428] Setting key 4e77e288fc467c7ca5456fde78710383
I20260811 08:04:22.527354 26410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:22.524439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:50879 (local address 127.15.36.254:46871)
0811 08:04:22.524565 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:22.524568 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:22.524802 (+ 234us) server_negotiation.cc:407] Connection header received
0811 08:04:22.525413 (+ 611us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:22.525415 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:22.525422 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:22.525467 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:22.527066 (+ 1599us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:04:22.527068 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:04:22.527069 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:04:22.527075 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:04:22.527093 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:04:22.527098 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:04:22.527158 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 08:04:22.527261 (+ 103us) server_negotiation.cc:299] Negotiation successful
0811 08:04:22.527279 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 08:04:22.527532 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.195:0
--local_ip_for_outbound_sockets=127.15.36.195
--webserver_interface=127.15.36.195
--webserver_port=0
--tserver_master_addrs=127.15.36.254:46871
--builtin_ntp_servers=127.15.36.212:34063
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260811 08:04:22.527621 26728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:22.524361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:46871 (local address 127.15.36.194:50879)
0811 08:04:22.524667 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:22.524704 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:22.525250 (+ 546us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:22.525553 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:22.525557 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:22.525568 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:04:22.526844 (+ 1276us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 08:04:22.526844 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:04:22.526882 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 08:04:22.526917 (+ 35us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:04:22.527162 (+ 245us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:04:22.527168 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:04:22.527172 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:04:22.527275 (+ 103us) client_negotiation.cc:240] Negotiation successful
0811 08:04:22.527362 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":131,"threads_started":1}
I20260811 08:04:22.529570 26726 heartbeater.cc:347] Connected to a master server at 127.15.36.254:46871
I20260811 08:04:22.529711 26726 heartbeater.cc:464] Registering TS with master...
I20260811 08:04:22.529970 26726 heartbeater.cc:511] Master 127.15.36.254:46871 requested a full tablet report, sending...
I20260811 08:04:22.530453 26363 ts_manager.cc:194] Registered new tserver with Master: ac41bb7bced34999a6a90f5bad5e0b60 (127.15.36.194:39215)
W20260811 08:04:22.630191 26729 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:04:22.630462 26729 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:04:22.630489 26729 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:04:22.631875 26729 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:04:22.631943 26729 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:04:22.631974 26729 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.195
I20260811 08:04:22.633476 26729 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:34063
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.36.195
--webserver_port=0
--tserver_master_addrs=127.15.36.254:46871
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26729
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.195
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:04:22.633854 26729 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:04:22.634289 26729 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:04:22.640095 26734 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:04:22.640071 26735 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:04:22.640071 26737 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:04:22.640202 26729 server_base.cc:1034] running on GCE node
I20260811 08:04:22.640592 26729 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:04:22.640992 26729 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:04:22.642366 26729 hybrid_clock.cc:648] HybridClock initialized: now 1786435462642351 us; error 31 us; skew 500 ppm
I20260811 08:04:22.644619 26729 webserver.cc:460] Webserver started at http://127.15.36.195:37409/ using document root <none> and password file <none>
I20260811 08:04:22.644949 26729 fs_manager.cc:359] Metadata directory not provided
I20260811 08:04:22.645035 26729 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:04:22.645205 26729 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:04:22.646636 26729 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-2/data/instance:
uuid: "671e703ddb7b4caaa9283f76939ab7b4"
format_stamp: "Formatted at 2026-08-11 08:04:22 on dist-test-slave-2w3w"
server_key: "688b09b340cf88a2dad5e296721c3960"
server_key_iv: "cc6ea9dbc0b082853886125a562b4494"
server_key_version: "encryptionkey@0"
I20260811 08:04:22.647173 26729 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-2/wal/instance:
uuid: "671e703ddb7b4caaa9283f76939ab7b4"
format_stamp: "Formatted at 2026-08-11 08:04:22 on dist-test-slave-2w3w"
server_key: "688b09b340cf88a2dad5e296721c3960"
server_key_iv: "cc6ea9dbc0b082853886125a562b4494"
server_key_version: "encryptionkey@0"
I20260811 08:04:22.649031 26729 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260811 08:04:22.650321 26747 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:04:22.650671 26729 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:04:22.650902 26729 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-2/wal
uuid: "671e703ddb7b4caaa9283f76939ab7b4"
format_stamp: "Formatted at 2026-08-11 08:04:22 on dist-test-slave-2w3w"
server_key: "688b09b340cf88a2dad5e296721c3960"
server_key_iv: "cc6ea9dbc0b082853886125a562b4494"
server_key_version: "encryptionkey@0"
I20260811 08:04:22.651110 26729 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:04:22.656844 26729 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:04:22.657336 26729 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:04:22.657503 26729 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:04:22.657903 26729 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:04:22.658324 26729 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:04:22.658385 26729 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:04:22.658432 26729 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:04:22.658461 26729 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:04:22.665393 26729 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.195:41545
I20260811 08:04:22.665448 26873 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.195:41545 every 8 connection(s)
I20260811 08:04:22.665851 26729 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
I20260811 08:04:22.669852 26410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:22.666839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:51197 (local address 127.15.36.254:46871)
0811 08:04:22.666915 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:22.666918 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:22.667304 (+ 386us) server_negotiation.cc:407] Connection header received
0811 08:04:22.667857 (+ 553us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:22.667859 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:22.667866 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:22.667916 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:22.669502 (+ 1586us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:04:22.669504 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:04:22.669504 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:04:22.669511 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:04:22.669538 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:04:22.669544 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:04:22.669627 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 08:04:22.669739 (+ 112us) server_negotiation.cc:299] Negotiation successful
0811 08:04:22.669759 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 08:04:22.670125 26876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:22.666781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:46871 (local address 127.15.36.195:51197)
0811 08:04:22.667171 (+ 390us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:22.667209 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:22.667734 (+ 525us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:22.668010 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:22.668014 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:22.668022 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:04:22.669280 (+ 1258us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 08:04:22.669280 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:04:22.669317 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 08:04:22.669354 (+ 37us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:04:22.669627 (+ 273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:04:22.669636 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:04:22.669640 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:04:22.669753 (+ 113us) client_negotiation.cc:240] Negotiation successful
0811 08:04:22.669836 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":322,"thread_start_us":292,"threads_started":1}
I20260811 08:04:22.671161 26874 heartbeater.cc:347] Connected to a master server at 127.15.36.254:46871
I20260811 08:04:22.671288 26874 heartbeater.cc:464] Registering TS with master...
I20260811 08:04:22.671463 26874 heartbeater.cc:511] Master 127.15.36.254:46871 requested a full tablet report, sending...
I20260811 08:04:22.671949 26363 ts_manager.cc:194] Registered new tserver with Master: 671e703ddb7b4caaa9283f76939ab7b4 (127.15.36.195:41545)
I20260811 08:04:22.675107 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 26729
I20260811 08:04:22.675204 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786435400844580-15507-0/minicluster-data/ts-2/wal/instance
I20260811 08:04:22.675374 15507 external_mini_cluster.cc:1428] Setting key 42a123996ae5a288f0ffc8bc5836134a
I20260811 08:04:22.677404 15507 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 08:04:22.679842 26410 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:04:22.679065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44582 (local address 127.15.36.254:46871)
0811 08:04:22.679135 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:22.679137 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:22.679234 (+ 97us) server_negotiation.cc:407] Connection header received
0811 08:04:22.679287 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:22.679288 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:22.679293 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:22.679358 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:22.679667 (+ 309us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44582: BlockingRecv error: recv got EOF from 127.0.0.1:44582 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 08:04:22.679906 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 26433
I20260811 08:04:22.693190 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 26578
I20260811 08:04:22.703902 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 26729
I20260811 08:04:22.713780 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 26324
2026-08-11T08:04:22Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (680 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:04:22 dist-test-slave-2w3w krb5kdc[26886](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:04:22 dist-test-slave-2w3w krb5kdc[26886](info): set up 2 sockets
Aug 11 08:04:22 dist-test-slave-2w3w krb5kdc[26886](info): commencing operation
krb5kdc: starting...
W20260811 08:04:23.979162 15507 mini_kdc.cc:121] Time spent starting KDC: real 1.238s user 0.004s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Aug 11 08:04:24 dist-test-slave-2w3w krb5kdc[26886](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435464, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:04:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:04:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.36.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab.
Entry for principal kudu/127.15.36.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab.
I20260811 08:04:24.183880 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:44253
--webserver_interface=127.15.36.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=kudu/127.15.36.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:38313
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.36.254:44253
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:04:24.286660 26900 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:04:24.286950 26900 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:04:24.287022 26900 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:04:24.288507 26900 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:04:24.288585 26900 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:04:24.288602 26900 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:04:24.288616 26900 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:04:24.288630 26900 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:04:24.290874 26900 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:38313
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.36.254:44253
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=kudu/127.15.36.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:44253
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.36.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26900
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:04:24.291355 26900 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:04:24.291651 26900 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:04:24.297782 26906 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:04:24.298045 26909 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:04:24.298156 26907 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:04:24.298537 26900 server_base.cc:1034] running on GCE node
I20260811 08:04:24.298909 26900 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:04:24.299297 26900 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:04:24.300546 26900 hybrid_clock.cc:648] HybridClock initialized: now 1786435464300497 us; error 77 us; skew 500 ppm
Aug 11 08:04:24 dist-test-slave-2w3w krb5kdc[26886](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435464, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:04:24.312422 26900 init.cc:377] Logged in from keytab as kudu/127.15.36.254@KRBTEST.COM (short username kudu)
I20260811 08:04:24.313519 26900 webserver.cc:460] Webserver started at http://127.15.36.254:35047/ using document root <none> and password file <none>
I20260811 08:04:24.314157 26900 fs_manager.cc:359] Metadata directory not provided
I20260811 08:04:24.314283 26900 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:04:24.314481 26900 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:04:24.315824 26900 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/minicluster-data/master-0/data/instance:
uuid: "f39771ac295a4c3f8d5f8382f4cc5ac3"
format_stamp: "Formatted at 2026-08-11 08:04:24 on dist-test-slave-2w3w"
server_key: "2df4a01d09a25aee89c36674ee20e745"
server_key_iv: "2bfd3f285191017fdf49fac6af7e177f"
server_key_version: "encryptionkey@0"
I20260811 08:04:24.316248 26900 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/minicluster-data/master-0/wal/instance:
uuid: "f39771ac295a4c3f8d5f8382f4cc5ac3"
format_stamp: "Formatted at 2026-08-11 08:04:24 on dist-test-slave-2w3w"
server_key: "2df4a01d09a25aee89c36674ee20e745"
server_key_iv: "2bfd3f285191017fdf49fac6af7e177f"
server_key_version: "encryptionkey@0"
I20260811 08:04:24.317924 26900 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 08:04:24.319311 26920 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:04:24.319689 26900 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260811 08:04:24.319842 26900 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/minicluster-data/master-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/minicluster-data/master-0/wal
uuid: "f39771ac295a4c3f8d5f8382f4cc5ac3"
format_stamp: "Formatted at 2026-08-11 08:04:24 on dist-test-slave-2w3w"
server_key: "2df4a01d09a25aee89c36674ee20e745"
server_key_iv: "2bfd3f285191017fdf49fac6af7e177f"
server_key_version: "encryptionkey@0"
I20260811 08:04:24.319959 26900 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:04:24.330765 26900 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:04:24.335270 26900 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:04:24.335513 26900 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:04:24.341049 26900 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.254:44253
I20260811 08:04:24.341259 26982 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.254:44253 every 8 connection(s)
I20260811 08:04:24.341627 26900 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
I20260811 08:04:24.343626 26983 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:04:24.346434 26983 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f39771ac295a4c3f8d5f8382f4cc5ac3: Bootstrap starting.
I20260811 08:04:24.347258 26983 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f39771ac295a4c3f8d5f8382f4cc5ac3: Neither blocks nor log segments found. Creating new log.
I20260811 08:04:24.347640 26983 log.cc:824] T 00000000000000000000000000000000 P f39771ac295a4c3f8d5f8382f4cc5ac3: Log is configured to *not* fsync() on all Append() calls
I20260811 08:04:24.348719 26983 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f39771ac295a4c3f8d5f8382f4cc5ac3: No bootstrap required, opened a new log
I20260811 08:04:24.351194 26983 raft_consensus.cc:348] T 00000000000000000000000000000000 P f39771ac295a4c3f8d5f8382f4cc5ac3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f39771ac295a4c3f8d5f8382f4cc5ac3" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 44253 } }
I20260811 08:04:24.351455 26983 raft_consensus.cc:374] T 00000000000000000000000000000000 P f39771ac295a4c3f8d5f8382f4cc5ac3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:04:24.351500 26983 raft_consensus.cc:729] T 00000000000000000000000000000000 P f39771ac295a4c3f8d5f8382f4cc5ac3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f39771ac295a4c3f8d5f8382f4cc5ac3, State: Initialized, Role: FOLLOWER
I20260811 08:04:24.351707 26983 consensus_queue.cc:260] T 00000000000000000000000000000000 P f39771ac295a4c3f8d5f8382f4cc5ac3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f39771ac295a4c3f8d5f8382f4cc5ac3" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 44253 } }
I20260811 08:04:24.351831 26983 raft_consensus.cc:388] T 00000000000000000000000000000000 P f39771ac295a4c3f8d5f8382f4cc5ac3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:04:24.351847 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 26900
I20260811 08:04:24.351881 26983 raft_consensus.cc:482] T 00000000000000000000000000000000 P f39771ac295a4c3f8d5f8382f4cc5ac3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:04:24.351945 26983 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f39771ac295a4c3f8d5f8382f4cc5ac3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:04:24.351981 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/minicluster-data/master-0/wal/instance
I20260811 08:04:24.352200 15507 external_mini_cluster.cc:1428] Setting key 07de8a37238870c4a3e94c5ec40acd6f
I20260811 08:04:24.353381 26983 raft_consensus.cc:504] T 00000000000000000000000000000000 P f39771ac295a4c3f8d5f8382f4cc5ac3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f39771ac295a4c3f8d5f8382f4cc5ac3" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 44253 } }
I20260811 08:04:24.353520 26983 leader_election.cc:302] T 00000000000000000000000000000000 P f39771ac295a4c3f8d5f8382f4cc5ac3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f39771ac295a4c3f8d5f8382f4cc5ac3; no voters:
I20260811 08:04:24.353695 26983 leader_election.cc:288] T 00000000000000000000000000000000 P f39771ac295a4c3f8d5f8382f4cc5ac3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:04:24.353796 26989 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f39771ac295a4c3f8d5f8382f4cc5ac3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:04:24.354064 26983 sys_catalog.cc:564] T 00000000000000000000000000000000 P f39771ac295a4c3f8d5f8382f4cc5ac3 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:04:24.354029 26989 raft_consensus.cc:686] T 00000000000000000000000000000000 P f39771ac295a4c3f8d5f8382f4cc5ac3 [term 1 LEADER]: Becoming Leader. State: Replica: f39771ac295a4c3f8d5f8382f4cc5ac3, State: Running, Role: LEADER
I20260811 08:04:24.354252 26989 consensus_queue.cc:237] T 00000000000000000000000000000000 P f39771ac295a4c3f8d5f8382f4cc5ac3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f39771ac295a4c3f8d5f8382f4cc5ac3" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 44253 } }
I20260811 08:04:24.354846 26991 sys_catalog.cc:455] T 00000000000000000000000000000000 P f39771ac295a4c3f8d5f8382f4cc5ac3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f39771ac295a4c3f8d5f8382f4cc5ac3. Latest consensus state: current_term: 1 leader_uuid: "f39771ac295a4c3f8d5f8382f4cc5ac3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f39771ac295a4c3f8d5f8382f4cc5ac3" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 44253 } } }
I20260811 08:04:24.355432 26991 sys_catalog.cc:458] T 00000000000000000000000000000000 P f39771ac295a4c3f8d5f8382f4cc5ac3 [sys.catalog]: This master's current role is: LEADER
I20260811 08:04:24.355309 26990 sys_catalog.cc:455] T 00000000000000000000000000000000 P f39771ac295a4c3f8d5f8382f4cc5ac3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f39771ac295a4c3f8d5f8382f4cc5ac3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f39771ac295a4c3f8d5f8382f4cc5ac3" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 44253 } } }
I20260811 08:04:24.355751 26990 sys_catalog.cc:458] T 00000000000000000000000000000000 P f39771ac295a4c3f8d5f8382f4cc5ac3 [sys.catalog]: This master's current role is: LEADER
I20260811 08:04:24.355753 27004 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:04:24.356735 27004 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:04:24.358731 27004 catalog_manager.cc:1347] Generated new cluster ID: 507feb1f8a2d4fe69664c13fb885fad0
I20260811 08:04:24.358985 27004 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 08:04:24 dist-test-slave-2w3w krb5kdc[26886](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435464, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:04:24.368453 26987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:24.352994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50370 (local address 127.15.36.254:44253)
0811 08:04:24.353278 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:24.353290 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:24.353349 (+ 59us) server_negotiation.cc:407] Connection header received
0811 08:04:24.353495 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:24.353503 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:24.353570 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:24.353739 (+ 169us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:24.354752 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:24.356730 (+ 1978us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:24.357901 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:24.358420 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:24.358568 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:24.362420 (+ 3852us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:04:24.362428 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:04:24.362429 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:04:24.362465 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:04:24.365528 (+ 3063us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:04:24.366101 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:04:24.366105 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:04:24.366106 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:04:24.366294 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:04:24.366561 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:04:24.366562 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:04:24.366562 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:04:24.367058 (+ 496us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:04:24.367257 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0811 08:04:24.367640 (+ 383us) server_negotiation.cc:299] Negotiation successful
0811 08:04:24.368153 (+ 513us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":217,"thread_start_us":136,"threads_started":1}
I20260811 08:04:24.393764 27004 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:04:24.394873 27004 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:04:24.402812 27004 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f39771ac295a4c3f8d5f8382f4cc5ac3: Generated new TSK 0
I20260811 08:04:24.403102 27004 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.36.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab.
Entry for principal kudu/127.15.36.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab.
I20260811 08:04:24.451401 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.193:0
--local_ip_for_outbound_sockets=127.15.36.193
--webserver_interface=127.15.36.193
--webserver_port=0
--tserver_master_addrs=127.15.36.254:44253
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab
--principal=kudu/127.15.36.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:38313
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:04:24.589491 27011 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:04:24.589826 27011 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:04:24.589874 27011 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:04:24.591434 27011 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:04:24.591526 27011 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:04:24.591580 27011 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.193
I20260811 08:04:24.593417 27011 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:38313
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab
--principal=kudu/127.15.36.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.36.193
--webserver_port=0
--tserver_master_addrs=127.15.36.254:44253
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27011
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.193
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:04:24.593768 27011 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:04:24.594748 27011 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:04:24.607653 27020 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:04:24.607653 27017 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:04:24.607800 27018 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:04:24.608388 27011 server_base.cc:1034] running on GCE node
I20260811 08:04:24.608848 27011 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:04:24.609277 27011 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:04:24.610495 27011 hybrid_clock.cc:648] HybridClock initialized: now 1786435464610405 us; error 101 us; skew 500 ppm
Aug 11 08:04:24 dist-test-slave-2w3w krb5kdc[26886](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435464, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:04:24.614777 27011 init.cc:377] Logged in from keytab as kudu/127.15.36.193@KRBTEST.COM (short username kudu)
I20260811 08:04:24.615759 27011 webserver.cc:460] Webserver started at http://127.15.36.193:37443/ using document root <none> and password file <none>
I20260811 08:04:24.616047 27011 fs_manager.cc:359] Metadata directory not provided
I20260811 08:04:24.616128 27011 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:04:24.616297 27011 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:04:24.617499 27011 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/minicluster-data/ts-0/data/instance:
uuid: "ebe8bfbbdaef47afb9f449112818a209"
format_stamp: "Formatted at 2026-08-11 08:04:24 on dist-test-slave-2w3w"
server_key: "418c08538639fa4bd64c2d0a567c667e"
server_key_iv: "715e094f996b6cf7c43043168d7745e2"
server_key_version: "encryptionkey@0"
I20260811 08:04:24.618278 27011 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/minicluster-data/ts-0/wal/instance:
uuid: "ebe8bfbbdaef47afb9f449112818a209"
format_stamp: "Formatted at 2026-08-11 08:04:24 on dist-test-slave-2w3w"
server_key: "418c08538639fa4bd64c2d0a567c667e"
server_key_iv: "715e094f996b6cf7c43043168d7745e2"
server_key_version: "encryptionkey@0"
I20260811 08:04:24.620587 27011 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.003s
I20260811 08:04:24.621906 27029 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:04:24.622300 27011 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:04:24.622431 27011 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/minicluster-data/ts-0/wal
uuid: "ebe8bfbbdaef47afb9f449112818a209"
format_stamp: "Formatted at 2026-08-11 08:04:24 on dist-test-slave-2w3w"
server_key: "418c08538639fa4bd64c2d0a567c667e"
server_key_iv: "715e094f996b6cf7c43043168d7745e2"
server_key_version: "encryptionkey@0"
I20260811 08:04:24.622579 27011 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:04:24.657593 27011 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:04:24.660830 27011 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:04:24.661043 27011 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:04:24.661342 27011 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:04:24.661757 27011 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:04:24.661823 27011 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:04:24.661871 27011 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:04:24.661895 27011 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:04:24.676796 27011 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.193:38685
I20260811 08:04:24.677357 27011 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
I20260811 08:04:24.677400 27159 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.193:38685 every 8 connection(s)
I20260811 08:04:24.682191 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 27011
I20260811 08:04:24.682289 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/minicluster-data/ts-0/wal/instance
I20260811 08:04:24.682631 15507 external_mini_cluster.cc:1428] Setting key 6ba62279ac13d061fc6607207c564c54
Aug 11 08:04:24 dist-test-slave-2w3w krb5kdc[26886](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435464, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.193@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:04:24.693555 26987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:24.678407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:47393 (local address 127.15.36.254:44253)
0811 08:04:24.678468 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:24.678475 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:24.679307 (+ 832us) server_negotiation.cc:407] Connection header received
0811 08:04:24.680234 (+ 927us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:24.680235 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:24.680253 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:24.680325 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:24.681116 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:24.682244 (+ 1128us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:24.683845 (+ 1601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:24.684248 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:24.684355 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:24.688941 (+ 4586us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:04:24.688943 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:04:24.688944 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:04:24.688955 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:04:24.691550 (+ 2595us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:04:24.692153 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:04:24.692155 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:04:24.692155 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:04:24.692225 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:04:24.692537 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:04:24.692538 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:04:24.692538 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:04:24.692679 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:04:24.692768 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 08:04:24.693330 (+ 562us) server_negotiation.cc:299] Negotiation successful
0811 08:04:24.693453 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
WARNING: no policy specified for kudu/127.15.36.194@KRBTEST.COM; defaulting to no policy
I20260811 08:04:24.694175 27163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:24.678387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:44253 (local address 127.15.36.193:47393)
0811 08:04:24.678869 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:24.678912 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:24.680068 (+ 1156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:24.680430 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:24.680434 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:24.680746 (+ 312us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:04:24.680974 (+ 228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:24.680979 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:24.682536 (+ 1557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:24.682538 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:24.683701 (+ 1163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:24.683705 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:24.684475 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:24.684476 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:24.684700 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:24.686086 (+ 1386us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:04:24.686100 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:04:24.688591 (+ 2491us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:04:24.691690 (+ 3099us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:04:24.691706 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:04:24.691712 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:04:24.692032 (+ 320us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:04:24.692305 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:04:24.692306 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:04:24.692306 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:04:24.692447 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:04:24.692757 (+ 310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:04:24.692766 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:04:24.693133 (+ 367us) client_negotiation.cc:769] Sending connection context
0811 08:04:24.693289 (+ 156us) client_negotiation.cc:240] Negotiation successful
0811 08:04:24.693504 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":439,"thread_start_us":411,"threads_started":1}
I20260811 08:04:24.695391 27160 heartbeater.cc:347] Connected to a master server at 127.15.36.254:44253
I20260811 08:04:24.695568 27160 heartbeater.cc:464] Registering TS with master...
I20260811 08:04:24.696832 27160 heartbeater.cc:511] Master 127.15.36.254:44253 requested a full tablet report, sending...
I20260811 08:04:24.697692 26939 ts_manager.cc:194] Registered new tserver with Master: ebe8bfbbdaef47afb9f449112818a209 (127.15.36.193:38685)
I20260811 08:04:24.698635 26939 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.36.193@KRBTEST.COM'} at 127.15.36.193:47393
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab.
Entry for principal kudu/127.15.36.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab.
I20260811 08:04:24.735526 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.194:0
--local_ip_for_outbound_sockets=127.15.36.194
--webserver_interface=127.15.36.194
--webserver_port=0
--tserver_master_addrs=127.15.36.254:44253
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab
--principal=kudu/127.15.36.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:38313
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:04:24.905882 27167 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:04:24.906175 27167 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:04:24.906209 27167 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:04:24.907987 27167 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:04:24.908069 27167 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:04:24.908106 27167 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.194
I20260811 08:04:24.910526 27167 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:38313
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab
--principal=kudu/127.15.36.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.36.194
--webserver_port=0
--tserver_master_addrs=127.15.36.254:44253
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27167
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.194
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:04:24.910924 27167 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:04:24.911618 27167 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:04:24.920111 27174 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:04:24.920270 27167 server_base.cc:1034] running on GCE node
W20260811 08:04:24.920212 27176 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:04:24.920212 27173 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:04:24.920737 27167 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:04:24.921058 27167 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:04:24.922892 27167 hybrid_clock.cc:648] HybridClock initialized: now 1786435464922849 us; error 57 us; skew 500 ppm
Aug 11 08:04:24 dist-test-slave-2w3w krb5kdc[26886](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435464, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:04:24.928792 27167 init.cc:377] Logged in from keytab as kudu/127.15.36.194@KRBTEST.COM (short username kudu)
I20260811 08:04:24.929458 27167 webserver.cc:460] Webserver started at http://127.15.36.194:33857/ using document root <none> and password file <none>
I20260811 08:04:24.929757 27167 fs_manager.cc:359] Metadata directory not provided
I20260811 08:04:24.929843 27167 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:04:24.930023 27167 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:04:24.931524 27167 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/minicluster-data/ts-1/data/instance:
uuid: "823ad6982d7f49e1a2374a40359689fb"
format_stamp: "Formatted at 2026-08-11 08:04:24 on dist-test-slave-2w3w"
server_key: "e02179619ff54893313c0b1b5f5cbe36"
server_key_iv: "19f27eb3e722f47eb1173b42ea21507d"
server_key_version: "encryptionkey@0"
I20260811 08:04:24.931993 27167 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/minicluster-data/ts-1/wal/instance:
uuid: "823ad6982d7f49e1a2374a40359689fb"
format_stamp: "Formatted at 2026-08-11 08:04:24 on dist-test-slave-2w3w"
server_key: "e02179619ff54893313c0b1b5f5cbe36"
server_key_iv: "19f27eb3e722f47eb1173b42ea21507d"
server_key_version: "encryptionkey@0"
I20260811 08:04:24.933882 27167 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260811 08:04:24.935151 27184 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:04:24.935504 27167 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:04:24.935654 27167 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/minicluster-data/ts-1/wal
uuid: "823ad6982d7f49e1a2374a40359689fb"
format_stamp: "Formatted at 2026-08-11 08:04:24 on dist-test-slave-2w3w"
server_key: "e02179619ff54893313c0b1b5f5cbe36"
server_key_iv: "19f27eb3e722f47eb1173b42ea21507d"
server_key_version: "encryptionkey@0"
I20260811 08:04:24.935768 27167 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:04:24.952009 27167 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:04:24.956079 27167 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:04:24.956290 27167 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:04:24.956636 27167 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:04:24.957118 27167 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:04:24.957161 27167 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:04:24.957190 27167 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:04:24.957204 27167 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:04:24.968976 27167 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.194:36209
I20260811 08:04:24.969081 27312 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.194:36209 every 8 connection(s)
I20260811 08:04:24.969456 27167 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
I20260811 08:04:24.976444 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 27167
I20260811 08:04:24.976567 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/minicluster-data/ts-1/wal/instance
I20260811 08:04:24.976787 15507 external_mini_cluster.cc:1428] Setting key ca0b534bb5df62b91b1621317576941c
Aug 11 08:04:24 dist-test-slave-2w3w krb5kdc[26886](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435464, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.194@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:04:24.987879 26987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:24.970859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:51021 (local address 127.15.36.254:44253)
0811 08:04:24.970943 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:24.970946 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:24.971008 (+ 62us) server_negotiation.cc:407] Connection header received
0811 08:04:24.971693 (+ 685us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:24.971694 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:24.971708 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:24.971757 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:24.972873 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:24.973402 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:24.974873 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:24.975176 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:24.975283 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:24.979565 (+ 4282us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:04:24.979567 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:04:24.979567 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:04:24.979577 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:04:24.984955 (+ 5378us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:04:24.986076 (+ 1121us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:04:24.986078 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:04:24.986078 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:04:24.986164 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:04:24.986591 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:04:24.986591 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:04:24.986592 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:04:24.986732 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:04:24.986796 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 08:04:24.987680 (+ 884us) server_negotiation.cc:299] Negotiation successful
0811 08:04:24.987783 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 08:04:24.988126 27315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:24.970572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:44253 (local address 127.15.36.194:51021)
0811 08:04:24.970801 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:24.970905 (+ 104us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:24.971549 (+ 644us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:24.971843 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:24.971847 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:24.972516 (+ 669us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:04:24.972741 (+ 225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:24.972746 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:24.973538 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:24.973539 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:24.974750 (+ 1211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:24.974755 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:24.975298 (+ 543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:24.975299 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:24.975451 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:24.976232 (+ 781us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:04:24.976245 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:04:24.978286 (+ 2041us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:04:24.985147 (+ 6861us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:04:24.985167 (+ 20us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:04:24.985172 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:04:24.985830 (+ 658us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:04:24.986269 (+ 439us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:04:24.986270 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:04:24.986271 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:04:24.986482 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:04:24.986825 (+ 343us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:04:24.986834 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:04:24.987365 (+ 531us) client_negotiation.cc:769] Sending connection context
0811 08:04:24.987591 (+ 226us) client_negotiation.cc:240] Negotiation successful
0811 08:04:24.987828 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":86,"threads_started":1}
I20260811 08:04:24.988950 27313 heartbeater.cc:347] Connected to a master server at 127.15.36.254:44253
I20260811 08:04:24.989085 27313 heartbeater.cc:464] Registering TS with master...
I20260811 08:04:24.989354 27313 heartbeater.cc:511] Master 127.15.36.254:44253 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.15.36.195@KRBTEST.COM; defaulting to no policy
I20260811 08:04:24.990113 26939 ts_manager.cc:194] Registered new tserver with Master: 823ad6982d7f49e1a2374a40359689fb (127.15.36.194:36209)
I20260811 08:04:24.990511 26939 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.36.194@KRBTEST.COM'} at 127.15.36.194:51021
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab.
Entry for principal kudu/127.15.36.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab.
I20260811 08:04:25.034950 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.195:0
--local_ip_for_outbound_sockets=127.15.36.195
--webserver_interface=127.15.36.195
--webserver_port=0
--tserver_master_addrs=127.15.36.254:44253
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab
--principal=kudu/127.15.36.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:38313
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:04:25.148509 27318 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:04:25.148816 27318 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:04:25.148892 27318 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:04:25.150942 27318 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:04:25.151085 27318 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:04:25.151140 27318 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.195
I20260811 08:04:25.153443 27318 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:38313
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab
--principal=kudu/127.15.36.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.36.195
--webserver_port=0
--tserver_master_addrs=127.15.36.254:44253
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27318
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.195
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:04:25.153929 27318 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:04:25.154244 27318 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:04:25.162097 27323 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:04:25.161988 27326 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:04:25.161988 27324 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:04:25.162400 27318 server_base.cc:1034] running on GCE node
I20260811 08:04:25.162757 27318 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:04:25.163141 27318 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:04:25.164387 27318 hybrid_clock.cc:648] HybridClock initialized: now 1786435465164352 us; error 55 us; skew 500 ppm
Aug 11 08:04:25 dist-test-slave-2w3w krb5kdc[26886](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435465, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:04:25.168804 27318 init.cc:377] Logged in from keytab as kudu/127.15.36.195@KRBTEST.COM (short username kudu)
I20260811 08:04:25.169901 27318 webserver.cc:460] Webserver started at http://127.15.36.195:41169/ using document root <none> and password file <none>
I20260811 08:04:25.170275 27318 fs_manager.cc:359] Metadata directory not provided
I20260811 08:04:25.170369 27318 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:04:25.170562 27318 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:04:25.172029 27318 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/minicluster-data/ts-2/data/instance:
uuid: "bd9b357030ef4a5fa289f349ef059821"
format_stamp: "Formatted at 2026-08-11 08:04:25 on dist-test-slave-2w3w"
server_key: "78d1606c8b772ccd38cc969029829c2c"
server_key_iv: "a81c359df9dbd7ba9447bf505afb4913"
server_key_version: "encryptionkey@0"
I20260811 08:04:25.172492 27318 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/minicluster-data/ts-2/wal/instance:
uuid: "bd9b357030ef4a5fa289f349ef059821"
format_stamp: "Formatted at 2026-08-11 08:04:25 on dist-test-slave-2w3w"
server_key: "78d1606c8b772ccd38cc969029829c2c"
server_key_iv: "a81c359df9dbd7ba9447bf505afb4913"
server_key_version: "encryptionkey@0"
I20260811 08:04:25.174471 27318 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20260811 08:04:25.175719 27334 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:04:25.176128 27318 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:04:25.176285 27318 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/minicluster-data/ts-2/wal
uuid: "bd9b357030ef4a5fa289f349ef059821"
format_stamp: "Formatted at 2026-08-11 08:04:25 on dist-test-slave-2w3w"
server_key: "78d1606c8b772ccd38cc969029829c2c"
server_key_iv: "a81c359df9dbd7ba9447bf505afb4913"
server_key_version: "encryptionkey@0"
I20260811 08:04:25.176412 27318 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:04:25.193883 27318 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:04:25.197434 27318 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:04:25.197655 27318 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:04:25.197949 27318 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:04:25.198331 27318 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:04:25.198397 27318 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:04:25.198446 27318 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:04:25.198468 27318 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:04:25.207746 27318 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.195:45879
I20260811 08:04:25.207973 27460 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.195:45879 every 8 connection(s)
I20260811 08:04:25.208241 27318 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
I20260811 08:04:25.215528 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 27318
I20260811 08:04:25.215667 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/minicluster-data/ts-2/wal/instance
I20260811 08:04:25.216064 15507 external_mini_cluster.cc:1428] Setting key 52fb4a46a15d06e712e6bcba03a8b606
Aug 11 08:04:25 dist-test-slave-2w3w krb5kdc[26886](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435465, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.195@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:04:25.222044 26987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:25.209422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:44233 (local address 127.15.36.254:44253)
0811 08:04:25.209485 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:25.209487 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:25.209500 (+ 13us) server_negotiation.cc:407] Connection header received
0811 08:04:25.210506 (+ 1006us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:25.210507 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:25.210522 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:25.210577 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:25.211404 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:25.211954 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:25.213111 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:25.213326 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:25.213418 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:25.217606 (+ 4188us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:04:25.217608 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:04:25.217608 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:04:25.217618 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:04:25.220046 (+ 2428us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:04:25.220679 (+ 633us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:04:25.220680 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:04:25.220681 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:04:25.220771 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:04:25.221105 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:04:25.221107 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:04:25.221107 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:04:25.221341 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:04:25.221472 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0811 08:04:25.221820 (+ 348us) server_negotiation.cc:299] Negotiation successful
0811 08:04:25.221943 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 08:04:25.222270 27463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:25.209114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:44253 (local address 127.15.36.195:44233)
0811 08:04:25.209313 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:25.209365 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:25.210366 (+ 1001us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:25.210680 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:25.210683 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:25.211071 (+ 388us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:04:25.211292 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:25.211297 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:25.212076 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:25.212078 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:25.212994 (+ 916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:25.212997 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:25.213434 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:25.213435 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:25.213578 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:25.214464 (+ 886us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:04:25.214474 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:04:25.217498 (+ 3024us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:04:25.220212 (+ 2714us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:04:25.220227 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:04:25.220238 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:04:25.220569 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:04:25.220866 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:04:25.220867 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:04:25.220868 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:04:25.221011 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:04:25.221463 (+ 452us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:04:25.221472 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:04:25.221646 (+ 174us) client_negotiation.cc:769] Sending connection context
0811 08:04:25.221789 (+ 143us) client_negotiation.cc:240] Negotiation successful
0811 08:04:25.222000 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":112,"threads_started":1}
I20260811 08:04:25.223100 27461 heartbeater.cc:347] Connected to a master server at 127.15.36.254:44253
I20260811 08:04:25.223239 27461 heartbeater.cc:464] Registering TS with master...
I20260811 08:04:25.223459 27461 heartbeater.cc:511] Master 127.15.36.254:44253 requested a full tablet report, sending...
I20260811 08:04:25.224080 26939 ts_manager.cc:194] Registered new tserver with Master: bd9b357030ef4a5fa289f349ef059821 (127.15.36.195:45879)
I20260811 08:04:25.224752 26939 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.36.195@KRBTEST.COM'} at 127.15.36.195:44233
I20260811 08:04:25.230486 15507 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 08:04:25.242364 26987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:25.232565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50378 (local address 127.15.36.254:44253)
0811 08:04:25.232671 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:25.232674 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:25.232687 (+ 13us) server_negotiation.cc:407] Connection header received
0811 08:04:25.232720 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:25.232721 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:25.232740 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:25.232817 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:04:25.233533 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:25.234122 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:25.235043 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:25.235272 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:25.235372 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:25.238660 (+ 3288us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:04:25.238662 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:04:25.238662 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:04:25.238684 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:04:25.240851 (+ 2167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:04:25.241320 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:04:25.241322 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:04:25.241322 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:04:25.241423 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:04:25.241676 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:04:25.241677 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:04:25.241677 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:04:25.241873 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:04:25.242000 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0811 08:04:25.242143 (+ 143us) server_negotiation.cc:299] Negotiation successful
0811 08:04:25.242251 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 08:04:25.245573 26939 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50378:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:04:25.247455 26939 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:04:25.257790 27476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:25.250717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38850 (local address 127.15.36.193:38685)
0811 08:04:25.251642 (+ 925us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:25.251648 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:25.251860 (+ 212us) server_negotiation.cc:407] Connection header received
0811 08:04:25.252069 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:25.252072 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:25.252093 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:25.252156 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:04:25.252510 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:25.254833 (+ 2323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:25.256552 (+ 1719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:25.257293 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:25.257362 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:25.257424 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 08:04:25.257635 (+ 211us) server_negotiation.cc:299] Negotiation successful
0811 08:04:25.257683 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":886,"thread_start_us":589,"threads_started":1}
I20260811 08:04:25.258073 27475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:25.250774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46234 (local address 127.15.36.195:45879)
0811 08:04:25.252121 (+ 1347us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:25.252126 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:25.252137 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:04:25.252181 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:25.252183 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:25.252198 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:25.252278 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:04:25.252496 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:25.254890 (+ 2394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:25.256453 (+ 1563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:25.257249 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:25.257355 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:25.257425 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 08:04:25.257938 (+ 513us) server_negotiation.cc:299] Negotiation successful
0811 08:04:25.257992 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1302,"thread_start_us":86,"threads_started":1}
I20260811 08:04:25.258139 27474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:25.250647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.195:45879 (local address 127.0.0.1:46234)
0811 08:04:25.251883 (+ 1236us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:25.251894 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:25.251954 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:25.252366 (+ 412us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:25.252366 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:25.252369 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:04:25.252410 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:25.252411 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:25.255106 (+ 2695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:25.255108 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:25.256336 (+ 1228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:25.256340 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:25.257356 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:25.257357 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:25.257515 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:25.257518 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:04:25.257597 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 08:04:25.257824 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1205,"mutex_wait_us":162,"thread_start_us":199,"threads_started":1}
I20260811 08:04:25.258638 27472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:25.250621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.193:38685 (local address 127.0.0.1:38850)
0811 08:04:25.251717 (+ 1096us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:25.251776 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:25.251932 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:25.252291 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:25.252296 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:25.252299 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:04:25.252405 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:25.252408 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:25.254984 (+ 2576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:25.254985 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:25.256460 (+ 1475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:25.256464 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:25.257361 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:25.257362 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:25.257481 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:25.257502 (+ 21us) client_negotiation.cc:769] Sending connection context
0811 08:04:25.257597 (+ 95us) client_negotiation.cc:240] Negotiation successful
0811 08:04:25.257824 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1065,"mutex_wait_us":36,"thread_start_us":60,"threads_started":1}
I20260811 08:04:25.258886 27478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:25.251325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.194:36209 (local address 127.0.0.1:57692)
0811 08:04:25.251947 (+ 622us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:25.251959 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:25.252200 (+ 241us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:25.252495 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:25.252496 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:25.252499 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:04:25.252556 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:25.252559 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:25.255302 (+ 2743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:25.255303 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:25.256460 (+ 1157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:25.256464 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:25.258589 (+ 2125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:25.258590 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:25.258662 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:25.258667 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 08:04:25.258758 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 08:04:25.258811 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":592,"mutex_wait_us":8,"thread_start_us":311,"threads_started":1}
I20260811 08:04:25.259055 27477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:25.251404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57692 (local address 127.15.36.194:36209)
0811 08:04:25.251586 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:25.251595 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:25.252292 (+ 697us) server_negotiation.cc:407] Connection header received
0811 08:04:25.252360 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:25.252362 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:25.252377 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:25.252494 (+ 117us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:04:25.252626 (+ 132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:25.255171 (+ 2545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:25.257473 (+ 2302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:25.258267 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:25.258351 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:25.258411 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 08:04:25.258874 (+ 463us) server_negotiation.cc:299] Negotiation successful
0811 08:04:25.258932 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":101,"threads_started":1}
I20260811 08:04:25.259341 27385 tablet_service.cc:1467] Processing CreateTablet for tablet fa8d4b10435c40eb8f60144428fdefce (DEFAULT_TABLE table=test-table [id=48a86fc249f44a95af2ab695842156d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:04:25.259565 27085 tablet_service.cc:1467] Processing CreateTablet for tablet fa8d4b10435c40eb8f60144428fdefce (DEFAULT_TABLE table=test-table [id=48a86fc249f44a95af2ab695842156d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:04:25.259809 27385 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa8d4b10435c40eb8f60144428fdefce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:04:25.259814 27238 tablet_service.cc:1467] Processing CreateTablet for tablet fa8d4b10435c40eb8f60144428fdefce (DEFAULT_TABLE table=test-table [id=48a86fc249f44a95af2ab695842156d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:04:25.260003 27085 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa8d4b10435c40eb8f60144428fdefce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:04:25.260146 27238 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa8d4b10435c40eb8f60144428fdefce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:04:25.262755 27479 tablet_bootstrap.cc:492] T fa8d4b10435c40eb8f60144428fdefce P ebe8bfbbdaef47afb9f449112818a209: Bootstrap starting.
I20260811 08:04:25.263821 27479 tablet_bootstrap.cc:654] T fa8d4b10435c40eb8f60144428fdefce P ebe8bfbbdaef47afb9f449112818a209: Neither blocks nor log segments found. Creating new log.
I20260811 08:04:25.264889 27479 log.cc:824] T fa8d4b10435c40eb8f60144428fdefce P ebe8bfbbdaef47afb9f449112818a209: Log is configured to *not* fsync() on all Append() calls
I20260811 08:04:25.265583 27481 tablet_bootstrap.cc:492] T fa8d4b10435c40eb8f60144428fdefce P 823ad6982d7f49e1a2374a40359689fb: Bootstrap starting.
I20260811 08:04:25.266348 27481 tablet_bootstrap.cc:654] T fa8d4b10435c40eb8f60144428fdefce P 823ad6982d7f49e1a2374a40359689fb: Neither blocks nor log segments found. Creating new log.
I20260811 08:04:25.266669 27479 tablet_bootstrap.cc:492] T fa8d4b10435c40eb8f60144428fdefce P ebe8bfbbdaef47afb9f449112818a209: No bootstrap required, opened a new log
I20260811 08:04:25.266752 27479 ts_tablet_manager.cc:1397] T fa8d4b10435c40eb8f60144428fdefce P ebe8bfbbdaef47afb9f449112818a209: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260811 08:04:25.267055 27481 log.cc:824] T fa8d4b10435c40eb8f60144428fdefce P 823ad6982d7f49e1a2374a40359689fb: Log is configured to *not* fsync() on all Append() calls
I20260811 08:04:25.264969 27483 tablet_bootstrap.cc:492] T fa8d4b10435c40eb8f60144428fdefce P bd9b357030ef4a5fa289f349ef059821: Bootstrap starting.
I20260811 08:04:25.269728 27481 tablet_bootstrap.cc:492] T fa8d4b10435c40eb8f60144428fdefce P 823ad6982d7f49e1a2374a40359689fb: No bootstrap required, opened a new log
I20260811 08:04:25.269889 27481 ts_tablet_manager.cc:1397] T fa8d4b10435c40eb8f60144428fdefce P 823ad6982d7f49e1a2374a40359689fb: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.002s
I20260811 08:04:25.270123 27483 tablet_bootstrap.cc:654] T fa8d4b10435c40eb8f60144428fdefce P bd9b357030ef4a5fa289f349ef059821: Neither blocks nor log segments found. Creating new log.
I20260811 08:04:25.271663 27483 log.cc:824] T fa8d4b10435c40eb8f60144428fdefce P bd9b357030ef4a5fa289f349ef059821: Log is configured to *not* fsync() on all Append() calls
I20260811 08:04:25.273269 27483 tablet_bootstrap.cc:492] T fa8d4b10435c40eb8f60144428fdefce P bd9b357030ef4a5fa289f349ef059821: No bootstrap required, opened a new log
I20260811 08:04:25.273366 27483 ts_tablet_manager.cc:1397] T fa8d4b10435c40eb8f60144428fdefce P bd9b357030ef4a5fa289f349ef059821: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.000s
I20260811 08:04:25.273196 27479 raft_consensus.cc:348] T fa8d4b10435c40eb8f60144428fdefce P ebe8bfbbdaef47afb9f449112818a209 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe8bfbbdaef47afb9f449112818a209" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 38685 } } peers { permanent_uuid: "bd9b357030ef4a5fa289f349ef059821" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 45879 } } peers { permanent_uuid: "823ad6982d7f49e1a2374a40359689fb" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 36209 } }
I20260811 08:04:25.273437 27479 raft_consensus.cc:374] T fa8d4b10435c40eb8f60144428fdefce P ebe8bfbbdaef47afb9f449112818a209 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:04:25.273663 27479 raft_consensus.cc:729] T fa8d4b10435c40eb8f60144428fdefce P ebe8bfbbdaef47afb9f449112818a209 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebe8bfbbdaef47afb9f449112818a209, State: Initialized, Role: FOLLOWER
I20260811 08:04:25.273613 27481 raft_consensus.cc:348] T fa8d4b10435c40eb8f60144428fdefce P 823ad6982d7f49e1a2374a40359689fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe8bfbbdaef47afb9f449112818a209" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 38685 } } peers { permanent_uuid: "bd9b357030ef4a5fa289f349ef059821" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 45879 } } peers { permanent_uuid: "823ad6982d7f49e1a2374a40359689fb" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 36209 } }
I20260811 08:04:25.273825 27481 raft_consensus.cc:374] T fa8d4b10435c40eb8f60144428fdefce P 823ad6982d7f49e1a2374a40359689fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:04:25.273877 27481 raft_consensus.cc:729] T fa8d4b10435c40eb8f60144428fdefce P 823ad6982d7f49e1a2374a40359689fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 823ad6982d7f49e1a2374a40359689fb, State: Initialized, Role: FOLLOWER
I20260811 08:04:25.273854 27479 consensus_queue.cc:260] T fa8d4b10435c40eb8f60144428fdefce P ebe8bfbbdaef47afb9f449112818a209 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe8bfbbdaef47afb9f449112818a209" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 38685 } } peers { permanent_uuid: "bd9b357030ef4a5fa289f349ef059821" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 45879 } } peers { permanent_uuid: "823ad6982d7f49e1a2374a40359689fb" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 36209 } }
I20260811 08:04:25.274318 27479 ts_tablet_manager.cc:1428] T fa8d4b10435c40eb8f60144428fdefce P ebe8bfbbdaef47afb9f449112818a209: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s
I20260811 08:04:25.274201 27481 consensus_queue.cc:260] T fa8d4b10435c40eb8f60144428fdefce P 823ad6982d7f49e1a2374a40359689fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe8bfbbdaef47afb9f449112818a209" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 38685 } } peers { permanent_uuid: "bd9b357030ef4a5fa289f349ef059821" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 45879 } } peers { permanent_uuid: "823ad6982d7f49e1a2374a40359689fb" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 36209 } }
I20260811 08:04:25.274475 27160 heartbeater.cc:503] Master 127.15.36.254:44253 was elected leader, sending a full tablet report...
I20260811 08:04:25.274642 27481 ts_tablet_manager.cc:1428] T fa8d4b10435c40eb8f60144428fdefce P 823ad6982d7f49e1a2374a40359689fb: Time spent starting tablet: real 0.005s user 0.004s sys 0.002s
I20260811 08:04:25.274951 27313 heartbeater.cc:503] Master 127.15.36.254:44253 was elected leader, sending a full tablet report...
I20260811 08:04:25.276168 27483 raft_consensus.cc:348] T fa8d4b10435c40eb8f60144428fdefce P bd9b357030ef4a5fa289f349ef059821 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe8bfbbdaef47afb9f449112818a209" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 38685 } } peers { permanent_uuid: "bd9b357030ef4a5fa289f349ef059821" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 45879 } } peers { permanent_uuid: "823ad6982d7f49e1a2374a40359689fb" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 36209 } }
I20260811 08:04:25.276391 27483 raft_consensus.cc:374] T fa8d4b10435c40eb8f60144428fdefce P bd9b357030ef4a5fa289f349ef059821 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:04:25.276448 27483 raft_consensus.cc:729] T fa8d4b10435c40eb8f60144428fdefce P bd9b357030ef4a5fa289f349ef059821 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd9b357030ef4a5fa289f349ef059821, State: Initialized, Role: FOLLOWER
I20260811 08:04:25.276583 27483 consensus_queue.cc:260] T fa8d4b10435c40eb8f60144428fdefce P bd9b357030ef4a5fa289f349ef059821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe8bfbbdaef47afb9f449112818a209" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 38685 } } peers { permanent_uuid: "bd9b357030ef4a5fa289f349ef059821" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 45879 } } peers { permanent_uuid: "823ad6982d7f49e1a2374a40359689fb" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 36209 } }
I20260811 08:04:25.276960 27483 ts_tablet_manager.cc:1428] T fa8d4b10435c40eb8f60144428fdefce P bd9b357030ef4a5fa289f349ef059821: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260811 08:04:25.276988 27461 heartbeater.cc:503] Master 127.15.36.254:44253 was elected leader, sending a full tablet report...
W20260811 08:04:25.428539 27161 tablet.cc:2369] T fa8d4b10435c40eb8f60144428fdefce P ebe8bfbbdaef47afb9f449112818a209: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:04:25.457166 27487 raft_consensus.cc:482] T fa8d4b10435c40eb8f60144428fdefce P ebe8bfbbdaef47afb9f449112818a209 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:04:25.457329 27487 raft_consensus.cc:504] T fa8d4b10435c40eb8f60144428fdefce P ebe8bfbbdaef47afb9f449112818a209 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe8bfbbdaef47afb9f449112818a209" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 38685 } } peers { permanent_uuid: "bd9b357030ef4a5fa289f349ef059821" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 45879 } } peers { permanent_uuid: "823ad6982d7f49e1a2374a40359689fb" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 36209 } }
I20260811 08:04:25.457718 27487 leader_election.cc:288] T fa8d4b10435c40eb8f60144428fdefce P ebe8bfbbdaef47afb9f449112818a209 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd9b357030ef4a5fa289f349ef059821 (127.15.36.195:45879), 823ad6982d7f49e1a2374a40359689fb (127.15.36.194:36209)
W20260811 08:04:25.459051 27462 tablet.cc:2369] T fa8d4b10435c40eb8f60144428fdefce P bd9b357030ef4a5fa289f349ef059821: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:04:25.461724 27477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:25.458399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:60399 (local address 127.15.36.194:36209)
0811 08:04:25.458665 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:25.458668 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:25.458685 (+ 17us) server_negotiation.cc:407] Connection header received
0811 08:04:25.458782 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:25.458783 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:25.458793 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:25.458845 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:04:25.459206 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:25.459742 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:25.460841 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:25.461275 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:25.461388 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:25.461400 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0811 08:04:25.461587 (+ 187us) server_negotiation.cc:299] Negotiation successful
0811 08:04:25.461633 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":238}
I20260811 08:04:25.461763 27492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:25.458261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.194:36209 (local address 127.15.36.193:60399)
0811 08:04:25.458616 (+ 355us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:25.458629 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:25.458706 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:25.458859 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:25.458860 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:25.458861 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:04:25.458952 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:25.459045 (+ 93us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:25.459856 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:25.459857 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:25.460714 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:25.460717 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:25.461388 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:25.461389 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:25.461488 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:25.461492 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:04:25.461580 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 08:04:25.461630 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":331,"mutex_wait_us":1,"thread_start_us":289,"threads_started":1}
I20260811 08:04:25.462287 27475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:25.458194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:47615 (local address 127.15.36.195:45879)
0811 08:04:25.458294 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:25.458296 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:25.458308 (+ 12us) server_negotiation.cc:407] Connection header received
0811 08:04:25.458426 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:25.458428 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:25.458440 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:25.458476 (+ 36us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:04:25.458745 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:25.459518 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:25.460678 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:25.461603 (+ 925us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:25.461770 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:25.461783 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0811 08:04:25.462171 (+ 388us) server_negotiation.cc:299] Negotiation successful
0811 08:04:25.462223 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 08:04:25.462304 27491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:25.457984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.195:45879 (local address 127.15.36.193:47615)
0811 08:04:25.458236 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:25.458250 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 08:04:25.458323 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:04:25.458554 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:04:25.458554 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:04:25.458556 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:04:25.458636 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:25.458638 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:25.459630 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:25.459631 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:25.460558 (+ 927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:04:25.460561 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:04:25.461774 (+ 1213us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:04:25.461775 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:04:25.462081 (+ 306us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:25.462087 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 08:04:25.462154 (+ 67us) client_negotiation.cc:240] Negotiation successful
0811 08:04:25.462203 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":228,"mutex_wait_us":4,"thread_start_us":141,"threads_started":1}
I20260811 08:04:25.462376 27262 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa8d4b10435c40eb8f60144428fdefce" candidate_uuid: "ebe8bfbbdaef47afb9f449112818a209" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "823ad6982d7f49e1a2374a40359689fb" is_pre_election: true
I20260811 08:04:25.462628 27408 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa8d4b10435c40eb8f60144428fdefce" candidate_uuid: "ebe8bfbbdaef47afb9f449112818a209" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd9b357030ef4a5fa289f349ef059821" is_pre_election: true
I20260811 08:04:25.462769 27408 raft_consensus.cc:2454] T fa8d4b10435c40eb8f60144428fdefce P bd9b357030ef4a5fa289f349ef059821 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ebe8bfbbdaef47afb9f449112818a209 in term 0.
I20260811 08:04:25.462814 27262 raft_consensus.cc:2454] T fa8d4b10435c40eb8f60144428fdefce P 823ad6982d7f49e1a2374a40359689fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ebe8bfbbdaef47afb9f449112818a209 in term 0.
I20260811 08:04:25.463071 27037 leader_election.cc:302] T fa8d4b10435c40eb8f60144428fdefce P ebe8bfbbdaef47afb9f449112818a209 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd9b357030ef4a5fa289f349ef059821, ebe8bfbbdaef47afb9f449112818a209; no voters:
I20260811 08:04:25.463379 27487 raft_consensus.cc:2781] T fa8d4b10435c40eb8f60144428fdefce P ebe8bfbbdaef47afb9f449112818a209 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:04:25.463457 27487 raft_consensus.cc:482] T fa8d4b10435c40eb8f60144428fdefce P ebe8bfbbdaef47afb9f449112818a209 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:04:25.463485 27487 raft_consensus.cc:3037] T fa8d4b10435c40eb8f60144428fdefce P ebe8bfbbdaef47afb9f449112818a209 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:04:25.464676 27487 raft_consensus.cc:504] T fa8d4b10435c40eb8f60144428fdefce P ebe8bfbbdaef47afb9f449112818a209 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe8bfbbdaef47afb9f449112818a209" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 38685 } } peers { permanent_uuid: "bd9b357030ef4a5fa289f349ef059821" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 45879 } } peers { permanent_uuid: "823ad6982d7f49e1a2374a40359689fb" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 36209 } }
I20260811 08:04:25.464962 27487 leader_election.cc:288] T fa8d4b10435c40eb8f60144428fdefce P ebe8bfbbdaef47afb9f449112818a209 [CANDIDATE]: Term 1 election: Requested vote from peers bd9b357030ef4a5fa289f349ef059821 (127.15.36.195:45879), 823ad6982d7f49e1a2374a40359689fb (127.15.36.194:36209)
I20260811 08:04:25.465206 27408 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa8d4b10435c40eb8f60144428fdefce" candidate_uuid: "ebe8bfbbdaef47afb9f449112818a209" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd9b357030ef4a5fa289f349ef059821"
I20260811 08:04:25.465241 27262 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa8d4b10435c40eb8f60144428fdefce" candidate_uuid: "ebe8bfbbdaef47afb9f449112818a209" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "823ad6982d7f49e1a2374a40359689fb"
I20260811 08:04:25.465338 27262 raft_consensus.cc:3037] T fa8d4b10435c40eb8f60144428fdefce P 823ad6982d7f49e1a2374a40359689fb [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:04:25.465353 27408 raft_consensus.cc:3037] T fa8d4b10435c40eb8f60144428fdefce P bd9b357030ef4a5fa289f349ef059821 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:04:25.466249 27262 raft_consensus.cc:2454] T fa8d4b10435c40eb8f60144428fdefce P 823ad6982d7f49e1a2374a40359689fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ebe8bfbbdaef47afb9f449112818a209 in term 1.
I20260811 08:04:25.466781 27034 leader_election.cc:302] T fa8d4b10435c40eb8f60144428fdefce P ebe8bfbbdaef47afb9f449112818a209 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 823ad6982d7f49e1a2374a40359689fb, ebe8bfbbdaef47afb9f449112818a209; no voters:
I20260811 08:04:25.466851 27408 raft_consensus.cc:2454] T fa8d4b10435c40eb8f60144428fdefce P bd9b357030ef4a5fa289f349ef059821 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ebe8bfbbdaef47afb9f449112818a209 in term 1.
I20260811 08:04:25.467039 27487 raft_consensus.cc:2781] T fa8d4b10435c40eb8f60144428fdefce P ebe8bfbbdaef47afb9f449112818a209 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:04:25.467310 27487 raft_consensus.cc:686] T fa8d4b10435c40eb8f60144428fdefce P ebe8bfbbdaef47afb9f449112818a209 [term 1 LEADER]: Becoming Leader. State: Replica: ebe8bfbbdaef47afb9f449112818a209, State: Running, Role: LEADER
I20260811 08:04:25.467700 27487 consensus_queue.cc:237] T fa8d4b10435c40eb8f60144428fdefce P ebe8bfbbdaef47afb9f449112818a209 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe8bfbbdaef47afb9f449112818a209" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 38685 } } peers { permanent_uuid: "bd9b357030ef4a5fa289f349ef059821" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 45879 } } peers { permanent_uuid: "823ad6982d7f49e1a2374a40359689fb" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 36209 } }
I20260811 08:04:25.469955 26939 catalog_manager.cc:5495] T fa8d4b10435c40eb8f60144428fdefce P ebe8bfbbdaef47afb9f449112818a209 reported cstate change: term changed from 0 to 1, leader changed from <none> to ebe8bfbbdaef47afb9f449112818a209 (127.15.36.193). New cstate: current_term: 1 leader_uuid: "ebe8bfbbdaef47afb9f449112818a209" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe8bfbbdaef47afb9f449112818a209" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 38685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd9b357030ef4a5fa289f349ef059821" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 45879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "823ad6982d7f49e1a2374a40359689fb" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 36209 } health_report { overall_health: UNKNOWN } } }
W20260811 08:04:25.470633 27314 tablet.cc:2369] T fa8d4b10435c40eb8f60144428fdefce P 823ad6982d7f49e1a2374a40359689fb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:04:25.494633 27476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:25.491186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38854 (local address 127.15.36.193:38685)
0811 08:04:25.491337 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0811 08:04:25.491339 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:04:25.491350 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:04:25.491436 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:04:25.491437 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:04:25.491459 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:04:25.491545 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:04:25.491821 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:25.492403 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:25.493436 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:04:25.493663 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:04:25.493739 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:04:25.494152 (+ 413us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:04:25.494286 (+ 134us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:04:25.494373 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 08:04:25.494517 (+ 144us) server_negotiation.cc:299] Negotiation successful
0811 08:04:25.494545 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116}
I20260811 08:04:25.497422 27262 raft_consensus.cc:1261] T fa8d4b10435c40eb8f60144428fdefce P 823ad6982d7f49e1a2374a40359689fb [term 1 FOLLOWER]: Refusing update from remote peer ebe8bfbbdaef47afb9f449112818a209: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:04:25.497548 27408 raft_consensus.cc:1261] T fa8d4b10435c40eb8f60144428fdefce P bd9b357030ef4a5fa289f349ef059821 [term 1 FOLLOWER]: Refusing update from remote peer ebe8bfbbdaef47afb9f449112818a209: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:04:25.497910 27493 consensus_queue.cc:1035] T fa8d4b10435c40eb8f60144428fdefce P ebe8bfbbdaef47afb9f449112818a209 [LEADER]: Connected to new peer: Peer: permanent_uuid: "823ad6982d7f49e1a2374a40359689fb" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:04:25.498039 27487 consensus_queue.cc:1035] T fa8d4b10435c40eb8f60144428fdefce P ebe8bfbbdaef47afb9f449112818a209 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd9b357030ef4a5fa289f349ef059821" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 45879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:04:25.501045 27496 mvcc.cc:205] Tried to move back new op lower bound from 7317239666672783360 to 7317239666559414272. Current Snapshot: MvccSnapshot[applied={T|T < 7317239666672783360}]
I20260811 08:04:25.501896 27498 mvcc.cc:205] Tried to move back new op lower bound from 7317239666672783360 to 7317239666559414272. Current Snapshot: MvccSnapshot[applied={T|T < 7317239666672783360}]
I20260811 08:04:25.504572 26933 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50378:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:04:25.504731 26933 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50378:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:04:25.505885 26933 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f39771ac295a4c3f8d5f8382f4cc5ac3: Sending DeleteTablet for 3 replicas of tablet fa8d4b10435c40eb8f60144428fdefce
I20260811 08:04:25.506646 27085 tablet_service.cc:1514] Processing DeleteTablet for tablet fa8d4b10435c40eb8f60144428fdefce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:04:25 UTC) from {username='kudu', principal='kudu/127.15.36.254@KRBTEST.COM'} at 127.0.0.1:38850
I20260811 08:04:25.506737 27238 tablet_service.cc:1514] Processing DeleteTablet for tablet fa8d4b10435c40eb8f60144428fdefce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:04:25 UTC) from {username='kudu', principal='kudu/127.15.36.254@KRBTEST.COM'} at 127.0.0.1:57692
I20260811 08:04:25.507050 27508 tablet_replica.cc:330] T fa8d4b10435c40eb8f60144428fdefce P ebe8bfbbdaef47afb9f449112818a209: stopping tablet replica
I20260811 08:04:25.507037 27385 tablet_service.cc:1514] Processing DeleteTablet for tablet fa8d4b10435c40eb8f60144428fdefce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:04:25 UTC) from {username='kudu', principal='kudu/127.15.36.254@KRBTEST.COM'} at 127.0.0.1:46234
I20260811 08:04:25.507176 27508 raft_consensus.cc:2229] T fa8d4b10435c40eb8f60144428fdefce P ebe8bfbbdaef47afb9f449112818a209 [term 1 LEADER]: Raft consensus shutting down.
I20260811 08:04:25.507294 27508 raft_consensus.cc:2258] T fa8d4b10435c40eb8f60144428fdefce P ebe8bfbbdaef47afb9f449112818a209 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:04:25.507354 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 27011
I20260811 08:04:25.509498 27509 tablet_replica.cc:330] T fa8d4b10435c40eb8f60144428fdefce P 823ad6982d7f49e1a2374a40359689fb: stopping tablet replica
I20260811 08:04:25.509725 27509 raft_consensus.cc:2229] T fa8d4b10435c40eb8f60144428fdefce P 823ad6982d7f49e1a2374a40359689fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:04:25.509984 27509 raft_consensus.cc:2258] T fa8d4b10435c40eb8f60144428fdefce P 823ad6982d7f49e1a2374a40359689fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:04:25.510634 27509 ts_tablet_manager.cc:1905] T fa8d4b10435c40eb8f60144428fdefce P 823ad6982d7f49e1a2374a40359689fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:04:25.513547 27509 ts_tablet_manager.cc:1918] T fa8d4b10435c40eb8f60144428fdefce P 823ad6982d7f49e1a2374a40359689fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:04:25.513679 27509 log.cc:1196] T fa8d4b10435c40eb8f60144428fdefce P 823ad6982d7f49e1a2374a40359689fb: Deleting WAL directory at /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/minicluster-data/ts-1/wal/wals/fa8d4b10435c40eb8f60144428fdefce
I20260811 08:04:25.513989 27509 ts_tablet_manager.cc:1939] T fa8d4b10435c40eb8f60144428fdefce P 823ad6982d7f49e1a2374a40359689fb: Deleting consensus metadata
I20260811 08:04:25.515393 27510 tablet_replica.cc:330] T fa8d4b10435c40eb8f60144428fdefce P bd9b357030ef4a5fa289f349ef059821: stopping tablet replica
I20260811 08:04:25.515416 26922 catalog_manager.cc:4841] TS 823ad6982d7f49e1a2374a40359689fb (127.15.36.194:36209): tablet fa8d4b10435c40eb8f60144428fdefce (table test-table [id=48a86fc249f44a95af2ab695842156d4]) successfully deleted
I20260811 08:04:25.515583 27510 raft_consensus.cc:2229] T fa8d4b10435c40eb8f60144428fdefce P bd9b357030ef4a5fa289f349ef059821 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:04:25.515730 27510 raft_consensus.cc:2258] T fa8d4b10435c40eb8f60144428fdefce P bd9b357030ef4a5fa289f349ef059821 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:04:25.516223 27510 ts_tablet_manager.cc:1905] T fa8d4b10435c40eb8f60144428fdefce P bd9b357030ef4a5fa289f349ef059821: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 08:04:25.517736 26922 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.36.193:38685 (error 108)
I20260811 08:04:25.518460 27510 ts_tablet_manager.cc:1918] T fa8d4b10435c40eb8f60144428fdefce P bd9b357030ef4a5fa289f349ef059821: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:04:25.518554 27510 log.cc:1196] T fa8d4b10435c40eb8f60144428fdefce P bd9b357030ef4a5fa289f349ef059821: Deleting WAL directory at /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786435400844580-15507-0/minicluster-data/ts-2/wal/wals/fa8d4b10435c40eb8f60144428fdefce
I20260811 08:04:25.518556 27472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:04:25.518280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.193:38685 (local address 127.0.0.1:38864)
0811 08:04:25.518433 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 08:04:25.518492 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.193:38685: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120}
W20260811 08:04:25.518712 26922 catalog_manager.cc:4584] TS ebe8bfbbdaef47afb9f449112818a209 (127.15.36.193:38685): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet fa8d4b10435c40eb8f60144428fdefce: Network error: Client connection negotiation failed: client connection to 127.15.36.193:38685: connect: Connection refused (error 111)
I20260811 08:04:25.518868 27510 ts_tablet_manager.cc:1939] T fa8d4b10435c40eb8f60144428fdefce P bd9b357030ef4a5fa289f349ef059821: Deleting consensus metadata
I20260811 08:04:25.518940 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 27167
I20260811 08:04:25.522241 26925 catalog_manager.cc:4841] TS bd9b357030ef4a5fa289f349ef059821 (127.15.36.195:45879): tablet fa8d4b10435c40eb8f60144428fdefce (table test-table [id=48a86fc249f44a95af2ab695842156d4]) successfully deleted
I20260811 08:04:25.526728 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 27318
I20260811 08:04:25.535818 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 26900
2026-08-11T08:04:25Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2821 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:04:25 dist-test-slave-2w3w krb5kdc[27514](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:04:25 dist-test-slave-2w3w krb5kdc[27514](info): set up 2 sockets
Aug 11 08:04:25 dist-test-slave-2w3w krb5kdc[27514](info): commencing operation
krb5kdc: starting...
W20260811 08:04:26.830634 15507 mini_kdc.cc:121] Time spent starting KDC: real 1.268s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Aug 11 08:04:26 dist-test-slave-2w3w krb5kdc[27514](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435466, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:04:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:04:26Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.15.36.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.15.36.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.15.36.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/krb5kdc/rangeradmin_127.15.36.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.15.36.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/krb5kdc/rangeradmin_127.15.36.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.15.36.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.15.36.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.15.36.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/krb5kdc/rangerlookup_127.15.36.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.15.36.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/krb5kdc/rangerlookup_127.15.36.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.15.36.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.15.36.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.15.36.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/krb5kdc/HTTP_127.15.36.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.15.36.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/krb5kdc/HTTP_127.15.36.212@KRBTEST.COM.keytab.
I20260811 08:04:27.121819 15507 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskP5pk_f/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/postgres -l logfile start
2026-08-11 08:04:31.913 UTC [27549] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-11 08:04:31.913 UTC [27549] LOG: listening on IPv4 address "127.15.36.212", port 42905
2026-08-11 08:04:31.919 UTC [27549] LOG: listening on Unix socket "/tmp/.s.PGSQL.42905"
2026-08-11 08:04:31.950 UTC [27553] LOG: database system was shut down at 2026-08-11 08:04:28 UTC
2026-08-11 08:04:31.957 UTC [27549] LOG: database system is ready to accept connections
I20260811 08:04:33.067314 15507 mini_postgres.cc:96] Postgres bound to 42905
2026-08-11 08:04:33.075 UTC [27561] FATAL: database "slave" does not exist
127.15.36.212:42905 - accepting connections
I20260811 08:04:33.076579 15507 mini_ranger.cc:161] Starting Ranger...
I20260811 08:04:33.097316 15507 mini_ranger.cc:84] Created miniranger Postgres user
I20260811 08:04:34.184481 15507 mini_ranger.cc:87] Created ranger Postgres database
I20260811 08:04:34.184609 15507 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/ranger-admin
2026-08-11 08:04:34,580 [I] DB FLAVOR :POSTGRES
2026-08-11 08:04:34,580 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 08:04:34,580 [I] Checking connection..
2026-08-11 08:04:34,580 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP5pk_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskP5pk_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.36.212:42905/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-11 08:04:34,914 [I] Checking connection passed.
2026-08-11 08:04:34,914 [I] --------- Verifying version history table ---------
2026-08-11 08:04:34,914 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP5pk_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskP5pk_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.36.212:42905/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 08:04:35,299 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 08:04:35,300 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP5pk_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskP5pk_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.36.212:42905/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 08:04:35,644 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 08:04:35,644 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-11 08:04:35,644 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP5pk_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskP5pk_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.36.212:42905/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskP5pk_f/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-11 08:04:36.061 UTC [27634] WARNING: there is no transaction in progress
2026-08-11 08:04:36,073 [I] create_dbversion_catalog.sql file imported successfully
2026-08-11 08:04:36,073 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP5pk_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskP5pk_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.36.212:42905/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 08:04:36,440 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-11 08:04:36,441 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 08:04:36,441 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP5pk_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskP5pk_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.36.212:42905/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-11 08:04:36,787 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP5pk_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskP5pk_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.36.212:42905/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-11 08:04:37,179 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP5pk_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskP5pk_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.36.212:42905/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-2w3w.c.gcp-upstream.internal','N') ;"
2026-08-11 08:04:37,510 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP5pk_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskP5pk_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.36.212:42905/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 08:04:37,839 [I] Table x_portal_user does not exist in database ranger
2026-08-11 08:04:37,839 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP5pk_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskP5pk_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.36.212:42905/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 08:04:38,176 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-11 08:04:38,177 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP5pk_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskP5pk_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.36.212:42905/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 08:04:38,522 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP5pk_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskP5pk_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.36.212:42905/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 08:04:38,859 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-11 08:04:38,859 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP5pk_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskP5pk_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.36.212:42905/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskP5pk_f/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-11 08:04:40.559 UTC [27756] WARNING: there is no transaction in progress
2026-08-11 08:04:40.591 UTC [27756] WARNING: there is no transaction in progress
2026-08-11 08:04:40.620 UTC [27756] WARNING: there is no transaction in progress
2026-08-11 08:04:40.649 UTC [27756] WARNING: there is no transaction in progress
2026-08-11 08:04:40.682 UTC [27756] WARNING: there is no transaction in progress
2026-08-11 08:04:40.721 UTC [27756] WARNING: there is no transaction in progress
2026-08-11 08:04:40.823 UTC [27756] WARNING: there is no transaction in progress
2026-08-11 08:04:40.835 UTC [27756] WARNING: there is no transaction in progress
2026-08-11 08:04:40.860 UTC [27756] WARNING: there is no transaction in progress
2026-08-11 08:04:40.879 UTC [27756] WARNING: there is no transaction in progress
2026-08-11 08:04:40.899 UTC [27756] WARNING: there is no transaction in progress
2026-08-11 08:04:40.930 UTC [27756] WARNING: there is no transaction in progress
2026-08-11 08:04:40.949 UTC [27756] WARNING: there is no transaction in progress
2026-08-11 08:04:40.966 UTC [27756] WARNING: there is no transaction in progress
2026-08-11 08:04:40.981 UTC [27756] WARNING: there is no transaction in progress
2026-08-11 08:04:40.997 UTC [27756] WARNING: there is no transaction in progress
2026-08-11 08:04:42,500 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-11 08:04:42,501 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP5pk_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskP5pk_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.36.212:42905/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-11 08:04:42,874 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-11 08:04:42,874 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP5pk_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskP5pk_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.36.212:42905/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 08:04:43,241 [I] Table x_portal_user already exists in database 'ranger'
2026-08-11 08:04:43,241 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP5pk_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskP5pk_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.36.212:42905/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 08:04:43,622 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-11 08:04:43,623 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP5pk_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskP5pk_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.36.212:42905/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 08:04:44,007 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP5pk_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskP5pk_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.36.212:42905/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 08:04:44,291 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP5pk_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskP5pk_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.36.212:42905/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-2w3w.c.gcp-upstream.internal';"
2026-08-11 08:04:44,610 [I] CORE_DB_SCHEMA import status has been updated
2026-08-11 08:04:44,610 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP5pk_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskP5pk_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.36.212:42905/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-11 08:04:44,921 [I] DB_PATCHES have already been applied
I20260811 08:04:44.928339 15507 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/ranger-admin:/tmp/dist-test-taskP5pk_f/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskP5pk_f/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskP5pk_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskP5pk_f/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260811 08:04:44.928486 15507 mini_ranger.cc:193] Using host: 127.15.36.212
I20260811 08:04:44.932638 15507 mini_ranger.cc:227] Ranger admin URL: http://127.15.36.212:40715
Aug 11, 2026 8:04:45 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 8:04:45 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 8:04:45 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/ranger-admin/ews/webapp
Aug 11, 2026 8:04:45 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 11, 2026 8:04:45 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 11, 2026 8:04:46 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/ranger-admin/ews/webapp].
Aug 11, 2026 8:04:46 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260811 08:04:46.288913 15507 mini_ranger.cc:160] Time spent starting Ranger: real 13.212s user 0.005s sys 0.009s
Aug 11, 2026 8:05:15 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 11, 2026 8:05:15 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 11, 2026 8:05:15 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 11, 2026 8:05:15 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 11, 2026 8:05:15 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 11, 2026 8:05:15 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 11, 2026 8:05:15 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 11, 2026 8:05:15 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 11, 2026 8:05:15 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 11, 2026 8:05:15 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 11, 2026 8:05:15 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 11, 2026 8:05:15 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 11, 2026 8:05:15 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 11, 2026 8:05:15 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 11, 2026 8:05:15 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 11, 2026 8:05:15 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 11, 2026 8:05:15 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 11, 2026 8:05:16 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260811 08:05:17.663206 15507 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.15.36.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.15.36.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.15.36.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/krb5kdc/rangerkms_127.15.36.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.15.36.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/krb5kdc/rangerkms_127.15.36.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.15.36.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.15.36.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.15.36.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/krb5kdc/HTTP_127.15.36.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.15.36.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/krb5kdc/HTTP_127.15.36.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 11 08:05:17 dist-test-slave-2w3w krb5kdc[27514](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435517, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260811 08:05:17.784597 15507 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260811 08:05:17.799971 15507 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260811 08:05:19.048383 15507 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260811 08:05:19.048478 15507 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/ranger-kms
I20260811 08:05:19.048503 15507 mini_ranger_kms.cc:227] Using postgres at 127.15.36.212:42905
2026-08-11 08:05:19,342 [I] DB FLAVOR :POSTGRES
2026-08-11 08:05:19,343 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 08:05:19,343 [I] Checking connection
2026-08-11 08:05:19,343 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP5pk_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.36.212:42905/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-11 08:05:19,685 [I] connection success
2026-08-11 08:05:19,685 [I] --------- Verifying Ranger DB tables ---------
2026-08-11 08:05:19,686 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-11 08:05:19,686 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP5pk_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.36.212:42905/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-11 08:05:20,001 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-11 08:05:20,002 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 08:05:20,002 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-11 08:05:20,002 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP5pk_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.36.212:42905/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-11 08:05:20,337 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260811 08:05:20.980839 15507 mini_ranger_kms.cc:310] Created kms service
I20260811 08:05:21.239295 15507 mini_ranger_kms.cc:326] Created kudu user
I20260811 08:05:21.301779 15507 mini_ranger_kms.cc:343] Created rangerkms user
Aug 11 08:05:21 dist-test-slave-2w3w krb5kdc[27514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435517, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.15.36.212@KRBTEST.COM
I20260811 08:05:21.845144 15507 mini_ranger_kms.cc:384] Added ranger policy
I20260811 08:05:21.845554 15507 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/ranger-kms:/tmp/dist-test-taskP5pk_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskP5pk_f/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskP5pk_f/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260811 08:05:21.845603 15507 mini_ranger_kms.cc:240] Using host: 127.15.36.212
I20260811 08:05:21.852169 15507 mini_ranger_kms.cc:276] Ranger KMS PID: 27965
I20260811 08:05:21.852348 15507 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.15.36.212:51857
Aug 11, 2026 8:05:23 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 8:05:23 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 8:05:23 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 11, 2026 8:05:23 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 11, 2026 8:05:23 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/ranger-kms/ews/webapp].
Aug 11, 2026 8:05:23 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 11 08:05:24 dist-test-slave-2w3w krb5kdc[27514](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786435524, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.15.36.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:05:24.456188 15507 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.672s user 0.000s sys 0.267s
I20260811 08:05:24.456365 15507 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260811 08:05:24.456497 15507 mini_ranger_kms.cc:401] 127.15.36.212:51857/kms/v1/keys
Aug 11 08:05:24 dist-test-slave-2w3w krb5kdc[27514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435524, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.15.36.212@KRBTEST.COM for HTTP/127.15.36.212@KRBTEST.COM
Aug 11 08:05:25 dist-test-slave-2w3w krb5kdc[27514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435524, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.15.36.212@KRBTEST.COM for HTTP/127.15.36.212@KRBTEST.COM
Aug 11 08:05:27 dist-test-slave-2w3w krb5kdc[27514](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435527, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.15.36.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab.
Entry for principal kudu/127.15.36.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab.
I20260811 08:05:28.023913 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:39935
--webserver_interface=127.15.36.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=kudu/127.15.36.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:37709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.36.254:39935
--ranger_config_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.36.212:51857/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:05:28.115701 28023 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:05:28.116048 28023 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:05:28.116096 28023 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:05:28.117803 28023 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:05:28.117926 28023 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:05:28.117959 28023 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:05:28.117993 28023 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:05:28.118019 28023 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:05:28.120453 28023 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:37709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/master-0/wal
--ranger_kms_url=127.15.36.212:51857/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.15.36.254:39935
--ranger_config_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=kudu/127.15.36.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:39935
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.36.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28023
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:05:28.120795 28023 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:05:28.121068 28023 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:05:28.126631 28033 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:05:28.126709 28030 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:05:28.127008 28029 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:05:28.126936 28023 server_base.cc:1034] running on GCE node
I20260811 08:05:28.127324 28023 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:05:28.127718 28023 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:05:28.128988 28023 hybrid_clock.cc:648] HybridClock initialized: now 1786435528128943 us; error 47 us; skew 500 ppm
Aug 11 08:05:28 dist-test-slave-2w3w krb5kdc[27514](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435528, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:05:28.137036 28023 init.cc:377] Logged in from keytab as kudu/127.15.36.254@KRBTEST.COM (short username kudu)
I20260811 08:05:28.137606 28023 webserver.cc:460] Webserver started at http://127.15.36.254:36783/ using document root <none> and password file <none>
I20260811 08:05:28.138177 28023 fs_manager.cc:359] Metadata directory not provided
I20260811 08:05:28.138314 28023 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:05:28.138514 28023 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 08:05:28 dist-test-slave-2w3w krb5kdc[27514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435528, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.254@KRBTEST.COM for HTTP/127.15.36.212@KRBTEST.COM
I20260811 08:05:28.193254 28023 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/master-0/data/instance:
uuid: "23bf2cbff1364d43a3ee4d442263d5fc"
format_stamp: "Formatted at 2026-08-11 08:05:28 on dist-test-slave-2w3w"
server_key: "6d17cad2caf799eb4f39528ac025f250"
server_key_iv: "c24fde0d456f4ab718921fa10c548bb9"
server_key_version: "kuduclusterkey@0"
I20260811 08:05:28.193751 28023 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/master-0/wal/instance:
uuid: "23bf2cbff1364d43a3ee4d442263d5fc"
format_stamp: "Formatted at 2026-08-11 08:05:28 on dist-test-slave-2w3w"
server_key: "6d17cad2caf799eb4f39528ac025f250"
server_key_iv: "c24fde0d456f4ab718921fa10c548bb9"
server_key_version: "kuduclusterkey@0"
I20260811 08:05:28.195465 28023 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 08:05:28.209087 28040 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:05:28.209322 28023 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:05:28.209427 28023 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/master-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/master-0/wal
uuid: "23bf2cbff1364d43a3ee4d442263d5fc"
format_stamp: "Formatted at 2026-08-11 08:05:28 on dist-test-slave-2w3w"
server_key: "6d17cad2caf799eb4f39528ac025f250"
server_key_iv: "c24fde0d456f4ab718921fa10c548bb9"
server_key_version: "kuduclusterkey@0"
I20260811 08:05:28.209556 28023 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:05:28.226255 28023 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:05:28.228713 28023 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:05:28.228926 28023 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:05:28.234665 28023 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.254:39935
I20260811 08:05:28.234689 28098 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.254:39935 every 8 connection(s)
I20260811 08:05:28.235246 28023 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
I20260811 08:05:28.236112 28099 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:05:28.239459 28099 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23bf2cbff1364d43a3ee4d442263d5fc: Bootstrap starting.
I20260811 08:05:28.240212 28099 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 23bf2cbff1364d43a3ee4d442263d5fc: Neither blocks nor log segments found. Creating new log.
I20260811 08:05:28.240561 28099 log.cc:824] T 00000000000000000000000000000000 P 23bf2cbff1364d43a3ee4d442263d5fc: Log is configured to *not* fsync() on all Append() calls
I20260811 08:05:28.241655 28099 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23bf2cbff1364d43a3ee4d442263d5fc: No bootstrap required, opened a new log
I20260811 08:05:28.242199 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 28023
I20260811 08:05:28.242345 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/master-0/wal/instance
I20260811 08:05:28.242545 15507 external_mini_cluster.cc:1428] Setting key 473de0f8e0ddb3c1651378a0ea0fd87a
I20260811 08:05:28.244766 28099 raft_consensus.cc:348] T 00000000000000000000000000000000 P 23bf2cbff1364d43a3ee4d442263d5fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23bf2cbff1364d43a3ee4d442263d5fc" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 39935 } }
I20260811 08:05:28.245086 28099 raft_consensus.cc:374] T 00000000000000000000000000000000 P 23bf2cbff1364d43a3ee4d442263d5fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:05:28.245148 28099 raft_consensus.cc:729] T 00000000000000000000000000000000 P 23bf2cbff1364d43a3ee4d442263d5fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23bf2cbff1364d43a3ee4d442263d5fc, State: Initialized, Role: FOLLOWER
I20260811 08:05:28.245332 28099 consensus_queue.cc:260] T 00000000000000000000000000000000 P 23bf2cbff1364d43a3ee4d442263d5fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23bf2cbff1364d43a3ee4d442263d5fc" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 39935 } }
I20260811 08:05:28.245419 28099 raft_consensus.cc:388] T 00000000000000000000000000000000 P 23bf2cbff1364d43a3ee4d442263d5fc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:05:28.245450 28099 raft_consensus.cc:482] T 00000000000000000000000000000000 P 23bf2cbff1364d43a3ee4d442263d5fc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:05:28.245517 28099 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 23bf2cbff1364d43a3ee4d442263d5fc [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:05:28.246373 28099 raft_consensus.cc:504] T 00000000000000000000000000000000 P 23bf2cbff1364d43a3ee4d442263d5fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23bf2cbff1364d43a3ee4d442263d5fc" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 39935 } }
I20260811 08:05:28.246495 28099 leader_election.cc:302] T 00000000000000000000000000000000 P 23bf2cbff1364d43a3ee4d442263d5fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 23bf2cbff1364d43a3ee4d442263d5fc; no voters:
I20260811 08:05:28.246722 28099 leader_election.cc:288] T 00000000000000000000000000000000 P 23bf2cbff1364d43a3ee4d442263d5fc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:05:28.246783 28105 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 23bf2cbff1364d43a3ee4d442263d5fc [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:05:28.247076 28105 raft_consensus.cc:686] T 00000000000000000000000000000000 P 23bf2cbff1364d43a3ee4d442263d5fc [term 1 LEADER]: Becoming Leader. State: Replica: 23bf2cbff1364d43a3ee4d442263d5fc, State: Running, Role: LEADER
I20260811 08:05:28.247140 28099 sys_catalog.cc:564] T 00000000000000000000000000000000 P 23bf2cbff1364d43a3ee4d442263d5fc [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:05:28.247219 28105 consensus_queue.cc:237] T 00000000000000000000000000000000 P 23bf2cbff1364d43a3ee4d442263d5fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23bf2cbff1364d43a3ee4d442263d5fc" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 39935 } }
I20260811 08:05:28.247632 28105 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23bf2cbff1364d43a3ee4d442263d5fc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "23bf2cbff1364d43a3ee4d442263d5fc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23bf2cbff1364d43a3ee4d442263d5fc" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 39935 } } }
I20260811 08:05:28.247782 28105 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23bf2cbff1364d43a3ee4d442263d5fc [sys.catalog]: This master's current role is: LEADER
I20260811 08:05:28.247991 28105 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23bf2cbff1364d43a3ee4d442263d5fc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 23bf2cbff1364d43a3ee4d442263d5fc. Latest consensus state: current_term: 1 leader_uuid: "23bf2cbff1364d43a3ee4d442263d5fc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23bf2cbff1364d43a3ee4d442263d5fc" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 39935 } } }
I20260811 08:05:28.248100 28105 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23bf2cbff1364d43a3ee4d442263d5fc [sys.catalog]: This master's current role is: LEADER
I20260811 08:05:28.248257 28115 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:05:28.248847 28115 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:05:28.249487 28099 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 08:05:28.250859 28122 mvcc.cc:205] Tried to move back new op lower bound from 7317239923712147456 to 7317239923701129216. Current Snapshot: MvccSnapshot[applied={T|T < 7317239923712147456}]
I20260811 08:05:28.251464 28115 catalog_manager.cc:1347] Generated new cluster ID: ea3ac33658964a01bf316ad7171dab4c
I20260811 08:05:28.251510 28115 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 08:05:28 dist-test-slave-2w3w krb5kdc[27514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435527, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:05:28.260571 28104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:05:28.243189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35792 (local address 127.15.36.254:39935)
0811 08:05:28.243412 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0811 08:05:28.243424 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 08:05:28.243579 (+ 155us) server_negotiation.cc:407] Connection header received
0811 08:05:28.244731 (+ 1152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:05:28.244740 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:05:28.244803 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:05:28.245209 (+ 406us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:05:28.246109 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:05:28.247496 (+ 1387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:05:28.248657 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:05:28.249241 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:05:28.252446 (+ 3205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:05:28.252564 (+ 118us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:05:28.252567 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:05:28.252567 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:05:28.252576 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:05:28.254527 (+ 1951us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:05:28.255008 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:05:28.255012 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:05:28.255012 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:05:28.255137 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:05:28.256799 (+ 1662us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:05:28.256833 (+ 34us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:05:28.256834 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:05:28.258398 (+ 1564us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:05:28.259424 (+ 1026us) server_negotiation.cc:1035] Waiting for connection context
0811 08:05:28.259525 (+ 101us) server_negotiation.cc:299] Negotiation successful
0811 08:05:28.260201 (+ 676us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":122,"threads_started":1}
I20260811 08:05:28.270503 28115 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:05:28.271407 28115 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:05:28.284088 28115 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 23bf2cbff1364d43a3ee4d442263d5fc: Generated new TSK 0
I20260811 08:05:28.284408 28115 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.36.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab.
Entry for principal kudu/127.15.36.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab.
I20260811 08:05:29.187996 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.36.212:51857/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.193:0
--local_ip_for_outbound_sockets=127.15.36.193
--webserver_interface=127.15.36.193
--webserver_port=0
--tserver_master_addrs=127.15.36.254:39935
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab
--principal=kudu/127.15.36.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:37709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:05:29.306360 28148 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:05:29.306613 28148 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:05:29.306641 28148 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:05:29.308348 28148 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:05:29.308445 28148 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:05:29.308498 28148 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.193
I20260811 08:05:29.310741 28148 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:37709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.15.36.212:51857/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab
--principal=kudu/127.15.36.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.36.193
--webserver_port=0
--tserver_master_addrs=127.15.36.254:39935
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28148
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.193
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:05:29.311177 28148 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:05:29.311452 28148 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:05:29.319314 28153 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:05:29.319250 28154 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:05:29.319692 28148 server_base.cc:1034] running on GCE node
W20260811 08:05:29.319842 28156 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:05:29.320094 28148 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:05:29.320418 28148 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:05:29.321626 28148 hybrid_clock.cc:648] HybridClock initialized: now 1786435529321602 us; error 40 us; skew 500 ppm
Aug 11 08:05:29 dist-test-slave-2w3w krb5kdc[27514](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435529, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:05:29.324963 28148 init.cc:377] Logged in from keytab as kudu/127.15.36.193@KRBTEST.COM (short username kudu)
I20260811 08:05:29.325688 28148 webserver.cc:460] Webserver started at http://127.15.36.193:35117/ using document root <none> and password file <none>
I20260811 08:05:29.325992 28148 fs_manager.cc:359] Metadata directory not provided
I20260811 08:05:29.326076 28148 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:05:29.326254 28148 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 08:05:29 dist-test-slave-2w3w krb5kdc[27514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435529, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.193@KRBTEST.COM for HTTP/127.15.36.212@KRBTEST.COM
I20260811 08:05:29.341964 28148 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/ts-0/data/instance:
uuid: "66b4a51336394a46a4623b8b7348435d"
format_stamp: "Formatted at 2026-08-11 08:05:29 on dist-test-slave-2w3w"
server_key: "59c95d8fbca269bf46c36baa3091cd94"
server_key_iv: "e1d451a703c20d205e9f44825554cc3e"
server_key_version: "kuduclusterkey@0"
I20260811 08:05:29.342481 28148 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/ts-0/wal/instance:
uuid: "66b4a51336394a46a4623b8b7348435d"
format_stamp: "Formatted at 2026-08-11 08:05:29 on dist-test-slave-2w3w"
server_key: "59c95d8fbca269bf46c36baa3091cd94"
server_key_iv: "e1d451a703c20d205e9f44825554cc3e"
server_key_version: "kuduclusterkey@0"
I20260811 08:05:29.344753 28148 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260811 08:05:29.360518 28166 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:05:29.360790 28148 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:05:29.360891 28148 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/ts-0/wal
uuid: "66b4a51336394a46a4623b8b7348435d"
format_stamp: "Formatted at 2026-08-11 08:05:29 on dist-test-slave-2w3w"
server_key: "59c95d8fbca269bf46c36baa3091cd94"
server_key_iv: "e1d451a703c20d205e9f44825554cc3e"
server_key_version: "kuduclusterkey@0"
I20260811 08:05:29.360996 28148 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:05:29.383162 28148 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:05:29.385877 28148 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:05:29.386121 28148 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:05:29.386475 28148 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:05:29.386937 28148 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:05:29.387059 28148 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:05:29.387166 28148 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:05:29.387239 28148 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:05:29.395030 28148 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.193:39671
I20260811 08:05:29.395578 28148 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
I20260811 08:05:29.400220 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 28148
I20260811 08:05:29.400343 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/ts-0/wal/instance
I20260811 08:05:29.400535 15507 external_mini_cluster.cc:1428] Setting key 73e377a5968843956ce941801abbe7be
Aug 11 08:05:29 dist-test-slave-2w3w krb5kdc[27514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435529, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.193@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:05:29.411150 28294 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.193:39671 every 8 connection(s)
I20260811 08:05:29.411468 28298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:05:29.396392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:39935 (local address 127.15.36.193:50759)
0811 08:05:29.399666 (+ 3274us) negotiation.cc:107] Waiting for socket to connect
0811 08:05:29.399734 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0811 08:05:29.400558 (+ 824us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:05:29.400971 (+ 413us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:05:29.400977 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:05:29.401261 (+ 284us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:05:29.401564 (+ 303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:05:29.401570 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:05:29.402601 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:05:29.402602 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:05:29.404062 (+ 1460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:05:29.404066 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:05:29.404642 (+ 576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:05:29.404644 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:05:29.404816 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:05:29.405485 (+ 669us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:05:29.405497 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:05:29.407417 (+ 1920us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:05:29.409637 (+ 2220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:05:29.409647 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:05:29.409650 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:05:29.410007 (+ 357us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:05:29.410252 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:05:29.410252 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:05:29.410253 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:05:29.410399 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:05:29.410706 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:05:29.410713 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:05:29.410904 (+ 191us) client_negotiation.cc:769] Sending connection context
0811 08:05:29.411038 (+ 134us) client_negotiation.cc:240] Negotiation successful
0811 08:05:29.411225 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3214,"thread_start_us":574,"threads_started":1}
I20260811 08:05:29.411933 28297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:05:29.396445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:50759 (local address 127.15.36.254:39935)
0811 08:05:29.399560 (+ 3115us) server_negotiation.cc:206] Beginning negotiation
0811 08:05:29.399563 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:05:29.399871 (+ 308us) server_negotiation.cc:407] Connection header received
0811 08:05:29.400779 (+ 908us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:05:29.400780 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:05:29.400798 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:05:29.400868 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:05:29.401691 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:05:29.402479 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:05:29.404182 (+ 1703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:05:29.404498 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:05:29.404563 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:05:29.407556 (+ 2993us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:05:29.407558 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:05:29.407558 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:05:29.407567 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:05:29.409520 (+ 1953us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:05:29.410104 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:05:29.410105 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:05:29.410106 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:05:29.410178 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:05:29.410469 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:05:29.410470 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:05:29.410470 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:05:29.410618 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:05:29.410679 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 08:05:29.411726 (+ 1047us) server_negotiation.cc:299] Negotiation successful
0811 08:05:29.411833 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3082,"thread_start_us":60,"threads_started":1}
I20260811 08:05:29.412427 28295 heartbeater.cc:347] Connected to a master server at 127.15.36.254:39935
I20260811 08:05:29.412561 28295 heartbeater.cc:464] Registering TS with master...
I20260811 08:05:29.412781 28295 heartbeater.cc:511] Master 127.15.36.254:39935 requested a full tablet report, sending...
I20260811 08:05:29.413378 28058 ts_manager.cc:194] Registered new tserver with Master: 66b4a51336394a46a4623b8b7348435d (127.15.36.193:39671)
I20260811 08:05:29.414286 28058 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.36.193@KRBTEST.COM'} at 127.15.36.193:50759
WARNING: no policy specified for kudu/127.15.36.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab.
Entry for principal kudu/127.15.36.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab.
I20260811 08:05:29.455453 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.36.212:51857/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.194:0
--local_ip_for_outbound_sockets=127.15.36.194
--webserver_interface=127.15.36.194
--webserver_port=0
--tserver_master_addrs=127.15.36.254:39935
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab
--principal=kudu/127.15.36.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:37709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:05:29.571744 28301 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:05:29.572070 28301 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:05:29.572114 28301 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:05:29.574121 28301 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:05:29.574247 28301 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:05:29.574318 28301 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.194
I20260811 08:05:29.577760 28301 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:37709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.15.36.212:51857/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab
--principal=kudu/127.15.36.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.36.194
--webserver_port=0
--tserver_master_addrs=127.15.36.254:39935
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28301
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.194
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:05:29.578083 28301 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
Aug 11 08:05:29 dist-test-slave-2w3w krb5kdc[27514](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786435529, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:05:29.578466 28301 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:05:29.585512 28309 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:05:29.585760 28301 server_base.cc:1034] running on GCE node
W20260811 08:05:29.585940 28308 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:05:29.585511 28312 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:05:29.586473 28301 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:05:29.586812 28301 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:05:29.588003 28301 hybrid_clock.cc:648] HybridClock initialized: now 1786435529587991 us; error 48 us; skew 500 ppm
Aug 11 08:05:29 dist-test-slave-2w3w krb5kdc[27514](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435529, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:05:29.591732 28301 init.cc:377] Logged in from keytab as kudu/127.15.36.194@KRBTEST.COM (short username kudu)
I20260811 08:05:29.592398 28301 webserver.cc:460] Webserver started at http://127.15.36.194:40867/ using document root <none> and password file <none>
I20260811 08:05:29.593102 28301 fs_manager.cc:359] Metadata directory not provided
I20260811 08:05:29.593250 28301 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:05:29.593444 28301 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 08:05:29 dist-test-slave-2w3w krb5kdc[27514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435529, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.194@KRBTEST.COM for HTTP/127.15.36.212@KRBTEST.COM
I20260811 08:05:29.614459 28301 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/ts-1/data/instance:
uuid: "b0fa438872ec4e3b98566973e8edc5c4"
format_stamp: "Formatted at 2026-08-11 08:05:29 on dist-test-slave-2w3w"
server_key: "5ff48258c8d4c4984ecd43bda5ea322f"
server_key_iv: "90197f302d0eba2b164ae27e5f44720c"
server_key_version: "kuduclusterkey@0"
I20260811 08:05:29.615029 28301 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/ts-1/wal/instance:
uuid: "b0fa438872ec4e3b98566973e8edc5c4"
format_stamp: "Formatted at 2026-08-11 08:05:29 on dist-test-slave-2w3w"
server_key: "5ff48258c8d4c4984ecd43bda5ea322f"
server_key_iv: "90197f302d0eba2b164ae27e5f44720c"
server_key_version: "kuduclusterkey@0"
I20260811 08:05:29.617235 28301 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260811 08:05:29.632668 28320 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:05:29.632992 28301 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:05:29.633111 28301 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/ts-1/wal
uuid: "b0fa438872ec4e3b98566973e8edc5c4"
format_stamp: "Formatted at 2026-08-11 08:05:29 on dist-test-slave-2w3w"
server_key: "5ff48258c8d4c4984ecd43bda5ea322f"
server_key_iv: "90197f302d0eba2b164ae27e5f44720c"
server_key_version: "kuduclusterkey@0"
I20260811 08:05:29.633220 28301 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:05:29.658860 28301 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:05:29.661819 28301 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:05:29.662151 28301 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:05:29.662514 28301 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:05:29.663051 28301 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:05:29.663192 28301 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:05:29.663278 28301 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:05:29.663354 28301 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:05:29.674312 28301 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.194:39915
I20260811 08:05:29.675022 28301 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
I20260811 08:05:29.675869 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 28301
I20260811 08:05:29.676007 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/ts-1/wal/instance
I20260811 08:05:29.676229 15507 external_mini_cluster.cc:1428] Setting key 75dea872e2feeeb264e769978fc01805
I20260811 08:05:29.681399 28452 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.194:39915 every 8 connection(s)
Aug 11 08:05:29 dist-test-slave-2w3w krb5kdc[27514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435529, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.194@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:05:29.694213 28297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:05:29.677749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:34429 (local address 127.15.36.254:39935)
0811 08:05:29.677832 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0811 08:05:29.677835 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:05:29.683380 (+ 5545us) server_negotiation.cc:407] Connection header received
0811 08:05:29.684136 (+ 756us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:05:29.684137 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:05:29.684156 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:05:29.684218 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:05:29.685171 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:05:29.685836 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:05:29.686903 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:05:29.687220 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:05:29.687297 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:05:29.690321 (+ 3024us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:05:29.690323 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:05:29.690323 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:05:29.690333 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:05:29.692254 (+ 1921us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:05:29.692882 (+ 628us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:05:29.692883 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:05:29.692884 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:05:29.692963 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:05:29.693294 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:05:29.693295 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:05:29.693295 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:05:29.693451 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:05:29.693504 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 08:05:29.693996 (+ 492us) server_negotiation.cc:299] Negotiation successful
0811 08:05:29.694110 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 08:05:29.695182 28455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:05:29.677772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:39935 (local address 127.15.36.194:34429)
0811 08:05:29.683175 (+ 5403us) negotiation.cc:107] Waiting for socket to connect
0811 08:05:29.683249 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0811 08:05:29.684006 (+ 757us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:05:29.684368 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:05:29.684374 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:05:29.684701 (+ 327us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:05:29.685035 (+ 334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:05:29.685042 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:05:29.685947 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:05:29.685948 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:05:29.686767 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:05:29.686770 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:05:29.687377 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:05:29.687378 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:05:29.687533 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:05:29.688251 (+ 718us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:05:29.688262 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:05:29.690165 (+ 1903us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:05:29.692386 (+ 2221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:05:29.692398 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:05:29.692402 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:05:29.692773 (+ 371us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:05:29.693049 (+ 276us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:05:29.693049 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:05:29.693050 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:05:29.693205 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:05:29.693559 (+ 354us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:05:29.693565 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:05:29.693753 (+ 188us) client_negotiation.cc:769] Sending connection context
0811 08:05:29.694633 (+ 880us) client_negotiation.cc:240] Negotiation successful
0811 08:05:29.694864 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5331,"thread_start_us":141,"threads_started":1}
I20260811 08:05:29.696074 28453 heartbeater.cc:347] Connected to a master server at 127.15.36.254:39935
I20260811 08:05:29.696182 28453 heartbeater.cc:464] Registering TS with master...
I20260811 08:05:29.696394 28453 heartbeater.cc:511] Master 127.15.36.254:39935 requested a full tablet report, sending...
I20260811 08:05:29.696907 28058 ts_manager.cc:194] Registered new tserver with Master: b0fa438872ec4e3b98566973e8edc5c4 (127.15.36.194:39915)
I20260811 08:05:29.697412 28058 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.36.194@KRBTEST.COM'} at 127.15.36.194:34429
WARNING: no policy specified for kudu/127.15.36.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab.
Entry for principal kudu/127.15.36.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab.
I20260811 08:05:29.746165 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.36.212:51857/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.195:0
--local_ip_for_outbound_sockets=127.15.36.195
--webserver_interface=127.15.36.195
--webserver_port=0
--tserver_master_addrs=127.15.36.254:39935
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab
--principal=kudu/127.15.36.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:37709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:05:29.880811 28458 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:05:29.881245 28458 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:05:29.881348 28458 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:05:29.883563 28458 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:05:29.883723 28458 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:05:29.883823 28458 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.195
I20260811 08:05:29.886677 28458 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:37709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.15.36.212:51857/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab
--principal=kudu/127.15.36.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.36.195
--webserver_port=0
--tserver_master_addrs=127.15.36.254:39935
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28458
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.195
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:05:29.887455 28458 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:05:29.887847 28458 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:05:29.895561 28464 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:05:29.896031 28466 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:05:29.896179 28463 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:05:29.896697 28458 server_base.cc:1034] running on GCE node
I20260811 08:05:29.897156 28458 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:05:29.897488 28458 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:05:29.898679 28458 hybrid_clock.cc:648] HybridClock initialized: now 1786435529898662 us; error 31 us; skew 500 ppm
Aug 11 08:05:29 dist-test-slave-2w3w krb5kdc[27514](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435529, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:05:29.902098 28458 init.cc:377] Logged in from keytab as kudu/127.15.36.195@KRBTEST.COM (short username kudu)
I20260811 08:05:29.902714 28458 webserver.cc:460] Webserver started at http://127.15.36.195:41409/ using document root <none> and password file <none>
I20260811 08:05:29.903036 28458 fs_manager.cc:359] Metadata directory not provided
I20260811 08:05:29.903121 28458 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:05:29.903278 28458 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 08:05:29 dist-test-slave-2w3w krb5kdc[27514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435529, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.195@KRBTEST.COM for HTTP/127.15.36.212@KRBTEST.COM
I20260811 08:05:29.917408 28458 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/ts-2/data/instance:
uuid: "973105cd6cb54f11a80a928fe1ff16a2"
format_stamp: "Formatted at 2026-08-11 08:05:29 on dist-test-slave-2w3w"
server_key: "8c15716172c1c1e04a6dbd891c49cbc5"
server_key_iv: "1b232e17fd1cec6e525d0a83503bace4"
server_key_version: "kuduclusterkey@0"
I20260811 08:05:29.918111 28458 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/ts-2/wal/instance:
uuid: "973105cd6cb54f11a80a928fe1ff16a2"
format_stamp: "Formatted at 2026-08-11 08:05:29 on dist-test-slave-2w3w"
server_key: "8c15716172c1c1e04a6dbd891c49cbc5"
server_key_iv: "1b232e17fd1cec6e525d0a83503bace4"
server_key_version: "kuduclusterkey@0"
I20260811 08:05:29.920378 28458 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260811 08:05:29.955155 28473 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:05:29.955423 28458 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.001s
I20260811 08:05:29.955540 28458 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/ts-2/wal
uuid: "973105cd6cb54f11a80a928fe1ff16a2"
format_stamp: "Formatted at 2026-08-11 08:05:29 on dist-test-slave-2w3w"
server_key: "8c15716172c1c1e04a6dbd891c49cbc5"
server_key_iv: "1b232e17fd1cec6e525d0a83503bace4"
server_key_version: "kuduclusterkey@0"
I20260811 08:05:29.955667 28458 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:05:29.988512 28458 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:05:29.991283 28458 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:05:29.991482 28458 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:05:29.991727 28458 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:05:29.992161 28458 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:05:29.992218 28458 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:05:29.992259 28458 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:05:29.992286 28458 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:05:30.002367 28458 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.195:37575
I20260811 08:05:30.002925 28458 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
I20260811 08:05:30.003551 28603 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.195:37575 every 8 connection(s)
I20260811 08:05:30.004987 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 28458
I20260811 08:05:30.005095 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/ts-2/wal/instance
I20260811 08:05:30.005293 15507 external_mini_cluster.cc:1428] Setting key a63f5b4b58ebebca604797a33663e1ef
Aug 11 08:05:30 dist-test-slave-2w3w krb5kdc[27514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435529, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.195@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:05:30.021783 28297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:05:30.005469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:55647 (local address 127.15.36.254:39935)
0811 08:05:30.005669 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0811 08:05:30.005672 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:05:30.005679 (+ 7us) server_negotiation.cc:407] Connection header received
0811 08:05:30.005703 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:05:30.005703 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:05:30.005714 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:05:30.005767 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:05:30.010735 (+ 4968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:05:30.011605 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:05:30.013102 (+ 1497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:05:30.013436 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:05:30.013520 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:05:30.017535 (+ 4015us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:05:30.017537 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:05:30.017538 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:05:30.017547 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:05:30.019734 (+ 2187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:05:30.020419 (+ 685us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:05:30.020421 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:05:30.020422 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:05:30.020496 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:05:30.020879 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:05:30.020880 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:05:30.020880 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:05:30.021033 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:05:30.021124 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 08:05:30.021557 (+ 433us) server_negotiation.cc:299] Negotiation successful
0811 08:05:30.021669 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173}
I20260811 08:05:30.022917 28606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:05:30.004471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:39935 (local address 127.15.36.195:55647)
0811 08:05:30.004674 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0811 08:05:30.004720 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 08:05:30.005456 (+ 736us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:05:30.009918 (+ 4462us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:05:30.009923 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:05:30.010225 (+ 302us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:05:30.010563 (+ 338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:05:30.010571 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:05:30.011741 (+ 1170us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:05:30.011741 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:05:30.012979 (+ 1238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:05:30.012983 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:05:30.013640 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:05:30.013641 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:05:30.013772 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:05:30.014848 (+ 1076us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:05:30.014859 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:05:30.017383 (+ 2524us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:05:30.019865 (+ 2482us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:05:30.019880 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:05:30.019883 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:05:30.020282 (+ 399us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:05:30.020584 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:05:30.020584 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:05:30.020585 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:05:30.020745 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:05:30.021129 (+ 384us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:05:30.021138 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:05:30.021352 (+ 214us) client_negotiation.cc:769] Sending connection context
0811 08:05:30.022272 (+ 920us) client_negotiation.cc:240] Negotiation successful
0811 08:05:30.022509 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":118,"threads_started":1}
I20260811 08:05:30.023940 28604 heartbeater.cc:347] Connected to a master server at 127.15.36.254:39935
I20260811 08:05:30.024057 28604 heartbeater.cc:464] Registering TS with master...
I20260811 08:05:30.024274 28604 heartbeater.cc:511] Master 127.15.36.254:39935 requested a full tablet report, sending...
I20260811 08:05:30.024755 28058 ts_manager.cc:194] Registered new tserver with Master: 973105cd6cb54f11a80a928fe1ff16a2 (127.15.36.195:37575)
I20260811 08:05:30.025247 28058 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.36.195@KRBTEST.COM'} at 127.15.36.195:55647
I20260811 08:05:30.028038 15507 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 08:05:30.039465 28297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:05:30.029917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53866 (local address 127.15.36.254:39935)
0811 08:05:30.029964 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 08:05:30.029966 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:05:30.030274 (+ 308us) server_negotiation.cc:407] Connection header received
0811 08:05:30.030381 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:05:30.030382 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:05:30.030406 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:05:30.030440 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:05:30.031541 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:05:30.032348 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:05:30.033416 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:05:30.033724 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:05:30.033775 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:05:30.035587 (+ 1812us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:05:30.035589 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:05:30.035589 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:05:30.035597 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:05:30.037998 (+ 2401us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:05:30.038490 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:05:30.038491 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:05:30.038491 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:05:30.038558 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:05:30.038780 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:05:30.038781 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:05:30.038781 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:05:30.038918 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:05:30.039036 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 08:05:30.039259 (+ 223us) server_negotiation.cc:299] Negotiation successful
0811 08:05:30.039352 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 08:05:30.041963 28058 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53866:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:05:30.044432 28058 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:05:30.066864 28619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:05:30.048695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.195:37575 (local address 127.0.0.1:50856)
0811 08:05:30.050903 (+ 2208us) negotiation.cc:107] Waiting for socket to connect
0811 08:05:30.050914 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:05:30.052021 (+ 1107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:05:30.052405 (+ 384us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:05:30.052406 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:05:30.052408 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:05:30.052466 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:05:30.052467 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:05:30.054405 (+ 1938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:05:30.054406 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:05:30.063526 (+ 9120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:05:30.063531 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:05:30.066499 (+ 2968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:05:30.066500 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:05:30.066608 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:05:30.066627 (+ 19us) client_negotiation.cc:769] Sending connection context
0811 08:05:30.066703 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 08:05:30.066771 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2190,"thread_start_us":81,"threads_started":1}
I20260811 08:05:30.068811 28622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:05:30.049340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50856 (local address 127.15.36.195:37575)
0811 08:05:30.050758 (+ 1418us) server_negotiation.cc:206] Beginning negotiation
0811 08:05:30.050762 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:05:30.051003 (+ 241us) server_negotiation.cc:407] Connection header received
0811 08:05:30.052152 (+ 1149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:05:30.052155 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:05:30.052174 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:05:30.052306 (+ 132us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:05:30.052557 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:05:30.053836 (+ 1279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:05:30.063679 (+ 9843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:05:30.064494 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:05:30.064576 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:05:30.068632 (+ 4056us) server_negotiation.cc:1035] Waiting for connection context
0811 08:05:30.068670 (+ 38us) server_negotiation.cc:299] Negotiation successful
0811 08:05:30.068725 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1366,"thread_start_us":87,"threads_started":1}
I20260811 08:05:30.069224 28621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:05:30.048998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48472 (local address 127.15.36.193:39671)
0811 08:05:30.050456 (+ 1458us) server_negotiation.cc:206] Beginning negotiation
0811 08:05:30.050461 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:05:30.050473 (+ 12us) server_negotiation.cc:407] Connection header received
0811 08:05:30.050509 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:05:30.050511 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:05:30.050530 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:05:30.050608 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:05:30.051228 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:05:30.055902 (+ 4674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:05:30.062137 (+ 6235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:05:30.068060 (+ 5923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:05:30.068135 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:05:30.068199 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 08:05:30.069084 (+ 885us) server_negotiation.cc:299] Negotiation successful
0811 08:05:30.069150 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1420,"thread_start_us":50,"threads_started":1}
I20260811 08:05:30.067922 28618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:05:30.048874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.194:39915 (local address 127.0.0.1:33870)
0811 08:05:30.057325 (+ 8451us) negotiation.cc:107] Waiting for socket to connect
0811 08:05:30.057339 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 08:05:30.057397 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:05:30.057760 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:05:30.057761 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:05:30.057764 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:05:30.057823 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:05:30.057825 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:05:30.059356 (+ 1531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:05:30.059358 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:05:30.065602 (+ 6244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:05:30.065605 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:05:30.067659 (+ 2054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:05:30.067660 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:05:30.067733 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:05:30.067738 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 08:05:30.067792 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 08:05:30.067839 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8425,"thread_start_us":56,"threads_started":1}
I20260811 08:05:30.068496 28620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:05:30.048366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.193:39671 (local address 127.0.0.1:48472)
0811 08:05:30.050115 (+ 1749us) negotiation.cc:107] Waiting for socket to connect
0811 08:05:30.050176 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0811 08:05:30.050260 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:05:30.051049 (+ 789us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:05:30.051053 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:05:30.051055 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:05:30.051135 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:05:30.051137 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:05:30.056043 (+ 4906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:05:30.056045 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:05:30.061976 (+ 5931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:05:30.061981 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:05:30.068238 (+ 6257us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:05:30.068239 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:05:30.068304 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:05:30.068308 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:05:30.068363 (+ 55us) client_negotiation.cc:240] Negotiation successful
0811 08:05:30.068424 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1625,"thread_start_us":155,"threads_started":1}
I20260811 08:05:30.070706 28624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:05:30.049525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33870 (local address 127.15.36.194:39915)
0811 08:05:30.050845 (+ 1320us) server_negotiation.cc:206] Beginning negotiation
0811 08:05:30.050849 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:05:30.057472 (+ 6623us) server_negotiation.cc:407] Connection header received
0811 08:05:30.057531 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:05:30.057534 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:05:30.057554 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:05:30.057648 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:05:30.057915 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:05:30.059226 (+ 1311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:05:30.065735 (+ 6509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:05:30.067455 (+ 1720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:05:30.067534 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:05:30.067617 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 08:05:30.070563 (+ 2946us) server_negotiation.cc:299] Negotiation successful
0811 08:05:30.070620 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1285,"thread_start_us":87,"threads_started":1}
I20260811 08:05:30.071687 28224 tablet_service.cc:1467] Processing CreateTablet for tablet 8922acd16a694650a09535f5a46f403f (DEFAULT_TABLE table=test-table [id=c8ffc68d26454000b8064e653ddc1a3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:05:30.071798 28528 tablet_service.cc:1467] Processing CreateTablet for tablet 8922acd16a694650a09535f5a46f403f (DEFAULT_TABLE table=test-table [id=c8ffc68d26454000b8064e653ddc1a3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:05:30.072105 28224 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8922acd16a694650a09535f5a46f403f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:05:30.072136 28528 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8922acd16a694650a09535f5a46f403f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:05:30.077374 28377 tablet_service.cc:1467] Processing CreateTablet for tablet 8922acd16a694650a09535f5a46f403f (DEFAULT_TABLE table=test-table [id=c8ffc68d26454000b8064e653ddc1a3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:05:30.077759 28377 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8922acd16a694650a09535f5a46f403f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:05:30.081586 28630 tablet_bootstrap.cc:492] T 8922acd16a694650a09535f5a46f403f P b0fa438872ec4e3b98566973e8edc5c4: Bootstrap starting.
I20260811 08:05:30.082687 28630 tablet_bootstrap.cc:654] T 8922acd16a694650a09535f5a46f403f P b0fa438872ec4e3b98566973e8edc5c4: Neither blocks nor log segments found. Creating new log.
I20260811 08:05:30.083114 28630 log.cc:824] T 8922acd16a694650a09535f5a46f403f P b0fa438872ec4e3b98566973e8edc5c4: Log is configured to *not* fsync() on all Append() calls
I20260811 08:05:30.083407 28627 tablet_bootstrap.cc:492] T 8922acd16a694650a09535f5a46f403f P 973105cd6cb54f11a80a928fe1ff16a2: Bootstrap starting.
I20260811 08:05:30.085283 28627 tablet_bootstrap.cc:654] T 8922acd16a694650a09535f5a46f403f P 973105cd6cb54f11a80a928fe1ff16a2: Neither blocks nor log segments found. Creating new log.
I20260811 08:05:30.085762 28627 log.cc:824] T 8922acd16a694650a09535f5a46f403f P 973105cd6cb54f11a80a928fe1ff16a2: Log is configured to *not* fsync() on all Append() calls
I20260811 08:05:30.086726 28630 tablet_bootstrap.cc:492] T 8922acd16a694650a09535f5a46f403f P b0fa438872ec4e3b98566973e8edc5c4: No bootstrap required, opened a new log
I20260811 08:05:30.086853 28630 ts_tablet_manager.cc:1397] T 8922acd16a694650a09535f5a46f403f P b0fa438872ec4e3b98566973e8edc5c4: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260811 08:05:30.087162 28626 tablet_bootstrap.cc:492] T 8922acd16a694650a09535f5a46f403f P 66b4a51336394a46a4623b8b7348435d: Bootstrap starting.
I20260811 08:05:30.087987 28626 tablet_bootstrap.cc:654] T 8922acd16a694650a09535f5a46f403f P 66b4a51336394a46a4623b8b7348435d: Neither blocks nor log segments found. Creating new log.
I20260811 08:05:30.088327 28626 log.cc:824] T 8922acd16a694650a09535f5a46f403f P 66b4a51336394a46a4623b8b7348435d: Log is configured to *not* fsync() on all Append() calls
I20260811 08:05:30.089368 28630 raft_consensus.cc:348] T 8922acd16a694650a09535f5a46f403f P b0fa438872ec4e3b98566973e8edc5c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66b4a51336394a46a4623b8b7348435d" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 39671 } } peers { permanent_uuid: "973105cd6cb54f11a80a928fe1ff16a2" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 37575 } } peers { permanent_uuid: "b0fa438872ec4e3b98566973e8edc5c4" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39915 } }
I20260811 08:05:30.089679 28630 raft_consensus.cc:374] T 8922acd16a694650a09535f5a46f403f P b0fa438872ec4e3b98566973e8edc5c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:05:30.089764 28630 raft_consensus.cc:729] T 8922acd16a694650a09535f5a46f403f P b0fa438872ec4e3b98566973e8edc5c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0fa438872ec4e3b98566973e8edc5c4, State: Initialized, Role: FOLLOWER
I20260811 08:05:30.089986 28630 consensus_queue.cc:260] T 8922acd16a694650a09535f5a46f403f P b0fa438872ec4e3b98566973e8edc5c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66b4a51336394a46a4623b8b7348435d" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 39671 } } peers { permanent_uuid: "973105cd6cb54f11a80a928fe1ff16a2" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 37575 } } peers { permanent_uuid: "b0fa438872ec4e3b98566973e8edc5c4" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39915 } }
I20260811 08:05:30.090370 28630 ts_tablet_manager.cc:1428] T 8922acd16a694650a09535f5a46f403f P b0fa438872ec4e3b98566973e8edc5c4: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 08:05:30.090549 28453 heartbeater.cc:503] Master 127.15.36.254:39935 was elected leader, sending a full tablet report...
I20260811 08:05:30.091813 28626 tablet_bootstrap.cc:492] T 8922acd16a694650a09535f5a46f403f P 66b4a51336394a46a4623b8b7348435d: No bootstrap required, opened a new log
I20260811 08:05:30.091899 28626 ts_tablet_manager.cc:1397] T 8922acd16a694650a09535f5a46f403f P 66b4a51336394a46a4623b8b7348435d: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260811 08:05:30.092365 28627 tablet_bootstrap.cc:492] T 8922acd16a694650a09535f5a46f403f P 973105cd6cb54f11a80a928fe1ff16a2: No bootstrap required, opened a new log
I20260811 08:05:30.092504 28627 ts_tablet_manager.cc:1397] T 8922acd16a694650a09535f5a46f403f P 973105cd6cb54f11a80a928fe1ff16a2: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20260811 08:05:30.094658 28626 raft_consensus.cc:348] T 8922acd16a694650a09535f5a46f403f P 66b4a51336394a46a4623b8b7348435d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66b4a51336394a46a4623b8b7348435d" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 39671 } } peers { permanent_uuid: "973105cd6cb54f11a80a928fe1ff16a2" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 37575 } } peers { permanent_uuid: "b0fa438872ec4e3b98566973e8edc5c4" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39915 } }
I20260811 08:05:30.094926 28626 raft_consensus.cc:374] T 8922acd16a694650a09535f5a46f403f P 66b4a51336394a46a4623b8b7348435d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:05:30.095003 28626 raft_consensus.cc:729] T 8922acd16a694650a09535f5a46f403f P 66b4a51336394a46a4623b8b7348435d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66b4a51336394a46a4623b8b7348435d, State: Initialized, Role: FOLLOWER
I20260811 08:05:30.095161 28626 consensus_queue.cc:260] T 8922acd16a694650a09535f5a46f403f P 66b4a51336394a46a4623b8b7348435d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66b4a51336394a46a4623b8b7348435d" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 39671 } } peers { permanent_uuid: "973105cd6cb54f11a80a928fe1ff16a2" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 37575 } } peers { permanent_uuid: "b0fa438872ec4e3b98566973e8edc5c4" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39915 } }
I20260811 08:05:30.095227 28627 raft_consensus.cc:348] T 8922acd16a694650a09535f5a46f403f P 973105cd6cb54f11a80a928fe1ff16a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66b4a51336394a46a4623b8b7348435d" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 39671 } } peers { permanent_uuid: "973105cd6cb54f11a80a928fe1ff16a2" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 37575 } } peers { permanent_uuid: "b0fa438872ec4e3b98566973e8edc5c4" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39915 } }
I20260811 08:05:30.095500 28626 ts_tablet_manager.cc:1428] T 8922acd16a694650a09535f5a46f403f P 66b4a51336394a46a4623b8b7348435d: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260811 08:05:30.095525 28627 raft_consensus.cc:374] T 8922acd16a694650a09535f5a46f403f P 973105cd6cb54f11a80a928fe1ff16a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:05:30.095641 28295 heartbeater.cc:503] Master 127.15.36.254:39935 was elected leader, sending a full tablet report...
I20260811 08:05:30.095649 28627 raft_consensus.cc:729] T 8922acd16a694650a09535f5a46f403f P 973105cd6cb54f11a80a928fe1ff16a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 973105cd6cb54f11a80a928fe1ff16a2, State: Initialized, Role: FOLLOWER
I20260811 08:05:30.095878 28627 consensus_queue.cc:260] T 8922acd16a694650a09535f5a46f403f P 973105cd6cb54f11a80a928fe1ff16a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66b4a51336394a46a4623b8b7348435d" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 39671 } } peers { permanent_uuid: "973105cd6cb54f11a80a928fe1ff16a2" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 37575 } } peers { permanent_uuid: "b0fa438872ec4e3b98566973e8edc5c4" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39915 } }
I20260811 08:05:30.096628 28627 ts_tablet_manager.cc:1428] T 8922acd16a694650a09535f5a46f403f P 973105cd6cb54f11a80a928fe1ff16a2: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260811 08:05:30.096848 28604 heartbeater.cc:503] Master 127.15.36.254:39935 was elected leader, sending a full tablet report...
Aug 11 08:05:30 dist-test-slave-2w3w krb5kdc[27514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435529, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.254@KRBTEST.COM for HTTP/127.15.36.212@KRBTEST.COM
W20260811 08:05:30.162009 28296 tablet.cc:2369] T 8922acd16a694650a09535f5a46f403f P 66b4a51336394a46a4623b8b7348435d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 08:05:30.179634 28454 tablet.cc:2369] T 8922acd16a694650a09535f5a46f403f P b0fa438872ec4e3b98566973e8edc5c4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:05:30.214470 28636 raft_consensus.cc:482] T 8922acd16a694650a09535f5a46f403f P 973105cd6cb54f11a80a928fe1ff16a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:05:30.214881 28636 raft_consensus.cc:504] T 8922acd16a694650a09535f5a46f403f P 973105cd6cb54f11a80a928fe1ff16a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66b4a51336394a46a4623b8b7348435d" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 39671 } } peers { permanent_uuid: "973105cd6cb54f11a80a928fe1ff16a2" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 37575 } } peers { permanent_uuid: "b0fa438872ec4e3b98566973e8edc5c4" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39915 } }
I20260811 08:05:30.215782 28636 leader_election.cc:288] T 8922acd16a694650a09535f5a46f403f P 973105cd6cb54f11a80a928fe1ff16a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66b4a51336394a46a4623b8b7348435d (127.15.36.193:39671), b0fa438872ec4e3b98566973e8edc5c4 (127.15.36.194:39915)
I20260811 08:05:30.220410 28606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:05:30.216154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.193:39671 (local address 127.15.36.195:40303)
0811 08:05:30.216331 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0811 08:05:30.216343 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:05:30.216387 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:05:30.216613 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:05:30.216615 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:05:30.216618 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:05:30.216693 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:05:30.216695 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:05:30.217666 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:05:30.217668 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:05:30.218909 (+ 1241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:05:30.218913 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:05:30.220075 (+ 1162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:05:30.220076 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:05:30.220177 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:05:30.220181 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:05:30.220238 (+ 57us) client_negotiation.cc:240] Negotiation successful
0811 08:05:30.220320 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155}
I20260811 08:05:30.221303 28621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:05:30.216355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:40303 (local address 127.15.36.193:39671)
0811 08:05:30.216411 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 08:05:30.216413 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:05:30.216425 (+ 12us) server_negotiation.cc:407] Connection header received
0811 08:05:30.216458 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:05:30.216459 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:05:30.216469 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:05:30.216550 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:05:30.216788 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:05:30.217532 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:05:30.219127 (+ 1595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:05:30.219890 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:05:30.219997 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:05:30.220010 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0811 08:05:30.221169 (+ 1159us) server_negotiation.cc:299] Negotiation successful
0811 08:05:30.221225 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 08:05:30.221671 28245 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8922acd16a694650a09535f5a46f403f" candidate_uuid: "973105cd6cb54f11a80a928fe1ff16a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66b4a51336394a46a4623b8b7348435d" is_pre_election: true
I20260811 08:05:30.221848 28245 raft_consensus.cc:2454] T 8922acd16a694650a09535f5a46f403f P 66b4a51336394a46a4623b8b7348435d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 973105cd6cb54f11a80a928fe1ff16a2 in term 0.
I20260811 08:05:30.222265 28476 leader_election.cc:302] T 8922acd16a694650a09535f5a46f403f P 973105cd6cb54f11a80a928fe1ff16a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66b4a51336394a46a4623b8b7348435d, 973105cd6cb54f11a80a928fe1ff16a2; no voters:
I20260811 08:05:30.222434 28636 raft_consensus.cc:2781] T 8922acd16a694650a09535f5a46f403f P 973105cd6cb54f11a80a928fe1ff16a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:05:30.222481 28636 raft_consensus.cc:482] T 8922acd16a694650a09535f5a46f403f P 973105cd6cb54f11a80a928fe1ff16a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:05:30.222503 28636 raft_consensus.cc:3037] T 8922acd16a694650a09535f5a46f403f P 973105cd6cb54f11a80a928fe1ff16a2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:05:30.223515 28636 raft_consensus.cc:504] T 8922acd16a694650a09535f5a46f403f P 973105cd6cb54f11a80a928fe1ff16a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66b4a51336394a46a4623b8b7348435d" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 39671 } } peers { permanent_uuid: "973105cd6cb54f11a80a928fe1ff16a2" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 37575 } } peers { permanent_uuid: "b0fa438872ec4e3b98566973e8edc5c4" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39915 } }
I20260811 08:05:30.223702 28636 leader_election.cc:288] T 8922acd16a694650a09535f5a46f403f P 973105cd6cb54f11a80a928fe1ff16a2 [CANDIDATE]: Term 1 election: Requested vote from peers 66b4a51336394a46a4623b8b7348435d (127.15.36.193:39671), b0fa438872ec4e3b98566973e8edc5c4 (127.15.36.194:39915)
I20260811 08:05:30.224135 28245 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8922acd16a694650a09535f5a46f403f" candidate_uuid: "973105cd6cb54f11a80a928fe1ff16a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66b4a51336394a46a4623b8b7348435d"
I20260811 08:05:30.224227 28245 raft_consensus.cc:3037] T 8922acd16a694650a09535f5a46f403f P 66b4a51336394a46a4623b8b7348435d [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:05:30.225221 28245 raft_consensus.cc:2454] T 8922acd16a694650a09535f5a46f403f P 66b4a51336394a46a4623b8b7348435d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 973105cd6cb54f11a80a928fe1ff16a2 in term 1.
I20260811 08:05:30.225498 28476 leader_election.cc:302] T 8922acd16a694650a09535f5a46f403f P 973105cd6cb54f11a80a928fe1ff16a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66b4a51336394a46a4623b8b7348435d, 973105cd6cb54f11a80a928fe1ff16a2; no voters:
I20260811 08:05:30.225664 28636 raft_consensus.cc:2781] T 8922acd16a694650a09535f5a46f403f P 973105cd6cb54f11a80a928fe1ff16a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:05:30.225835 28636 raft_consensus.cc:686] T 8922acd16a694650a09535f5a46f403f P 973105cd6cb54f11a80a928fe1ff16a2 [term 1 LEADER]: Becoming Leader. State: Replica: 973105cd6cb54f11a80a928fe1ff16a2, State: Running, Role: LEADER
I20260811 08:05:30.225936 28636 consensus_queue.cc:237] T 8922acd16a694650a09535f5a46f403f P 973105cd6cb54f11a80a928fe1ff16a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66b4a51336394a46a4623b8b7348435d" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 39671 } } peers { permanent_uuid: "973105cd6cb54f11a80a928fe1ff16a2" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 37575 } } peers { permanent_uuid: "b0fa438872ec4e3b98566973e8edc5c4" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39915 } }
I20260811 08:05:30.226953 28058 catalog_manager.cc:5495] T 8922acd16a694650a09535f5a46f403f P 973105cd6cb54f11a80a928fe1ff16a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 973105cd6cb54f11a80a928fe1ff16a2 (127.15.36.195). New cstate: current_term: 1 leader_uuid: "973105cd6cb54f11a80a928fe1ff16a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66b4a51336394a46a4623b8b7348435d" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 39671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "973105cd6cb54f11a80a928fe1ff16a2" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 37575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0fa438872ec4e3b98566973e8edc5c4" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39915 } health_report { overall_health: UNKNOWN } } }
I20260811 08:05:30.232966 28606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:05:30.216541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.194:39915 (local address 127.15.36.195:35195)
0811 08:05:30.220520 (+ 3979us) negotiation.cc:107] Waiting for socket to connect
0811 08:05:30.220533 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 08:05:30.220585 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:05:30.227517 (+ 6932us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:05:30.227519 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:05:30.227522 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:05:30.227581 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:05:30.227583 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:05:30.230589 (+ 3006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:05:30.230591 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:05:30.231793 (+ 1202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:05:30.231798 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:05:30.232709 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:05:30.232710 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:05:30.232783 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:05:30.232787 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:05:30.232828 (+ 41us) client_negotiation.cc:240] Negotiation successful
0811 08:05:30.232876 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3966,"thread_start_us":97,"threads_started":1}
I20260811 08:05:30.233398 28624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:05:30.216732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:35195 (local address 127.15.36.194:39915)
0811 08:05:30.216772 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 08:05:30.216775 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:05:30.220820 (+ 4045us) server_negotiation.cc:407] Connection header received
0811 08:05:30.220857 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:05:30.220858 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:05:30.220872 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:05:30.220923 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:05:30.227691 (+ 6768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:05:30.228492 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:05:30.231918 (+ 3426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:05:30.232531 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:05:30.232628 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:05:30.232638 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 08:05:30.233270 (+ 632us) server_negotiation.cc:299] Negotiation successful
0811 08:05:30.233331 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 08:05:30.233979 28398 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8922acd16a694650a09535f5a46f403f" candidate_uuid: "973105cd6cb54f11a80a928fe1ff16a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0fa438872ec4e3b98566973e8edc5c4"
I20260811 08:05:30.234119 28398 raft_consensus.cc:3037] T 8922acd16a694650a09535f5a46f403f P b0fa438872ec4e3b98566973e8edc5c4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:05:30.233989 28400 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8922acd16a694650a09535f5a46f403f" candidate_uuid: "973105cd6cb54f11a80a928fe1ff16a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0fa438872ec4e3b98566973e8edc5c4" is_pre_election: true
I20260811 08:05:30.235857 28398 raft_consensus.cc:2454] T 8922acd16a694650a09535f5a46f403f P b0fa438872ec4e3b98566973e8edc5c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 973105cd6cb54f11a80a928fe1ff16a2 in term 1.
I20260811 08:05:30.240756 28622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:05:30.237131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50862 (local address 127.15.36.195:37575)
0811 08:05:30.237178 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 08:05:30.237180 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:05:30.237190 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:05:30.237262 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:05:30.237263 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:05:30.237374 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:05:30.237472 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:05:30.237685 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:05:30.238449 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:05:30.239642 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:05:30.239948 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:05:30.240017 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:05:30.240220 (+ 203us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:05:30.240374 (+ 154us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:05:30.240461 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 08:05:30.240629 (+ 168us) server_negotiation.cc:299] Negotiation successful
0811 08:05:30.240658 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
W20260811 08:05:30.254496 28605 tablet.cc:2369] T 8922acd16a694650a09535f5a46f403f P 973105cd6cb54f11a80a928fe1ff16a2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:05:30.261421 28398 raft_consensus.cc:1261] T 8922acd16a694650a09535f5a46f403f P b0fa438872ec4e3b98566973e8edc5c4 [term 1 FOLLOWER]: Refusing update from remote peer 973105cd6cb54f11a80a928fe1ff16a2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:05:30.261875 28641 consensus_queue.cc:1035] T 8922acd16a694650a09535f5a46f403f P 973105cd6cb54f11a80a928fe1ff16a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0fa438872ec4e3b98566973e8edc5c4" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:05:30.264393 28245 raft_consensus.cc:1261] T 8922acd16a694650a09535f5a46f403f P 66b4a51336394a46a4623b8b7348435d [term 1 FOLLOWER]: Refusing update from remote peer 973105cd6cb54f11a80a928fe1ff16a2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:05:30.264806 28641 consensus_queue.cc:1035] T 8922acd16a694650a09535f5a46f403f P 973105cd6cb54f11a80a928fe1ff16a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66b4a51336394a46a4623b8b7348435d" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 39671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:05:30.270226 28644 mvcc.cc:205] Tried to move back new op lower bound from 7317239931947184128 to 7317239931806101504. Current Snapshot: MvccSnapshot[applied={T|T < 7317239931947184128}]
I20260811 08:05:30.270571 28647 mvcc.cc:205] Tried to move back new op lower bound from 7317239931947184128 to 7317239931806101504. Current Snapshot: MvccSnapshot[applied={T|T < 7317239931947184128}]
I20260811 08:05:30.273548 28645 mvcc.cc:205] Tried to move back new op lower bound from 7317239931947184128 to 7317239931806101504. Current Snapshot: MvccSnapshot[applied={T|T < 7317239931947184128}]
I20260811 08:05:30.282461 28058 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53866:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:05:30.282586 28058 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53866:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:05:30.283502 28058 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 23bf2cbff1364d43a3ee4d442263d5fc: Sending DeleteTablet for 3 replicas of tablet 8922acd16a694650a09535f5a46f403f
I20260811 08:05:30.283957 28377 tablet_service.cc:1514] Processing DeleteTablet for tablet 8922acd16a694650a09535f5a46f403f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:05:30 UTC) from {username='kudu', principal='kudu/127.15.36.254@KRBTEST.COM'} at 127.0.0.1:33870
I20260811 08:05:30.283977 28224 tablet_service.cc:1514] Processing DeleteTablet for tablet 8922acd16a694650a09535f5a46f403f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:05:30 UTC) from {username='kudu', principal='kudu/127.15.36.254@KRBTEST.COM'} at 127.0.0.1:48472
I20260811 08:05:30.284144 28528 tablet_service.cc:1514] Processing DeleteTablet for tablet 8922acd16a694650a09535f5a46f403f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:05:30 UTC) from {username='kudu', principal='kudu/127.15.36.254@KRBTEST.COM'} at 127.0.0.1:50856
I20260811 08:05:30.284415 28653 tablet_replica.cc:330] T 8922acd16a694650a09535f5a46f403f P b0fa438872ec4e3b98566973e8edc5c4: stopping tablet replica
I20260811 08:05:30.284535 28655 tablet_replica.cc:330] T 8922acd16a694650a09535f5a46f403f P 973105cd6cb54f11a80a928fe1ff16a2: stopping tablet replica
I20260811 08:05:30.284644 28655 raft_consensus.cc:2229] T 8922acd16a694650a09535f5a46f403f P 973105cd6cb54f11a80a928fe1ff16a2 [term 1 LEADER]: Raft consensus shutting down.
I20260811 08:05:30.284819 28653 raft_consensus.cc:2229] T 8922acd16a694650a09535f5a46f403f P b0fa438872ec4e3b98566973e8edc5c4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:05:30.284878 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 28148
I20260811 08:05:30.288082 28653 raft_consensus.cc:2258] T 8922acd16a694650a09535f5a46f403f P b0fa438872ec4e3b98566973e8edc5c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:05:30.288985 28653 ts_tablet_manager.cc:1905] T 8922acd16a694650a09535f5a46f403f P b0fa438872ec4e3b98566973e8edc5c4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:05:30.291589 28653 ts_tablet_manager.cc:1918] T 8922acd16a694650a09535f5a46f403f P b0fa438872ec4e3b98566973e8edc5c4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:05:30.291702 28653 log.cc:1196] T 8922acd16a694650a09535f5a46f403f P b0fa438872ec4e3b98566973e8edc5c4: Deleting WAL directory at /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/ts-1/wal/wals/8922acd16a694650a09535f5a46f403f
I20260811 08:05:30.292057 28653 ts_tablet_manager.cc:1939] T 8922acd16a694650a09535f5a46f403f P b0fa438872ec4e3b98566973e8edc5c4: Deleting consensus metadata
I20260811 08:05:30.295077 28655 raft_consensus.cc:2258] T 8922acd16a694650a09535f5a46f403f P 973105cd6cb54f11a80a928fe1ff16a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:05:30.296295 28655 ts_tablet_manager.cc:1905] T 8922acd16a694650a09535f5a46f403f P 973105cd6cb54f11a80a928fe1ff16a2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:05:30.299163 28655 ts_tablet_manager.cc:1918] T 8922acd16a694650a09535f5a46f403f P 973105cd6cb54f11a80a928fe1ff16a2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:05:30.299279 28655 log.cc:1196] T 8922acd16a694650a09535f5a46f403f P 973105cd6cb54f11a80a928fe1ff16a2: Deleting WAL directory at /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786435400844580-15507-0/minicluster-data/ts-2/wal/wals/8922acd16a694650a09535f5a46f403f
I20260811 08:05:30.299595 28655 ts_tablet_manager.cc:1939] T 8922acd16a694650a09535f5a46f403f P 973105cd6cb54f11a80a928fe1ff16a2: Deleting consensus metadata
I20260811 08:05:30.300254 28044 catalog_manager.cc:4841] TS b0fa438872ec4e3b98566973e8edc5c4 (127.15.36.194:39915): tablet 8922acd16a694650a09535f5a46f403f (table test-table [id=c8ffc68d26454000b8064e653ddc1a3f]) successfully deleted
I20260811 08:05:30.300407 28044 catalog_manager.cc:4841] TS 973105cd6cb54f11a80a928fe1ff16a2 (127.15.36.195:37575): tablet 8922acd16a694650a09535f5a46f403f (table test-table [id=c8ffc68d26454000b8064e653ddc1a3f]) successfully deleted
W20260811 08:05:30.305248 28042 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.36.193:39671 (error 108)
I20260811 08:05:30.305753 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 28301
I20260811 08:05:30.319633 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 28458
I20260811 08:05:30.321534 28618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:05:30.321380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.193:39671 (local address 127.0.0.1:48482)
0811 08:05:30.321442 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0811 08:05:30.321482 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.193:39671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260811 08:05:30.321689 28042 catalog_manager.cc:4584] TS 66b4a51336394a46a4623b8b7348435d (127.15.36.193:39671): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8922acd16a694650a09535f5a46f403f: Network error: Client connection negotiation failed: client connection to 127.15.36.193:39671: connect: Connection refused (error 111)
I20260811 08:05:30.327041 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 28023
I20260811 08:05:30.337761 15507 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260811 08:05:30.684563 15507 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260811 08:05:30.684696 15507 mini_ranger.cc:66] Stopping Ranger...
I20260811 08:05:31.041262 15507 mini_ranger.cc:68] Stopped Ranger
2026-08-11 08:05:31.041 UTC [27549] LOG: received smart shutdown request
2026-08-11 08:05:31.046 UTC [27549] LOG: background worker "logical replication launcher" (PID 27559) exited with exit code 1
2026-08-11 08:05:31.047 UTC [27554] LOG: shutting down
2026-08-11 08:05:31.304 UTC [27549] LOG: database system is shut down
2026-08-11T08:05:31Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (65884 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:05:31 dist-test-slave-2w3w krb5kdc[28666](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:05:31 dist-test-slave-2w3w krb5kdc[28666](info): set up 2 sockets
Aug 11 08:05:31 dist-test-slave-2w3w krb5kdc[28666](info): commencing operation
krb5kdc: starting...
W20260811 08:05:32.621196 15507 mini_kdc.cc:121] Time spent starting KDC: real 1.174s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Aug 11 08:05:32 dist-test-slave-2w3w krb5kdc[28666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435532, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:05:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:05:32Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.15.36.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.15.36.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.15.36.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/krb5kdc/rangeradmin_127.15.36.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.15.36.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/krb5kdc/rangeradmin_127.15.36.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.15.36.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.15.36.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.15.36.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/krb5kdc/rangerlookup_127.15.36.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.15.36.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/krb5kdc/rangerlookup_127.15.36.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.15.36.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.15.36.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.15.36.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/krb5kdc/HTTP_127.15.36.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.15.36.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/krb5kdc/HTTP_127.15.36.212@KRBTEST.COM.keytab.
I20260811 08:05:32.849145 15507 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskP5pk_f/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/postgres -l logfile start
2026-08-11 08:05:36.446 UTC [28698] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-11 08:05:36.446 UTC [28698] LOG: listening on IPv4 address "127.15.36.212", port 34791
2026-08-11 08:05:36.451 UTC [28698] LOG: listening on Unix socket "/tmp/.s.PGSQL.34791"
2026-08-11 08:05:36.475 UTC [28701] LOG: database system was shut down at 2026-08-11 08:05:34 UTC
2026-08-11 08:05:36.479 UTC [28698] LOG: database system is ready to accept connections
I20260811 08:05:37.554883 15507 mini_postgres.cc:96] Postgres bound to 34791
2026-08-11 08:05:37.562 UTC [28709] FATAL: database "slave" does not exist
127.15.36.212:34791 - accepting connections
I20260811 08:05:37.563459 15507 mini_ranger.cc:161] Starting Ranger...
I20260811 08:05:37.581607 15507 mini_ranger.cc:84] Created miniranger Postgres user
I20260811 08:05:38.304986 15507 mini_ranger.cc:87] Created ranger Postgres database
I20260811 08:05:38.305080 15507 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ranger-admin
2026-08-11 08:05:38,620 [I] DB FLAVOR :POSTGRES
2026-08-11 08:05:38,621 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 08:05:38,621 [I] Checking connection..
2026-08-11 08:05:38,622 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP5pk_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskP5pk_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.36.212:34791/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-11 08:05:38,934 [I] Checking connection passed.
2026-08-11 08:05:38,935 [I] --------- Verifying version history table ---------
2026-08-11 08:05:38,935 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP5pk_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskP5pk_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.36.212:34791/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 08:05:39,239 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 08:05:39,239 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP5pk_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskP5pk_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.36.212:34791/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 08:05:39,563 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 08:05:39,563 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-11 08:05:39,564 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP5pk_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskP5pk_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.36.212:34791/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskP5pk_f/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-11 08:05:39.862 UTC [28784] WARNING: there is no transaction in progress
2026-08-11 08:05:39,871 [I] create_dbversion_catalog.sql file imported successfully
2026-08-11 08:05:39,871 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP5pk_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskP5pk_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.36.212:34791/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 08:05:40,152 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-11 08:05:40,152 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 08:05:40,152 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP5pk_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskP5pk_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.36.212:34791/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-11 08:05:40,416 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP5pk_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskP5pk_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.36.212:34791/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-11 08:05:40,700 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP5pk_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskP5pk_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.36.212:34791/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-2w3w.c.gcp-upstream.internal','N') ;"
2026-08-11 08:05:40,988 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP5pk_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskP5pk_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.36.212:34791/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 08:05:41,287 [I] Table x_portal_user does not exist in database ranger
2026-08-11 08:05:41,288 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP5pk_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskP5pk_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.36.212:34791/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 08:05:41,561 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-11 08:05:41,561 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP5pk_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskP5pk_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.36.212:34791/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 08:05:41,874 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP5pk_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskP5pk_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.36.212:34791/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 08:05:42,155 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-11 08:05:42,155 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP5pk_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskP5pk_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.36.212:34791/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskP5pk_f/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-11 08:05:43.452 UTC [28904] WARNING: there is no transaction in progress
2026-08-11 08:05:43.475 UTC [28904] WARNING: there is no transaction in progress
2026-08-11 08:05:43.496 UTC [28904] WARNING: there is no transaction in progress
2026-08-11 08:05:43.518 UTC [28904] WARNING: there is no transaction in progress
2026-08-11 08:05:43.548 UTC [28904] WARNING: there is no transaction in progress
2026-08-11 08:05:43.575 UTC [28904] WARNING: there is no transaction in progress
2026-08-11 08:05:43.657 UTC [28904] WARNING: there is no transaction in progress
2026-08-11 08:05:43.668 UTC [28904] WARNING: there is no transaction in progress
2026-08-11 08:05:43.688 UTC [28904] WARNING: there is no transaction in progress
2026-08-11 08:05:43.701 UTC [28904] WARNING: there is no transaction in progress
2026-08-11 08:05:43.714 UTC [28904] WARNING: there is no transaction in progress
2026-08-11 08:05:43.732 UTC [28904] WARNING: there is no transaction in progress
2026-08-11 08:05:43.746 UTC [28904] WARNING: there is no transaction in progress
2026-08-11 08:05:43.756 UTC [28904] WARNING: there is no transaction in progress
2026-08-11 08:05:43.768 UTC [28904] WARNING: there is no transaction in progress
2026-08-11 08:05:43.779 UTC [28904] WARNING: there is no transaction in progress
2026-08-11 08:05:44,808 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-11 08:05:44,808 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP5pk_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskP5pk_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.36.212:34791/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-11 08:05:45,108 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-11 08:05:45,109 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP5pk_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskP5pk_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.36.212:34791/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 08:05:45,424 [I] Table x_portal_user already exists in database 'ranger'
2026-08-11 08:05:45,424 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP5pk_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskP5pk_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.36.212:34791/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 08:05:45,738 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-11 08:05:45,738 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP5pk_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskP5pk_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.36.212:34791/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 08:05:46,028 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP5pk_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskP5pk_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.36.212:34791/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 08:05:46,334 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP5pk_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskP5pk_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.36.212:34791/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-2w3w.c.gcp-upstream.internal';"
2026-08-11 08:05:46,656 [I] CORE_DB_SCHEMA import status has been updated
2026-08-11 08:05:46,657 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP5pk_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskP5pk_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.36.212:34791/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-11 08:05:46,974 [I] DB_PATCHES have already been applied
I20260811 08:05:46.980979 15507 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ranger-admin:/tmp/dist-test-taskP5pk_f/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskP5pk_f/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskP5pk_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskP5pk_f/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260811 08:05:46.981068 15507 mini_ranger.cc:193] Using host: 127.15.36.212
I20260811 08:05:46.986013 15507 mini_ranger.cc:227] Ranger admin URL: http://127.15.36.212:56541
Aug 11, 2026 8:05:47 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 8:05:47 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 8:05:47 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ranger-admin/ews/webapp
Aug 11, 2026 8:05:47 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 11, 2026 8:05:47 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 11, 2026 8:05:48 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ranger-admin/ews/webapp].
Aug 11, 2026 8:05:48 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260811 08:05:48.294279 15507 mini_ranger.cc:160] Time spent starting Ranger: real 10.731s user 0.000s sys 0.013s
Aug 11, 2026 8:06:09 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 11, 2026 8:06:09 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 11, 2026 8:06:09 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 11, 2026 8:06:09 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 11, 2026 8:06:09 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 11, 2026 8:06:09 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 11, 2026 8:06:09 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 11, 2026 8:06:09 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 11, 2026 8:06:09 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 11, 2026 8:06:09 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 11, 2026 8:06:09 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 11, 2026 8:06:09 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 11, 2026 8:06:09 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 11, 2026 8:06:09 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 11, 2026 8:06:09 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 11, 2026 8:06:09 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 11, 2026 8:06:09 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 11, 2026 8:06:10 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260811 08:06:10.840500 15507 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.15.36.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.15.36.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.15.36.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/krb5kdc/rangerkms_127.15.36.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.15.36.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/krb5kdc/rangerkms_127.15.36.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.15.36.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.15.36.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.15.36.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/krb5kdc/HTTP_127.15.36.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.15.36.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/krb5kdc/HTTP_127.15.36.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 11 08:06:10 dist-test-slave-2w3w krb5kdc[28666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435570, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260811 08:06:10.954301 15507 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260811 08:06:10.965488 15507 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260811 08:06:12.077287 15507 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260811 08:06:12.077378 15507 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ranger-kms
I20260811 08:06:12.077400 15507 mini_ranger_kms.cc:227] Using postgres at 127.15.36.212:34791
2026-08-11 08:06:12,268 [I] DB FLAVOR :POSTGRES
2026-08-11 08:06:12,268 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 08:06:12,269 [I] Checking connection
2026-08-11 08:06:12,269 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP5pk_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.36.212:34791/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-11 08:06:12,551 [I] connection success
2026-08-11 08:06:12,551 [I] --------- Verifying Ranger DB tables ---------
2026-08-11 08:06:12,551 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-11 08:06:12,551 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP5pk_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.36.212:34791/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-11 08:06:12,820 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-11 08:06:12,820 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 08:06:12,820 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-11 08:06:12,821 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP5pk_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.36.212:34791/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-11 08:06:13,133 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260811 08:06:13.699617 15507 mini_ranger_kms.cc:310] Created kms service
I20260811 08:06:13.928663 15507 mini_ranger_kms.cc:326] Created kudu user
I20260811 08:06:13.979943 15507 mini_ranger_kms.cc:343] Created rangerkms user
Aug 11 08:06:13 dist-test-slave-2w3w krb5kdc[28666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435570, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.15.36.212@KRBTEST.COM
I20260811 08:06:14.434798 15507 mini_ranger_kms.cc:384] Added ranger policy
I20260811 08:06:14.435150 15507 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ranger-kms:/tmp/dist-test-taskP5pk_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskP5pk_f/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskP5pk_f/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260811 08:06:14.435181 15507 mini_ranger_kms.cc:240] Using host: 127.15.36.212
I20260811 08:06:14.439358 15507 mini_ranger_kms.cc:276] Ranger KMS PID: 29106
I20260811 08:06:14.439455 15507 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.15.36.212:52233
Aug 11, 2026 8:06:15 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 8:06:15 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 8:06:15 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 11, 2026 8:06:15 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 11, 2026 8:06:15 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ranger-kms/ews/webapp].
Aug 11, 2026 8:06:15 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 11 08:06:16 dist-test-slave-2w3w krb5kdc[28666](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786435576, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.15.36.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:06:16.837673 15507 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.883s user 0.000s sys 0.171s
I20260811 08:06:16.837786 15507 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260811 08:06:16.837836 15507 mini_ranger_kms.cc:401] 127.15.36.212:52233/kms/v1/keys
Aug 11 08:06:17 dist-test-slave-2w3w krb5kdc[28666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435576, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.15.36.212@KRBTEST.COM for HTTP/127.15.36.212@KRBTEST.COM
Aug 11 08:06:17 dist-test-slave-2w3w krb5kdc[28666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435576, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.15.36.212@KRBTEST.COM for HTTP/127.15.36.212@KRBTEST.COM
Aug 11 08:06:20 dist-test-slave-2w3w krb5kdc[28666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435580, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.15.36.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab.
Entry for principal kudu/127.15.36.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab.
I20260811 08:06:20.356755 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:37621
--webserver_interface=127.15.36.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=kudu/127.15.36.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:38257
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.36.254:37621
--ranger_config_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.36.212:52233/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:06:20.444265 29161 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:06:20.444510 29161 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:06:20.444535 29161 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:06:20.445747 29161 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:06:20.445791 29161 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:06:20.445804 29161 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:06:20.445817 29161 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:06:20.445832 29161 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:06:20.447491 29161 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:38257
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/master-0/wal
--ranger_kms_url=127.15.36.212:52233/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.15.36.254:37621
--ranger_config_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=kudu/127.15.36.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:37621
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.36.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29161
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:06:20.447758 29161 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:06:20.447980 29161 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 08:06:20.453826 29161 server_base.cc:1034] running on GCE node
W20260811 08:06:20.453853 29168 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:06:20.453855 29169 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:06:20.454061 29171 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:06:20.454416 29161 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:06:20.454739 29161 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:06:20.455895 29161 hybrid_clock.cc:648] HybridClock initialized: now 1786435580455861 us; error 48 us; skew 500 ppm
Aug 11 08:06:20 dist-test-slave-2w3w krb5kdc[28666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435580, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:06:20.463006 29161 init.cc:377] Logged in from keytab as kudu/127.15.36.254@KRBTEST.COM (short username kudu)
I20260811 08:06:20.463544 29161 webserver.cc:460] Webserver started at http://127.15.36.254:38085/ using document root <none> and password file <none>
I20260811 08:06:20.463747 29161 fs_manager.cc:359] Metadata directory not provided
I20260811 08:06:20.463783 29161 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:06:20.463888 29161 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 08:06:20 dist-test-slave-2w3w krb5kdc[28666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435580, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.254@KRBTEST.COM for HTTP/127.15.36.212@KRBTEST.COM
I20260811 08:06:20.531122 29161 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/master-0/data/instance:
uuid: "b27dea39d6cf437881b21f4c62b60efa"
format_stamp: "Formatted at 2026-08-11 08:06:20 on dist-test-slave-2w3w"
server_key: "9622cd4cd3a05353bea4f499c43149e8"
server_key_iv: "d4753a51ff3a656fada2c5851e6d6a34"
server_key_version: "kuduclusterkey@0"
I20260811 08:06:20.531635 29161 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/master-0/wal/instance:
uuid: "b27dea39d6cf437881b21f4c62b60efa"
format_stamp: "Formatted at 2026-08-11 08:06:20 on dist-test-slave-2w3w"
server_key: "9622cd4cd3a05353bea4f499c43149e8"
server_key_iv: "d4753a51ff3a656fada2c5851e6d6a34"
server_key_version: "kuduclusterkey@0"
I20260811 08:06:20.533249 29161 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 08:06:20.552079 29179 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:06:20.552390 29161 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 08:06:20.552512 29161 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/master-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/master-0/wal
uuid: "b27dea39d6cf437881b21f4c62b60efa"
format_stamp: "Formatted at 2026-08-11 08:06:20 on dist-test-slave-2w3w"
server_key: "9622cd4cd3a05353bea4f499c43149e8"
server_key_iv: "d4753a51ff3a656fada2c5851e6d6a34"
server_key_version: "kuduclusterkey@0"
I20260811 08:06:20.552618 29161 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:06:20.577603 29161 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:06:20.580003 29161 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:06:20.580184 29161 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:06:20.585594 29161 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.254:37621
I20260811 08:06:20.585678 29235 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.254:37621 every 8 connection(s)
I20260811 08:06:20.586141 29161 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
I20260811 08:06:20.587070 29236 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:06:20.589543 29236 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b27dea39d6cf437881b21f4c62b60efa: Bootstrap starting.
I20260811 08:06:20.590262 29236 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b27dea39d6cf437881b21f4c62b60efa: Neither blocks nor log segments found. Creating new log.
I20260811 08:06:20.590602 29236 log.cc:824] T 00000000000000000000000000000000 P b27dea39d6cf437881b21f4c62b60efa: Log is configured to *not* fsync() on all Append() calls
I20260811 08:06:20.591499 29236 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b27dea39d6cf437881b21f4c62b60efa: No bootstrap required, opened a new log
I20260811 08:06:20.593735 29236 raft_consensus.cc:348] T 00000000000000000000000000000000 P b27dea39d6cf437881b21f4c62b60efa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b27dea39d6cf437881b21f4c62b60efa" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 37621 } }
I20260811 08:06:20.593918 29236 raft_consensus.cc:374] T 00000000000000000000000000000000 P b27dea39d6cf437881b21f4c62b60efa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:06:20.593945 29236 raft_consensus.cc:729] T 00000000000000000000000000000000 P b27dea39d6cf437881b21f4c62b60efa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b27dea39d6cf437881b21f4c62b60efa, State: Initialized, Role: FOLLOWER
I20260811 08:06:20.594122 29236 consensus_queue.cc:260] T 00000000000000000000000000000000 P b27dea39d6cf437881b21f4c62b60efa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b27dea39d6cf437881b21f4c62b60efa" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 37621 } }
I20260811 08:06:20.594218 29236 raft_consensus.cc:388] T 00000000000000000000000000000000 P b27dea39d6cf437881b21f4c62b60efa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:06:20.594244 29236 raft_consensus.cc:482] T 00000000000000000000000000000000 P b27dea39d6cf437881b21f4c62b60efa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:06:20.594316 29236 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b27dea39d6cf437881b21f4c62b60efa [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:06:20.595126 29236 raft_consensus.cc:504] T 00000000000000000000000000000000 P b27dea39d6cf437881b21f4c62b60efa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b27dea39d6cf437881b21f4c62b60efa" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 37621 } }
I20260811 08:06:20.595161 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 29161
I20260811 08:06:20.595268 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/master-0/wal/instance
I20260811 08:06:20.595273 29236 leader_election.cc:302] T 00000000000000000000000000000000 P b27dea39d6cf437881b21f4c62b60efa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b27dea39d6cf437881b21f4c62b60efa; no voters:
I20260811 08:06:20.595502 15507 external_mini_cluster.cc:1428] Setting key bc08e766f98a7979948edeb3ee1b63c2
I20260811 08:06:20.595501 29236 leader_election.cc:288] T 00000000000000000000000000000000 P b27dea39d6cf437881b21f4c62b60efa [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:06:20.595597 29239 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b27dea39d6cf437881b21f4c62b60efa [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:06:20.595781 29236 sys_catalog.cc:564] T 00000000000000000000000000000000 P b27dea39d6cf437881b21f4c62b60efa [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:06:20.595768 29239 raft_consensus.cc:686] T 00000000000000000000000000000000 P b27dea39d6cf437881b21f4c62b60efa [term 1 LEADER]: Becoming Leader. State: Replica: b27dea39d6cf437881b21f4c62b60efa, State: Running, Role: LEADER
I20260811 08:06:20.595930 29239 consensus_queue.cc:237] T 00000000000000000000000000000000 P b27dea39d6cf437881b21f4c62b60efa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b27dea39d6cf437881b21f4c62b60efa" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 37621 } }
I20260811 08:06:20.596336 29239 sys_catalog.cc:455] T 00000000000000000000000000000000 P b27dea39d6cf437881b21f4c62b60efa [sys.catalog]: SysCatalogTable state changed. Reason: New leader b27dea39d6cf437881b21f4c62b60efa. Latest consensus state: current_term: 1 leader_uuid: "b27dea39d6cf437881b21f4c62b60efa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b27dea39d6cf437881b21f4c62b60efa" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 37621 } } }
I20260811 08:06:20.596408 29239 sys_catalog.cc:458] T 00000000000000000000000000000000 P b27dea39d6cf437881b21f4c62b60efa [sys.catalog]: This master's current role is: LEADER
I20260811 08:06:20.596589 29241 sys_catalog.cc:455] T 00000000000000000000000000000000 P b27dea39d6cf437881b21f4c62b60efa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b27dea39d6cf437881b21f4c62b60efa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b27dea39d6cf437881b21f4c62b60efa" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 37621 } } }
I20260811 08:06:20.596715 29241 sys_catalog.cc:458] T 00000000000000000000000000000000 P b27dea39d6cf437881b21f4c62b60efa [sys.catalog]: This master's current role is: LEADER
I20260811 08:06:20.596890 29251 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:06:20.597457 29251 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:06:20.599288 29236 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 08:06:20.599722 29260 mvcc.cc:205] Tried to move back new op lower bound from 7317240138131546112 to 7317240138121183232. Current Snapshot: MvccSnapshot[applied={T|T < 7317240138131546112}]
I20260811 08:06:20.600272 29251 catalog_manager.cc:1347] Generated new cluster ID: 648c7c34cf8b4f9fbd62d0dced8e4499
I20260811 08:06:20.600409 29251 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 08:06:20 dist-test-slave-2w3w krb5kdc[28666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435580, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:06:20.613719 29246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:20.596235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49932 (local address 127.15.36.254:37621)
0811 08:06:20.596926 (+ 691us) server_negotiation.cc:206] Beginning negotiation
0811 08:06:20.596937 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 08:06:20.596976 (+ 39us) server_negotiation.cc:407] Connection header received
0811 08:06:20.597125 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:06:20.597134 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:06:20.597202 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:06:20.597350 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:06:20.598285 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:20.599739 (+ 1454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:20.600885 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:20.601532 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:20.601654 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:20.605148 (+ 3494us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:06:20.605155 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:06:20.605155 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:06:20.605174 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:06:20.609866 (+ 4692us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:20.610515 (+ 649us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:20.610520 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:20.610521 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:20.610845 (+ 324us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:20.611165 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:20.611166 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:20.611167 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:20.611875 (+ 708us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:06:20.612144 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0811 08:06:20.612768 (+ 624us) server_negotiation.cc:299] Negotiation successful
0811 08:06:20.613276 (+ 508us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":628,"thread_start_us":85,"threads_started":1}
I20260811 08:06:20.631156 29251 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:06:20.632091 29251 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:06:20.649722 29251 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b27dea39d6cf437881b21f4c62b60efa: Generated new TSK 0
I20260811 08:06:20.649959 29251 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.36.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab.
Entry for principal kudu/127.15.36.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab.
I20260811 08:06:21.432675 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.36.212:52233/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.193:0
--local_ip_for_outbound_sockets=127.15.36.193
--webserver_interface=127.15.36.193
--webserver_port=0
--tserver_master_addrs=127.15.36.254:37621
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab
--principal=kudu/127.15.36.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:38257
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:06:21.529824 29289 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:06:21.530059 29289 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:06:21.530086 29289 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:06:21.531422 29289 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:06:21.531481 29289 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:06:21.531512 29289 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.193
I20260811 08:06:21.533186 29289 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:38257
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.15.36.212:52233/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab
--principal=kudu/127.15.36.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.36.193
--webserver_port=0
--tserver_master_addrs=127.15.36.254:37621
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29289
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.193
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:06:21.533471 29289 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:06:21.533756 29289 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:06:21.539358 29295 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:06:21.539445 29289 server_base.cc:1034] running on GCE node
W20260811 08:06:21.539559 29297 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:06:21.539359 29294 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:06:21.539947 29289 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:06:21.540329 29289 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:06:21.541563 29289 hybrid_clock.cc:648] HybridClock initialized: now 1786435581541546 us; error 31 us; skew 500 ppm
Aug 11 08:06:21 dist-test-slave-2w3w krb5kdc[28666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435581, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:06:21.544515 29289 init.cc:377] Logged in from keytab as kudu/127.15.36.193@KRBTEST.COM (short username kudu)
I20260811 08:06:21.545030 29289 webserver.cc:460] Webserver started at http://127.15.36.193:39667/ using document root <none> and password file <none>
I20260811 08:06:21.545320 29289 fs_manager.cc:359] Metadata directory not provided
I20260811 08:06:21.545398 29289 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:06:21.545565 29289 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 08:06:21 dist-test-slave-2w3w krb5kdc[28666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435581, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.193@KRBTEST.COM for HTTP/127.15.36.212@KRBTEST.COM
I20260811 08:06:21.559484 29289 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-0/data/instance:
uuid: "e68dfd5e9284483cb007648e1546f088"
format_stamp: "Formatted at 2026-08-11 08:06:21 on dist-test-slave-2w3w"
server_key: "a661ca9dece4b855fa2b20e886434f8c"
server_key_iv: "ebeb2f34a5e818cacf3c8881c5117c7f"
server_key_version: "kuduclusterkey@0"
I20260811 08:06:21.559933 29289 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-0/wal/instance:
uuid: "e68dfd5e9284483cb007648e1546f088"
format_stamp: "Formatted at 2026-08-11 08:06:21 on dist-test-slave-2w3w"
server_key: "a661ca9dece4b855fa2b20e886434f8c"
server_key_iv: "ebeb2f34a5e818cacf3c8881c5117c7f"
server_key_version: "kuduclusterkey@0"
I20260811 08:06:21.562155 29289 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.001s
I20260811 08:06:21.577004 29307 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:06:21.577350 29289 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:06:21.577536 29289 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-0/wal
uuid: "e68dfd5e9284483cb007648e1546f088"
format_stamp: "Formatted at 2026-08-11 08:06:21 on dist-test-slave-2w3w"
server_key: "a661ca9dece4b855fa2b20e886434f8c"
server_key_iv: "ebeb2f34a5e818cacf3c8881c5117c7f"
server_key_version: "kuduclusterkey@0"
I20260811 08:06:21.577767 29289 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:06:21.595082 29289 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:06:21.597916 29289 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:06:21.598086 29289 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:06:21.598367 29289 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:06:21.598713 29289 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:06:21.598770 29289 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:06:21.598838 29289 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:06:21.598868 29289 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:06:21.606835 29289 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.193:35627
I20260811 08:06:21.606980 29429 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.193:35627 every 8 connection(s)
I20260811 08:06:21.607743 29289 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
I20260811 08:06:21.609606 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 29289
I20260811 08:06:21.609745 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-0/wal/instance
I20260811 08:06:21.609982 15507 external_mini_cluster.cc:1428] Setting key 8c4be0b7c6ce927fd0010ac2ac6965a6
Aug 11 08:06:21 dist-test-slave-2w3w krb5kdc[28666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435581, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.193@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:06:21.620818 29434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:21.608812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:56597 (local address 127.15.36.254:37621)
0811 08:06:21.608963 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0811 08:06:21.608965 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:06:21.609134 (+ 169us) server_negotiation.cc:407] Connection header received
0811 08:06:21.609689 (+ 555us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:06:21.609691 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:06:21.609708 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:06:21.609798 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:06:21.611047 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:21.611713 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:21.613312 (+ 1599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:21.613622 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:21.613708 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:21.616737 (+ 3029us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:06:21.616739 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:06:21.616740 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:06:21.616749 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:06:21.618697 (+ 1948us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:21.619308 (+ 611us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:21.619310 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:21.619311 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:21.619402 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:21.619804 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:21.619805 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:21.619806 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:21.619997 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:06:21.620082 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 08:06:21.620531 (+ 449us) server_negotiation.cc:299] Negotiation successful
0811 08:06:21.620653 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":88,"threads_started":1}
I20260811 08:06:21.620901 29433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:21.608710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:37621 (local address 127.15.36.193:56597)
0811 08:06:21.608956 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:21.609017 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0811 08:06:21.609576 (+ 559us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:06:21.609979 (+ 403us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:06:21.609985 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:06:21.610583 (+ 598us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:06:21.610924 (+ 341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:21.610931 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:21.611835 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:21.611836 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:21.613118 (+ 1282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:21.613122 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:21.613810 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:21.613812 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:21.613976 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:21.614705 (+ 729us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:06:21.614729 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:06:21.616600 (+ 1871us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:06:21.618810 (+ 2210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:06:21.618821 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:06:21.618824 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:06:21.619198 (+ 374us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:06:21.619512 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:06:21.619513 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:06:21.619514 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:06:21.619695 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:06:21.620096 (+ 401us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:06:21.620105 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:06:21.620301 (+ 196us) client_negotiation.cc:769] Sending connection context
0811 08:06:21.620439 (+ 138us) client_negotiation.cc:240] Negotiation successful
0811 08:06:21.620635 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":150,"threads_started":1}
WARNING: no policy specified for kudu/127.15.36.194@KRBTEST.COM; defaulting to no policy
I20260811 08:06:21.621915 29430 heartbeater.cc:347] Connected to a master server at 127.15.36.254:37621
I20260811 08:06:21.622041 29430 heartbeater.cc:464] Registering TS with master...
I20260811 08:06:21.622262 29430 heartbeater.cc:511] Master 127.15.36.254:37621 requested a full tablet report, sending...
I20260811 08:06:21.622951 29197 ts_manager.cc:194] Registered new tserver with Master: e68dfd5e9284483cb007648e1546f088 (127.15.36.193:35627)
I20260811 08:06:21.624042 29197 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.36.193@KRBTEST.COM'} at 127.15.36.193:56597
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab.
Entry for principal kudu/127.15.36.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab.
I20260811 08:06:21.646690 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.36.212:52233/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.194:0
--local_ip_for_outbound_sockets=127.15.36.194
--webserver_interface=127.15.36.194
--webserver_port=0
--tserver_master_addrs=127.15.36.254:37621
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab
--principal=kudu/127.15.36.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:38257
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:06:21.772280 29438 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:06:21.772609 29438 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:06:21.772647 29438 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:06:21.774690 29438 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:06:21.774791 29438 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:06:21.774838 29438 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.194
I20260811 08:06:21.777601 29438 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:38257
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.15.36.212:52233/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab
--principal=kudu/127.15.36.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.36.194
--webserver_port=0
--tserver_master_addrs=127.15.36.254:37621
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29438
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.194
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:06:21.777932 29438 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:06:21.778491 29438 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:06:21.785869 29447 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:06:21.786115 29448 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:06:21.786055 29451 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:06:21.786509 29438 server_base.cc:1034] running on GCE node
I20260811 08:06:21.786934 29438 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:06:21.787312 29438 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:06:21.788488 29438 hybrid_clock.cc:648] HybridClock initialized: now 1786435581788457 us; error 51 us; skew 500 ppm
Aug 11 08:06:21 dist-test-slave-2w3w krb5kdc[28666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435581, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:06:21.792541 29438 init.cc:377] Logged in from keytab as kudu/127.15.36.194@KRBTEST.COM (short username kudu)
I20260811 08:06:21.793191 29438 webserver.cc:460] Webserver started at http://127.15.36.194:43319/ using document root <none> and password file <none>
I20260811 08:06:21.793540 29438 fs_manager.cc:359] Metadata directory not provided
I20260811 08:06:21.793618 29438 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:06:21.793797 29438 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 08:06:21 dist-test-slave-2w3w krb5kdc[28666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435581, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.194@KRBTEST.COM for HTTP/127.15.36.212@KRBTEST.COM
Aug 11 08:06:21 dist-test-slave-2w3w krb5kdc[28666](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786435581, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:06:21.825006 29438 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-1/data/instance:
uuid: "0c52f106cbdf42179d43a85ef8855cae"
format_stamp: "Formatted at 2026-08-11 08:06:21 on dist-test-slave-2w3w"
server_key: "4f4e75bd0d7608c676396e1dcbda1575"
server_key_iv: "18d3a0dbe6807beb9ef4ac51024f925e"
server_key_version: "kuduclusterkey@0"
I20260811 08:06:21.825505 29438 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-1/wal/instance:
uuid: "0c52f106cbdf42179d43a85ef8855cae"
format_stamp: "Formatted at 2026-08-11 08:06:21 on dist-test-slave-2w3w"
server_key: "4f4e75bd0d7608c676396e1dcbda1575"
server_key_iv: "18d3a0dbe6807beb9ef4ac51024f925e"
server_key_version: "kuduclusterkey@0"
I20260811 08:06:21.835636 29438 fs_manager.cc:691] Time spent creating directory manager: real 0.010s user 0.004s sys 0.000s
I20260811 08:06:21.863090 29463 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:06:21.863337 29438 fs_manager.cc:725] Time spent opening block manager: real 0.010s user 0.001s sys 0.000s
I20260811 08:06:21.863449 29438 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-1/wal
uuid: "0c52f106cbdf42179d43a85ef8855cae"
format_stamp: "Formatted at 2026-08-11 08:06:21 on dist-test-slave-2w3w"
server_key: "4f4e75bd0d7608c676396e1dcbda1575"
server_key_iv: "18d3a0dbe6807beb9ef4ac51024f925e"
server_key_version: "kuduclusterkey@0"
I20260811 08:06:21.863560 29438 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:06:21.887079 29438 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:06:21.897799 29438 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:06:21.898102 29438 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:06:21.898427 29438 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:06:21.898986 29438 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:06:21.899101 29438 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:06:21.899185 29438 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:06:21.899250 29438 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:06:21.906617 29438 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.194:38463
I20260811 08:06:21.913836 29591 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.194:38463 every 8 connection(s)
I20260811 08:06:21.914187 29438 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
I20260811 08:06:21.916765 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 29438
I20260811 08:06:21.916869 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-1/wal/instance
I20260811 08:06:21.917290 15507 external_mini_cluster.cc:1428] Setting key 65645f97275c22ec5c134437e1f03f5f
Aug 11 08:06:21 dist-test-slave-2w3w krb5kdc[28666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435581, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.194@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:06:21.931221 29434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:21.915201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:33009 (local address 127.15.36.254:37621)
0811 08:06:21.915251 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 08:06:21.915253 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:06:21.915512 (+ 259us) server_negotiation.cc:407] Connection header received
0811 08:06:21.916305 (+ 793us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:06:21.916307 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:06:21.916477 (+ 170us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:06:21.916643 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:06:21.921649 (+ 5006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:21.922481 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:21.924110 (+ 1629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:21.924412 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:21.924466 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:21.927567 (+ 3101us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:06:21.927569 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:06:21.927570 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:06:21.927579 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:06:21.929377 (+ 1798us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:21.929940 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:21.929941 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:21.929942 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:21.930020 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:21.930353 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:21.930354 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:21.930354 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:21.930510 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:06:21.930570 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 08:06:21.931015 (+ 445us) server_negotiation.cc:299] Negotiation successful
0811 08:06:21.931120 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 08:06:21.932101 29594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:21.915215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:37621 (local address 127.15.36.194:33009)
0811 08:06:21.915375 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:21.915420 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 08:06:21.916129 (+ 709us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:06:21.920825 (+ 4696us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:06:21.920831 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:06:21.921158 (+ 327us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:06:21.921509 (+ 351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:21.921517 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:21.922625 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:21.922626 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:21.923979 (+ 1353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:21.923983 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:21.924591 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:21.924592 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:21.924747 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:21.925478 (+ 731us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:06:21.925490 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:06:21.927431 (+ 1941us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:06:21.929496 (+ 2065us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:06:21.929505 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:06:21.929508 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:06:21.929840 (+ 332us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:06:21.930095 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:06:21.930095 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:06:21.930096 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:06:21.930265 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:06:21.930607 (+ 342us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:06:21.930615 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:06:21.930795 (+ 180us) client_negotiation.cc:769] Sending connection context
0811 08:06:21.931632 (+ 837us) client_negotiation.cc:240] Negotiation successful
0811 08:06:21.931831 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":89,"threads_started":1}
I20260811 08:06:21.932916 29592 heartbeater.cc:347] Connected to a master server at 127.15.36.254:37621
I20260811 08:06:21.933028 29592 heartbeater.cc:464] Registering TS with master...
I20260811 08:06:21.933255 29592 heartbeater.cc:511] Master 127.15.36.254:37621 requested a full tablet report, sending...
I20260811 08:06:21.933756 29197 ts_manager.cc:194] Registered new tserver with Master: 0c52f106cbdf42179d43a85ef8855cae (127.15.36.194:38463)
I20260811 08:06:21.934244 29197 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.36.194@KRBTEST.COM'} at 127.15.36.194:33009
WARNING: no policy specified for kudu/127.15.36.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab.
Entry for principal kudu/127.15.36.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab.
I20260811 08:06:21.971719 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.36.212:52233/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.195:0
--local_ip_for_outbound_sockets=127.15.36.195
--webserver_interface=127.15.36.195
--webserver_port=0
--tserver_master_addrs=127.15.36.254:37621
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab
--principal=kudu/127.15.36.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:38257
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:06:22.164876 29597 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:06:22.165364 29597 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:06:22.165438 29597 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:06:22.167090 29597 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:06:22.167161 29597 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:06:22.167203 29597 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.195
I20260811 08:06:22.169764 29597 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:38257
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.15.36.212:52233/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab
--principal=kudu/127.15.36.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.36.195
--webserver_port=0
--tserver_master_addrs=127.15.36.254:37621
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29597
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.195
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:06:22.170063 29597 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:06:22.170348 29597 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:06:22.177598 29603 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:06:22.178447 29602 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:06:22.178929 29597 server_base.cc:1034] running on GCE node
W20260811 08:06:22.179193 29605 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:06:22.179499 29597 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:06:22.179828 29597 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:06:22.181054 29597 hybrid_clock.cc:648] HybridClock initialized: now 1786435582181029 us; error 42 us; skew 500 ppm
Aug 11 08:06:22 dist-test-slave-2w3w krb5kdc[28666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435582, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:06:22.184737 29597 init.cc:377] Logged in from keytab as kudu/127.15.36.195@KRBTEST.COM (short username kudu)
I20260811 08:06:22.185501 29597 webserver.cc:460] Webserver started at http://127.15.36.195:44751/ using document root <none> and password file <none>
I20260811 08:06:22.185830 29597 fs_manager.cc:359] Metadata directory not provided
I20260811 08:06:22.185972 29597 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:06:22.186182 29597 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 08:06:22 dist-test-slave-2w3w krb5kdc[28666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435582, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.195@KRBTEST.COM for HTTP/127.15.36.212@KRBTEST.COM
I20260811 08:06:22.204142 29597 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-2/data/instance:
uuid: "100d3fa60c8d48578b0b7fb58579dd71"
format_stamp: "Formatted at 2026-08-11 08:06:22 on dist-test-slave-2w3w"
server_key: "092b7c2423a2d4bae17c40c12936cfc3"
server_key_iv: "7dbbab3a7b1896f611f1a9b71dae28a0"
server_key_version: "kuduclusterkey@0"
I20260811 08:06:22.204665 29597 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-2/wal/instance:
uuid: "100d3fa60c8d48578b0b7fb58579dd71"
format_stamp: "Formatted at 2026-08-11 08:06:22 on dist-test-slave-2w3w"
server_key: "092b7c2423a2d4bae17c40c12936cfc3"
server_key_iv: "7dbbab3a7b1896f611f1a9b71dae28a0"
server_key_version: "kuduclusterkey@0"
I20260811 08:06:22.221000 29597 fs_manager.cc:691] Time spent creating directory manager: real 0.016s user 0.002s sys 0.001s
I20260811 08:06:22.243024 29612 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:06:22.243350 29597 fs_manager.cc:725] Time spent opening block manager: real 0.007s user 0.001s sys 0.000s
I20260811 08:06:22.243468 29597 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-2/wal
uuid: "100d3fa60c8d48578b0b7fb58579dd71"
format_stamp: "Formatted at 2026-08-11 08:06:22 on dist-test-slave-2w3w"
server_key: "092b7c2423a2d4bae17c40c12936cfc3"
server_key_iv: "7dbbab3a7b1896f611f1a9b71dae28a0"
server_key_version: "kuduclusterkey@0"
I20260811 08:06:22.243578 29597 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:06:22.262666 29597 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:06:22.265340 29597 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:06:22.265519 29597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:06:22.265805 29597 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:06:22.266263 29597 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:06:22.266358 29597 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:06:22.266402 29597 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:06:22.266441 29597 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:06:22.273671 29597 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.195:45595
I20260811 08:06:22.274173 29597 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
I20260811 08:06:22.283547 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 29597
I20260811 08:06:22.283694 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-2/wal/instance
I20260811 08:06:22.283701 29743 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.195:45595 every 8 connection(s)
I20260811 08:06:22.283944 15507 external_mini_cluster.cc:1428] Setting key 2301560e0988fe90cb566aeb031ce5e9
Aug 11 08:06:22 dist-test-slave-2w3w krb5kdc[28666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435582, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.195@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:06:22.303812 29434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:22.284469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:41759 (local address 127.15.36.254:37621)
0811 08:06:22.284511 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 08:06:22.284514 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:06:22.284983 (+ 469us) server_negotiation.cc:407] Connection header received
0811 08:06:22.285789 (+ 806us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:06:22.285791 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:06:22.285803 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:06:22.285860 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:06:22.286644 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:22.287478 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:22.291181 (+ 3703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:22.291505 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:22.291591 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:22.296316 (+ 4725us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:06:22.296318 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:06:22.296318 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:06:22.296328 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:06:22.298299 (+ 1971us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:22.298923 (+ 624us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:22.298924 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:22.298924 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:22.299021 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:22.301878 (+ 2857us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:22.301880 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:22.301881 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:22.302091 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:06:22.302184 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 08:06:22.303558 (+ 1374us) server_negotiation.cc:299] Negotiation successful
0811 08:06:22.303700 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 08:06:22.305114 29747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:22.284489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:37621 (local address 127.15.36.195:41759)
0811 08:06:22.284818 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:22.284865 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 08:06:22.285656 (+ 791us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:06:22.285957 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:06:22.285961 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:06:22.286236 (+ 275us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:06:22.286555 (+ 319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:22.286561 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:22.289587 (+ 3026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:22.289588 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:22.291045 (+ 1457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:22.291050 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:22.291644 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:22.291645 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:22.291819 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:22.292541 (+ 722us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:06:22.292552 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:06:22.296182 (+ 3630us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:06:22.298420 (+ 2238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:06:22.298431 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:06:22.298434 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:06:22.298820 (+ 386us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:06:22.299103 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:06:22.299104 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:06:22.299104 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:06:22.299278 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:06:22.303059 (+ 3781us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:06:22.303074 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:06:22.303335 (+ 261us) client_negotiation.cc:769] Sending connection context
0811 08:06:22.304579 (+ 1244us) client_negotiation.cc:240] Negotiation successful
0811 08:06:22.304831 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":127,"threads_started":1}
I20260811 08:06:22.305897 29745 heartbeater.cc:347] Connected to a master server at 127.15.36.254:37621
I20260811 08:06:22.306008 29745 heartbeater.cc:464] Registering TS with master...
I20260811 08:06:22.306231 29745 heartbeater.cc:511] Master 127.15.36.254:37621 requested a full tablet report, sending...
I20260811 08:06:22.306716 29197 ts_manager.cc:194] Registered new tserver with Master: 100d3fa60c8d48578b0b7fb58579dd71 (127.15.36.195:45595)
I20260811 08:06:22.307452 29197 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.36.195@KRBTEST.COM'} at 127.15.36.195:41759
I20260811 08:06:22.317322 15507 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 08:06:22.318244 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 29289
I20260811 08:06:22.336587 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 29438
I20260811 08:06:22.344982 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 29597
I20260811 08:06:22.354622 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 29161
I20260811 08:06:22.366175 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:37621
--webserver_interface=127.15.36.254
--webserver_port=38085
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=kudu/127.15.36.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:38257
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.36.254:37621
--ranger_config_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.36.212:52233/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.15.36.212:52233/kms with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:06:22.456183 29748 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:06:22.456414 29748 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:06:22.456440 29748 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:06:22.457691 29748 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:06:22.457746 29748 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:06:22.457762 29748 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:06:22.457774 29748 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:06:22.457787 29748 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:06:22.459604 29748 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:38257
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.15.36.212:52233/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.15.36.254:37621
--ranger_config_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=kudu/127.15.36.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:37621
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.36.254
--webserver_port=38085
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29748
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:06:22.459892 29748 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:06:22.460168 29748 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:06:22.465432 29753 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:06:22.465420 29754 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:06:22.465420 29756 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:06:22.465667 29748 server_base.cc:1034] running on GCE node
I20260811 08:06:22.465909 29748 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:06:22.466248 29748 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:06:22.467422 29748 hybrid_clock.cc:648] HybridClock initialized: now 1786435582467399 us; error 43 us; skew 500 ppm
Aug 11 08:06:22 dist-test-slave-2w3w krb5kdc[28666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435582, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:06:22.470149 29748 init.cc:377] Logged in from keytab as kudu/127.15.36.254@KRBTEST.COM (short username kudu)
I20260811 08:06:22.470731 29748 webserver.cc:460] Webserver started at http://127.15.36.254:38085/ using document root <none> and password file <none>
I20260811 08:06:22.471055 29748 fs_manager.cc:359] Metadata directory not provided
I20260811 08:06:22.471140 29748 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 08:06:22 dist-test-slave-2w3w krb5kdc[28666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435582, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.254@KRBTEST.COM for HTTP/127.15.36.212@KRBTEST.COM
I20260811 08:06:22.545517 29748 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:06:22.546667 29764 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:06:22.546917 29748 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:06:22.547083 29748 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/master-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/master-0/wal
uuid: "b27dea39d6cf437881b21f4c62b60efa"
format_stamp: "Formatted at 2026-08-11 08:06:20 on dist-test-slave-2w3w"
server_key: "9622cd4cd3a05353bea4f499c43149e8"
server_key_iv: "d4753a51ff3a656fada2c5851e6d6a34"
server_key_version: "kuduclusterkey@0"
I20260811 08:06:22.547497 29748 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:06:22.557493 29748 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:06:22.559820 29748 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:06:22.560011 29748 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:06:22.564848 29748 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.254:37621
I20260811 08:06:22.564898 29817 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.254:37621 every 8 connection(s)
I20260811 08:06:22.565310 29748 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
I20260811 08:06:22.566642 29818 sys_catalog.cc:263] Verifying existing consensus state
I20260811 08:06:22.567438 29818 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b27dea39d6cf437881b21f4c62b60efa: Bootstrap starting.
I20260811 08:06:22.574561 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 29748
I20260811 08:06:22.575043 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.36.212:52233/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.193:35627
--local_ip_for_outbound_sockets=127.15.36.193
--tserver_master_addrs=127.15.36.254:37621
--webserver_port=39667
--webserver_interface=127.15.36.193
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab
--principal=kudu/127.15.36.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:38257
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.15.36.212:52233/kms with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 08:06:22.576063 29818 log.cc:824] T 00000000000000000000000000000000 P b27dea39d6cf437881b21f4c62b60efa: Log is configured to *not* fsync() on all Append() calls
I20260811 08:06:22.578250 29818 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b27dea39d6cf437881b21f4c62b60efa: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 08:06:22.578577 29818 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b27dea39d6cf437881b21f4c62b60efa: Bootstrap complete.
I20260811 08:06:22.583012 29818 raft_consensus.cc:348] T 00000000000000000000000000000000 P b27dea39d6cf437881b21f4c62b60efa [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b27dea39d6cf437881b21f4c62b60efa" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 37621 } }
I20260811 08:06:22.583462 29818 raft_consensus.cc:729] T 00000000000000000000000000000000 P b27dea39d6cf437881b21f4c62b60efa [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b27dea39d6cf437881b21f4c62b60efa, State: Initialized, Role: FOLLOWER
I20260811 08:06:22.583666 29818 consensus_queue.cc:260] T 00000000000000000000000000000000 P b27dea39d6cf437881b21f4c62b60efa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b27dea39d6cf437881b21f4c62b60efa" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 37621 } }
I20260811 08:06:22.583760 29818 raft_consensus.cc:388] T 00000000000000000000000000000000 P b27dea39d6cf437881b21f4c62b60efa [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:06:22.583827 29818 raft_consensus.cc:482] T 00000000000000000000000000000000 P b27dea39d6cf437881b21f4c62b60efa [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:06:22.583881 29818 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b27dea39d6cf437881b21f4c62b60efa [term 1 FOLLOWER]: Advancing to term 2
I20260811 08:06:22.585637 29818 raft_consensus.cc:504] T 00000000000000000000000000000000 P b27dea39d6cf437881b21f4c62b60efa [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b27dea39d6cf437881b21f4c62b60efa" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 37621 } }
I20260811 08:06:22.585791 29818 leader_election.cc:302] T 00000000000000000000000000000000 P b27dea39d6cf437881b21f4c62b60efa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b27dea39d6cf437881b21f4c62b60efa; no voters:
I20260811 08:06:22.586117 29818 leader_election.cc:288] T 00000000000000000000000000000000 P b27dea39d6cf437881b21f4c62b60efa [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 08:06:22.586154 29824 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b27dea39d6cf437881b21f4c62b60efa [term 2 FOLLOWER]: Leader election won for term 2
I20260811 08:06:22.586340 29824 raft_consensus.cc:686] T 00000000000000000000000000000000 P b27dea39d6cf437881b21f4c62b60efa [term 2 LEADER]: Becoming Leader. State: Replica: b27dea39d6cf437881b21f4c62b60efa, State: Running, Role: LEADER
I20260811 08:06:22.586495 29818 sys_catalog.cc:564] T 00000000000000000000000000000000 P b27dea39d6cf437881b21f4c62b60efa [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:06:22.586506 29824 consensus_queue.cc:237] T 00000000000000000000000000000000 P b27dea39d6cf437881b21f4c62b60efa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b27dea39d6cf437881b21f4c62b60efa" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 37621 } }
I20260811 08:06:22.587031 29825 sys_catalog.cc:455] T 00000000000000000000000000000000 P b27dea39d6cf437881b21f4c62b60efa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "b27dea39d6cf437881b21f4c62b60efa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b27dea39d6cf437881b21f4c62b60efa" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 37621 } } }
I20260811 08:06:22.587193 29825 sys_catalog.cc:458] T 00000000000000000000000000000000 P b27dea39d6cf437881b21f4c62b60efa [sys.catalog]: This master's current role is: LEADER
I20260811 08:06:22.587565 29826 sys_catalog.cc:455] T 00000000000000000000000000000000 P b27dea39d6cf437881b21f4c62b60efa [sys.catalog]: SysCatalogTable state changed. Reason: New leader b27dea39d6cf437881b21f4c62b60efa. Latest consensus state: current_term: 2 leader_uuid: "b27dea39d6cf437881b21f4c62b60efa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b27dea39d6cf437881b21f4c62b60efa" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 37621 } } }
I20260811 08:06:22.587620 29833 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:06:22.587702 29826 sys_catalog.cc:458] T 00000000000000000000000000000000 P b27dea39d6cf437881b21f4c62b60efa [sys.catalog]: This master's current role is: LEADER
I20260811 08:06:22.588260 29833 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:06:22.588470 29833 catalog_manager.cc:1259] Loaded cluster ID: 648c7c34cf8b4f9fbd62d0dced8e4499
I20260811 08:06:22.588544 29833 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:06:22.588649 29818 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 08:06:22.592855 29833 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:06:22.593540 29833 catalog_manager.cc:5879] T 00000000000000000000000000000000 P b27dea39d6cf437881b21f4c62b60efa: Loaded TSK: 0
I20260811 08:06:22.593964 29833 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 08:06:22.705215 29823 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:06:22.705638 29823 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:06:22.705704 29823 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:06:22.707597 29823 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:06:22.707726 29823 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:06:22.707810 29823 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.193
I20260811 08:06:22.710345 29823 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:38257
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.15.36.212:52233/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab
--principal=kudu/127.15.36.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.193:35627
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.36.193
--webserver_port=39667
--tserver_master_addrs=127.15.36.254:37621
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29823
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.193
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:06:22.710937 29823 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:06:22.711359 29823 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:06:22.718731 29864 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:06:22.718739 29863 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:06:22.719005 29823 server_base.cc:1034] running on GCE node
W20260811 08:06:22.718746 29866 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:06:22.719390 29823 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:06:22.719710 29823 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:06:22.720908 29823 hybrid_clock.cc:648] HybridClock initialized: now 1786435582720880 us; error 42 us; skew 500 ppm
Aug 11 08:06:22 dist-test-slave-2w3w krb5kdc[28666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435582, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:06:22.725526 29823 init.cc:377] Logged in from keytab as kudu/127.15.36.193@KRBTEST.COM (short username kudu)
I20260811 08:06:22.726256 29823 webserver.cc:460] Webserver started at http://127.15.36.193:39667/ using document root <none> and password file <none>
I20260811 08:06:22.726617 29823 fs_manager.cc:359] Metadata directory not provided
I20260811 08:06:22.726778 29823 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 08:06:22 dist-test-slave-2w3w krb5kdc[28666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435582, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.193@KRBTEST.COM for HTTP/127.15.36.212@KRBTEST.COM
I20260811 08:06:22.758837 29823 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:06:22.763134 29876 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:06:22.763415 29823 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.000s
I20260811 08:06:22.763506 29823 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-0/wal
uuid: "e68dfd5e9284483cb007648e1546f088"
format_stamp: "Formatted at 2026-08-11 08:06:21 on dist-test-slave-2w3w"
server_key: "a661ca9dece4b855fa2b20e886434f8c"
server_key_iv: "ebeb2f34a5e818cacf3c8881c5117c7f"
server_key_version: "kuduclusterkey@0"
I20260811 08:06:22.764034 29823 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:06:22.787478 29823 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:06:22.790071 29823 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:06:22.790300 29823 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:06:22.790566 29823 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:06:22.791005 29823 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:06:22.791093 29823 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:06:22.791201 29823 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:06:22.791272 29823 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:06:22.797910 29823 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.193:35627
I20260811 08:06:22.798583 29823 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
I20260811 08:06:22.803715 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 29823
I20260811 08:06:22.804068 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.36.212:52233/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.194:38463
--local_ip_for_outbound_sockets=127.15.36.194
--tserver_master_addrs=127.15.36.254:37621
--webserver_port=43319
--webserver_interface=127.15.36.194
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab
--principal=kudu/127.15.36.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:38257
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.15.36.212:52233/kms with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 08:06:22.801345 29996 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.193:35627 every 8 connection(s)
Aug 11 08:06:22 dist-test-slave-2w3w krb5kdc[28666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435582, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.193@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:06:22.825860 29999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:22.802010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:37621 (local address 127.15.36.193:49765)
0811 08:06:22.802302 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:22.802347 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 08:06:22.803018 (+ 671us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:06:22.803502 (+ 484us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:06:22.803506 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:06:22.803767 (+ 261us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:06:22.804084 (+ 317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:22.804091 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:22.816346 (+ 12255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:22.816349 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:22.817763 (+ 1414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:22.817768 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:22.818774 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:22.818776 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:22.818949 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:22.819732 (+ 783us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:06:22.819743 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:06:22.821582 (+ 1839us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:06:22.823973 (+ 2391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:06:22.823981 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:06:22.823984 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:06:22.824314 (+ 330us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:06:22.824603 (+ 289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:06:22.824604 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:06:22.824604 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:06:22.824722 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:06:22.825193 (+ 471us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:06:22.825199 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:06:22.825355 (+ 156us) client_negotiation.cc:769] Sending connection context
0811 08:06:22.825442 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 08:06:22.825613 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":101,"threads_started":1}
I20260811 08:06:22.827085 30000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:22.802061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:49765 (local address 127.15.36.254:37621)
0811 08:06:22.802294 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0811 08:06:22.802304 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 08:06:22.802478 (+ 174us) server_negotiation.cc:407] Connection header received
0811 08:06:22.803260 (+ 782us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:06:22.803265 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:06:22.803310 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:06:22.803458 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:06:22.806127 (+ 2669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:22.816086 (+ 9959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:22.817929 (+ 1843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:22.818614 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:22.819330 (+ 716us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:22.821728 (+ 2398us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:06:22.821734 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:06:22.821734 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:06:22.821748 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:06:22.823858 (+ 2110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:22.824416 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:22.824419 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:22.824420 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:22.824530 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:22.824796 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:22.824797 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:22.824797 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:22.825112 (+ 315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:06:22.826505 (+ 1393us) server_negotiation.cc:1035] Waiting for connection context
0811 08:06:22.826586 (+ 81us) server_negotiation.cc:299] Negotiation successful
0811 08:06:22.826739 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":176,"thread_start_us":89,"threads_started":1}
I20260811 08:06:22.828022 29997 heartbeater.cc:347] Connected to a master server at 127.15.36.254:37621
I20260811 08:06:22.828135 29997 heartbeater.cc:464] Registering TS with master...
I20260811 08:06:22.828334 29997 heartbeater.cc:511] Master 127.15.36.254:37621 requested a full tablet report, sending...
W20260811 08:06:22.829216 29997 heartbeater.cc:644] Failed to heartbeat to 127.15.36.254:37621 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 08:06:22.829293 29997 heartbeater.cc:464] Registering TS with master...
I20260811 08:06:22.829349 29997 heartbeater.cc:511] Master 127.15.36.254:37621 requested a full tablet report, sending...
I20260811 08:06:22.829712 29997 heartbeater.cc:464] Registering TS with master...
I20260811 08:06:22.829785 29997 heartbeater.cc:511] Master 127.15.36.254:37621 requested a full tablet report, sending...
W20260811 08:06:22.830114 29997 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 08:06:22.917052 30001 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:06:22.917359 30001 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:06:22.917397 30001 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:06:22.919269 30001 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:06:22.919341 30001 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:06:22.919389 30001 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.194
I20260811 08:06:22.921813 30001 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:38257
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.15.36.212:52233/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab
--principal=kudu/127.15.36.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.194:38463
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.36.194
--webserver_port=43319
--tserver_master_addrs=127.15.36.254:37621
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30001
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.194
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:06:22.922099 30001 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:06:22.922425 30001 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:06:22.929226 30012 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:06:22.929283 30008 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:06:22.929252 30010 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:06:22.929924 30001 server_base.cc:1034] running on GCE node
I20260811 08:06:22.930235 30001 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:06:22.930613 30001 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:06:22.931778 30001 hybrid_clock.cc:648] HybridClock initialized: now 1786435582931753 us; error 44 us; skew 500 ppm
Aug 11 08:06:22 dist-test-slave-2w3w krb5kdc[28666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435582, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:06:22.935089 30001 init.cc:377] Logged in from keytab as kudu/127.15.36.194@KRBTEST.COM (short username kudu)
I20260811 08:06:22.935681 30001 webserver.cc:460] Webserver started at http://127.15.36.194:43319/ using document root <none> and password file <none>
I20260811 08:06:22.935985 30001 fs_manager.cc:359] Metadata directory not provided
I20260811 08:06:22.936072 30001 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 08:06:22 dist-test-slave-2w3w krb5kdc[28666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435582, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.194@KRBTEST.COM for HTTP/127.15.36.212@KRBTEST.COM
I20260811 08:06:22.952311 30001 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:06:22.953562 30020 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:06:22.953807 30001 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:06:22.953909 30001 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-1/wal
uuid: "0c52f106cbdf42179d43a85ef8855cae"
format_stamp: "Formatted at 2026-08-11 08:06:21 on dist-test-slave-2w3w"
server_key: "4f4e75bd0d7608c676396e1dcbda1575"
server_key_iv: "18d3a0dbe6807beb9ef4ac51024f925e"
server_key_version: "kuduclusterkey@0"
I20260811 08:06:22.954432 30001 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:06:22.991343 30001 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:06:22.993800 30001 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:06:22.994006 30001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:06:22.994330 30001 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:06:22.994815 30001 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:06:22.994886 30001 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:06:22.994923 30001 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:06:22.994941 30001 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:06:23.006814 30001 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.194:38463
I20260811 08:06:23.008579 30001 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
I20260811 08:06:23.011132 30142 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.194:38463 every 8 connection(s)
I20260811 08:06:23.011874 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 30001
I20260811 08:06:23.012187 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.36.212:52233/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.195:45595
--local_ip_for_outbound_sockets=127.15.36.195
--tserver_master_addrs=127.15.36.254:37621
--webserver_port=44751
--webserver_interface=127.15.36.195
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab
--principal=kudu/127.15.36.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:38257
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.15.36.212:52233/kms with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 08:06:23 dist-test-slave-2w3w krb5kdc[28666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435582, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.194@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:06:23.026844 30000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:23.009961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:33193 (local address 127.15.36.254:37621)
0811 08:06:23.010071 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0811 08:06:23.010073 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:06:23.010303 (+ 230us) server_negotiation.cc:407] Connection header received
0811 08:06:23.011195 (+ 892us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:06:23.011196 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:06:23.011213 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:06:23.011249 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:06:23.013611 (+ 2362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:23.014475 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:23.016321 (+ 1846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:23.017859 (+ 1538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:23.017958 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:23.022669 (+ 4711us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:06:23.022671 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:06:23.022671 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:06:23.022681 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:06:23.024304 (+ 1623us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:23.025698 (+ 1394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:23.025700 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:23.025700 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:23.025777 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:23.026104 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:23.026105 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:23.026106 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:23.026235 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:06:23.026315 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 08:06:23.026641 (+ 326us) server_negotiation.cc:299] Negotiation successful
0811 08:06:23.026743 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 08:06:23.027185 30144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:23.009642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:37621 (local address 127.15.36.194:33193)
0811 08:06:23.010161 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:23.010214 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 08:06:23.011038 (+ 824us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:06:23.011519 (+ 481us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:06:23.011527 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:06:23.011817 (+ 290us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:06:23.013437 (+ 1620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:23.013446 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:23.014628 (+ 1182us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:23.014629 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:23.016190 (+ 1561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:23.016195 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:23.018075 (+ 1880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:23.018077 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:23.018256 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:23.019814 (+ 1558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:06:23.019828 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:06:23.022533 (+ 2705us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:06:23.024423 (+ 1890us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:06:23.024436 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:06:23.024440 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:06:23.024719 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:06:23.025863 (+ 1144us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:06:23.025865 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:06:23.025865 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:06:23.026025 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:06:23.026306 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:06:23.026316 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:06:23.026498 (+ 182us) client_negotiation.cc:769] Sending connection context
0811 08:06:23.026608 (+ 110us) client_negotiation.cc:240] Negotiation successful
0811 08:06:23.026787 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":470,"thread_start_us":76,"threads_started":1}
I20260811 08:06:23.027760 30143 heartbeater.cc:347] Connected to a master server at 127.15.36.254:37621
I20260811 08:06:23.027889 30143 heartbeater.cc:464] Registering TS with master...
I20260811 08:06:23.028095 30143 heartbeater.cc:511] Master 127.15.36.254:37621 requested a full tablet report, sending...
W20260811 08:06:23.028815 30143 heartbeater.cc:644] Failed to heartbeat to 127.15.36.254:37621 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 08:06:23.028890 30143 heartbeater.cc:464] Registering TS with master...
I20260811 08:06:23.028956 30143 heartbeater.cc:511] Master 127.15.36.254:37621 requested a full tablet report, sending...
I20260811 08:06:23.029331 30143 heartbeater.cc:464] Registering TS with master...
I20260811 08:06:23.029421 30143 heartbeater.cc:511] Master 127.15.36.254:37621 requested a full tablet report, sending...
W20260811 08:06:23.029830 30143 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 08:06:23.143308 30146 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:06:23.143777 30146 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:06:23.143880 30146 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:06:23.145938 30146 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:06:23.146080 30146 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:06:23.146183 30146 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.195
I20260811 08:06:23.148442 30146 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:38257
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.15.36.212:52233/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab
--principal=kudu/127.15.36.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.195:45595
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.36.195
--webserver_port=44751
--tserver_master_addrs=127.15.36.254:37621
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30146
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.195
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:06:23.148757 30146 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:06:23.149040 30146 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:06:23.154816 30156 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:06:23.155931 30152 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:06:23.156278 30146 server_base.cc:1034] running on GCE node
W20260811 08:06:23.156069 30153 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:06:23.156704 30146 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:06:23.157187 30146 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:06:23.158448 30146 hybrid_clock.cc:648] HybridClock initialized: now 1786435583158416 us; error 48 us; skew 500 ppm
Aug 11 08:06:23 dist-test-slave-2w3w krb5kdc[28666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435583, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:06:23.162412 30146 init.cc:377] Logged in from keytab as kudu/127.15.36.195@KRBTEST.COM (short username kudu)
I20260811 08:06:23.163105 30146 webserver.cc:460] Webserver started at http://127.15.36.195:44751/ using document root <none> and password file <none>
I20260811 08:06:23.163411 30146 fs_manager.cc:359] Metadata directory not provided
I20260811 08:06:23.163494 30146 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 08:06:23 dist-test-slave-2w3w krb5kdc[28666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435583, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.195@KRBTEST.COM for HTTP/127.15.36.212@KRBTEST.COM
I20260811 08:06:23.189168 30146 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.001s sys 0.000s
I20260811 08:06:23.191882 30164 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:06:23.192109 30146 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.000s
I20260811 08:06:23.192209 30146 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-2/wal
uuid: "100d3fa60c8d48578b0b7fb58579dd71"
format_stamp: "Formatted at 2026-08-11 08:06:22 on dist-test-slave-2w3w"
server_key: "092b7c2423a2d4bae17c40c12936cfc3"
server_key_iv: "7dbbab3a7b1896f611f1a9b71dae28a0"
server_key_version: "kuduclusterkey@0"
I20260811 08:06:23.192744 30146 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:06:23.204054 30146 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:06:23.206683 30146 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:06:23.206862 30146 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:06:23.207172 30146 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:06:23.207542 30146 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:06:23.207588 30146 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:06:23.207619 30146 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:06:23.207638 30146 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:06:23.215145 30146 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.195:45595
I20260811 08:06:23.215221 30288 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.195:45595 every 8 connection(s)
I20260811 08:06:23.215567 30146 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
I20260811 08:06:23.218011 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 30146
Aug 11 08:06:23 dist-test-slave-2w3w krb5kdc[28666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435583, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.195@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:06:23.228955 30291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:23.216370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:37621 (local address 127.15.36.195:41067)
0811 08:06:23.216547 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:23.216590 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 08:06:23.217109 (+ 519us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:06:23.217387 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:06:23.217391 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:06:23.217589 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:06:23.217795 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:23.217799 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:23.218685 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:23.218686 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:23.220003 (+ 1317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:23.220006 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:23.220553 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:23.220554 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:23.220708 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:23.221354 (+ 646us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:06:23.221364 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:06:23.222942 (+ 1578us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:06:23.227086 (+ 4144us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:06:23.227099 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:06:23.227102 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:06:23.227484 (+ 382us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:06:23.227773 (+ 289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:06:23.227774 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:06:23.227775 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:06:23.227944 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:06:23.228256 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:06:23.228265 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:06:23.228465 (+ 200us) client_negotiation.cc:769] Sending connection context
0811 08:06:23.228588 (+ 123us) client_negotiation.cc:240] Negotiation successful
0811 08:06:23.228759 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":99,"threads_started":1}
I20260811 08:06:23.229389 30000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:23.216358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:41067 (local address 127.15.36.254:37621)
0811 08:06:23.216418 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 08:06:23.216430 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 08:06:23.216677 (+ 247us) server_negotiation.cc:407] Connection header received
0811 08:06:23.217229 (+ 552us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:06:23.217230 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:06:23.217243 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:06:23.217304 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:06:23.217900 (+ 596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:23.218561 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:23.220094 (+ 1533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:23.220380 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:23.220448 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:23.223140 (+ 2692us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:06:23.223142 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:06:23.223143 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:06:23.223152 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:06:23.224967 (+ 1815us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:23.227594 (+ 2627us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:23.227596 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:23.227596 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:23.227678 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:23.228030 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:23.228031 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:23.228031 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:23.228170 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:06:23.228262 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 08:06:23.229178 (+ 916us) server_negotiation.cc:299] Negotiation successful
0811 08:06:23.229299 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 08:06:23.229761 30289 heartbeater.cc:347] Connected to a master server at 127.15.36.254:37621
I20260811 08:06:23.229871 30289 heartbeater.cc:464] Registering TS with master...
I20260811 08:06:23.230072 30289 heartbeater.cc:511] Master 127.15.36.254:37621 requested a full tablet report, sending...
W20260811 08:06:23.230804 30289 heartbeater.cc:644] Failed to heartbeat to 127.15.36.254:37621 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 08:06:23.230882 30289 heartbeater.cc:464] Registering TS with master...
I20260811 08:06:23.230952 30289 heartbeater.cc:511] Master 127.15.36.254:37621 requested a full tablet report, sending...
I20260811 08:06:23.231402 30289 heartbeater.cc:464] Registering TS with master...
I20260811 08:06:23.231480 30289 heartbeater.cc:511] Master 127.15.36.254:37621 requested a full tablet report, sending...
W20260811 08:06:23.231849 30289 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 08:06:23.233542 30294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:23.218487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49938 (local address 127.15.36.254:37621)
0811 08:06:23.218826 (+ 339us) server_negotiation.cc:206] Beginning negotiation
0811 08:06:23.218828 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:06:23.218835 (+ 7us) server_negotiation.cc:407] Connection header received
0811 08:06:23.218855 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:06:23.218856 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:06:23.218867 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:06:23.218933 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:06:23.219769 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:23.220506 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:23.222062 (+ 1556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:23.222383 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:23.222478 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:23.225153 (+ 2675us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:06:23.225155 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:06:23.225155 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:06:23.225163 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:06:23.227068 (+ 1905us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:23.232390 (+ 5322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:23.232391 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:23.232392 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:23.232488 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:23.232805 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:23.232806 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:23.232806 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:23.232974 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:06:23.233171 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0811 08:06:23.233250 (+ 79us) server_negotiation.cc:299] Negotiation successful
0811 08:06:23.233371 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":319,"thread_start_us":64,"threads_started":1}
Aug 11 08:06:23 dist-test-slave-2w3w krb5kdc[28666](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786435583, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:06:23.830302 29997 heartbeater.cc:464] Registering TS with master...
I20260811 08:06:23.830490 29997 heartbeater.cc:511] Master 127.15.36.254:37621 requested a full tablet report, sending...
I20260811 08:06:23.831012 29781 ts_manager.cc:194] Registered new tserver with Master: e68dfd5e9284483cb007648e1546f088 (127.15.36.193:35627)
I20260811 08:06:23.832146 29781 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.36.193@KRBTEST.COM'} at 127.15.36.193:49765
I20260811 08:06:24.030054 30143 heartbeater.cc:464] Registering TS with master...
I20260811 08:06:24.030196 30143 heartbeater.cc:511] Master 127.15.36.254:37621 requested a full tablet report, sending...
I20260811 08:06:24.030576 29781 ts_manager.cc:194] Registered new tserver with Master: 0c52f106cbdf42179d43a85ef8855cae (127.15.36.194:38463)
I20260811 08:06:24.031191 29781 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.36.194@KRBTEST.COM'} at 127.15.36.194:33193
Aug 11 08:06:24 dist-test-slave-2w3w krb5kdc[28666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435583, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.254@KRBTEST.COM for HTTP/127.15.36.212@KRBTEST.COM
I20260811 08:06:24.232036 30289 heartbeater.cc:464] Registering TS with master...
I20260811 08:06:24.232219 30289 heartbeater.cc:511] Master 127.15.36.254:37621 requested a full tablet report, sending...
I20260811 08:06:24.232585 29781 ts_manager.cc:194] Registered new tserver with Master: 100d3fa60c8d48578b0b7fb58579dd71 (127.15.36.195:45595)
I20260811 08:06:24.233014 29781 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.36.195@KRBTEST.COM'} at 127.15.36.195:41067
I20260811 08:06:24.239121 15507 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 08:06:24.249444 30313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:24.240236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49940 (local address 127.15.36.254:37621)
0811 08:06:24.240579 (+ 343us) server_negotiation.cc:206] Beginning negotiation
0811 08:06:24.240582 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:06:24.240768 (+ 186us) server_negotiation.cc:407] Connection header received
0811 08:06:24.240798 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:06:24.240799 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:06:24.240811 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:06:24.240879 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:06:24.241637 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:24.242449 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:24.243535 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:24.243856 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:24.243928 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:24.245607 (+ 1679us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:06:24.245608 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:06:24.245609 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:06:24.245624 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:06:24.247689 (+ 2065us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:24.248155 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:24.248157 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:24.248157 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:24.248225 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:24.248500 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:24.248501 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:24.248501 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:24.248652 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:06:24.248747 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 08:06:24.249225 (+ 478us) server_negotiation.cc:299] Negotiation successful
0811 08:06:24.249334 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":314,"thread_start_us":88,"threads_started":1}
I20260811 08:06:24.252204 29781 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49940:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:06:24.255082 29781 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:06:24.269019 30320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:24.262337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.193:35627 (local address 127.0.0.1:49816)
0811 08:06:24.263711 (+ 1374us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:24.263718 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0811 08:06:24.263747 (+ 29us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:06:24.264201 (+ 454us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:06:24.264204 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:06:24.264206 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:06:24.264278 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:24.264280 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:24.265861 (+ 1581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:24.265862 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:24.267164 (+ 1302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:24.267169 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:24.268646 (+ 1477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:24.268648 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:24.268739 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:24.268754 (+ 15us) client_negotiation.cc:769] Sending connection context
0811 08:06:24.268820 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 08:06:24.268877 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1360,"thread_start_us":65,"threads_started":1}
I20260811 08:06:24.269642 30323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:24.262752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49816 (local address 127.15.36.193:35627)
0811 08:06:24.263847 (+ 1095us) server_negotiation.cc:206] Beginning negotiation
0811 08:06:24.263853 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 08:06:24.263862 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:06:24.263898 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:06:24.263901 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:06:24.263917 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:06:24.263981 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:06:24.264348 (+ 367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:24.265764 (+ 1416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:24.267629 (+ 1865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:24.268468 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:24.268543 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:24.268607 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 08:06:24.269518 (+ 911us) server_negotiation.cc:299] Negotiation successful
0811 08:06:24.269567 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1060,"thread_start_us":52,"threads_started":1}
I20260811 08:06:24.270531 29925 tablet_service.cc:1467] Processing CreateTablet for tablet 30d3553afe7e46aca92a1c7c634857e9 (DEFAULT_TABLE table=test-table [id=38b7a013166244ce98825ae1e0b51e62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:06:24.270922 29925 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30d3553afe7e46aca92a1c7c634857e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:06:24.275135 30321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:24.262115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.195:45595 (local address 127.0.0.1:53330)
0811 08:06:24.263497 (+ 1382us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:24.263548 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 08:06:24.263611 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:06:24.271363 (+ 7752us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:06:24.271364 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:06:24.271368 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:06:24.271423 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:24.271425 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:24.272698 (+ 1273us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:24.272700 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:24.273782 (+ 1082us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:24.273786 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:24.274855 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:24.274866 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:24.274934 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:24.274940 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 08:06:24.274997 (+ 57us) client_negotiation.cc:240] Negotiation successful
0811 08:06:24.275048 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1213,"thread_start_us":80,"threads_started":1}
I20260811 08:06:24.275550 30322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:24.262601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53330 (local address 127.15.36.195:45595)
0811 08:06:24.271092 (+ 8491us) server_negotiation.cc:206] Beginning negotiation
0811 08:06:24.271098 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 08:06:24.271111 (+ 13us) server_negotiation.cc:407] Connection header received
0811 08:06:24.271149 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:06:24.271150 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:06:24.271168 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:06:24.271262 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:06:24.271509 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:24.272575 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:24.273917 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:24.274739 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:24.275322 (+ 583us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:24.275406 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 08:06:24.275435 (+ 29us) server_negotiation.cc:299] Negotiation successful
0811 08:06:24.275476 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8447,"thread_start_us":74,"threads_started":1}
I20260811 08:06:24.276233 30217 tablet_service.cc:1467] Processing CreateTablet for tablet 30d3553afe7e46aca92a1c7c634857e9 (DEFAULT_TABLE table=test-table [id=38b7a013166244ce98825ae1e0b51e62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:06:24.276619 30217 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30d3553afe7e46aca92a1c7c634857e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:06:24.283036 30326 tablet_bootstrap.cc:492] T 30d3553afe7e46aca92a1c7c634857e9 P e68dfd5e9284483cb007648e1546f088: Bootstrap starting.
I20260811 08:06:24.283983 30326 tablet_bootstrap.cc:654] T 30d3553afe7e46aca92a1c7c634857e9 P e68dfd5e9284483cb007648e1546f088: Neither blocks nor log segments found. Creating new log.
I20260811 08:06:24.284399 30326 log.cc:824] T 30d3553afe7e46aca92a1c7c634857e9 P e68dfd5e9284483cb007648e1546f088: Log is configured to *not* fsync() on all Append() calls
I20260811 08:06:24.284898 30327 tablet_bootstrap.cc:492] T 30d3553afe7e46aca92a1c7c634857e9 P 100d3fa60c8d48578b0b7fb58579dd71: Bootstrap starting.
I20260811 08:06:24.285712 30327 tablet_bootstrap.cc:654] T 30d3553afe7e46aca92a1c7c634857e9 P 100d3fa60c8d48578b0b7fb58579dd71: Neither blocks nor log segments found. Creating new log.
I20260811 08:06:24.286096 30327 log.cc:824] T 30d3553afe7e46aca92a1c7c634857e9 P 100d3fa60c8d48578b0b7fb58579dd71: Log is configured to *not* fsync() on all Append() calls
I20260811 08:06:24.287074 30324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:24.262976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.194:38463 (local address 127.0.0.1:39688)
0811 08:06:24.264085 (+ 1109us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:24.264093 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 08:06:24.264127 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:06:24.283088 (+ 18961us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:06:24.283091 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:06:24.283096 (+ 5us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:06:24.283175 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:24.283178 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:24.284524 (+ 1346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:24.284526 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:24.285622 (+ 1096us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:24.285627 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:24.286735 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:24.286736 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:24.286804 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:24.286812 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 08:06:24.286901 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 08:06:24.286979 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1095,"thread_start_us":69,"threads_started":1}
I20260811 08:06:24.287137 30326 tablet_bootstrap.cc:492] T 30d3553afe7e46aca92a1c7c634857e9 P e68dfd5e9284483cb007648e1546f088: No bootstrap required, opened a new log
I20260811 08:06:24.287209 30326 ts_tablet_manager.cc:1397] T 30d3553afe7e46aca92a1c7c634857e9 P e68dfd5e9284483cb007648e1546f088: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260811 08:06:24.287580 30325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:24.263079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39688 (local address 127.15.36.194:38463)
0811 08:06:24.279146 (+ 16067us) server_negotiation.cc:206] Beginning negotiation
0811 08:06:24.279152 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 08:06:24.279170 (+ 18us) server_negotiation.cc:407] Connection header received
0811 08:06:24.279213 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:06:24.279215 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:06:24.279235 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:06:24.279358 (+ 123us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:06:24.283287 (+ 3929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:24.284389 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:24.285749 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:24.286546 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:24.286626 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:24.286689 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 08:06:24.287421 (+ 732us) server_negotiation.cc:299] Negotiation successful
0811 08:06:24.287479 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16019,"thread_start_us":81,"threads_started":1}
I20260811 08:06:24.288458 30061 tablet_service.cc:1467] Processing CreateTablet for tablet 30d3553afe7e46aca92a1c7c634857e9 (DEFAULT_TABLE table=test-table [id=38b7a013166244ce98825ae1e0b51e62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:06:24.288831 30061 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30d3553afe7e46aca92a1c7c634857e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:06:24.289657 30326 raft_consensus.cc:348] T 30d3553afe7e46aca92a1c7c634857e9 P e68dfd5e9284483cb007648e1546f088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c52f106cbdf42179d43a85ef8855cae" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 38463 } } peers { permanent_uuid: "100d3fa60c8d48578b0b7fb58579dd71" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 45595 } } peers { permanent_uuid: "e68dfd5e9284483cb007648e1546f088" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 35627 } }
I20260811 08:06:24.289829 30326 raft_consensus.cc:374] T 30d3553afe7e46aca92a1c7c634857e9 P e68dfd5e9284483cb007648e1546f088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:06:24.289858 30326 raft_consensus.cc:729] T 30d3553afe7e46aca92a1c7c634857e9 P e68dfd5e9284483cb007648e1546f088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e68dfd5e9284483cb007648e1546f088, State: Initialized, Role: FOLLOWER
I20260811 08:06:24.289995 30326 consensus_queue.cc:260] T 30d3553afe7e46aca92a1c7c634857e9 P e68dfd5e9284483cb007648e1546f088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c52f106cbdf42179d43a85ef8855cae" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 38463 } } peers { permanent_uuid: "100d3fa60c8d48578b0b7fb58579dd71" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 45595 } } peers { permanent_uuid: "e68dfd5e9284483cb007648e1546f088" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 35627 } }
I20260811 08:06:24.290290 30326 ts_tablet_manager.cc:1428] T 30d3553afe7e46aca92a1c7c634857e9 P e68dfd5e9284483cb007648e1546f088: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 08:06:24.290439 29997 heartbeater.cc:503] Master 127.15.36.254:37621 was elected leader, sending a full tablet report...
I20260811 08:06:24.291656 30327 tablet_bootstrap.cc:492] T 30d3553afe7e46aca92a1c7c634857e9 P 100d3fa60c8d48578b0b7fb58579dd71: No bootstrap required, opened a new log
I20260811 08:06:24.291743 30327 ts_tablet_manager.cc:1397] T 30d3553afe7e46aca92a1c7c634857e9 P 100d3fa60c8d48578b0b7fb58579dd71: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260811 08:06:24.294431 30327 raft_consensus.cc:348] T 30d3553afe7e46aca92a1c7c634857e9 P 100d3fa60c8d48578b0b7fb58579dd71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c52f106cbdf42179d43a85ef8855cae" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 38463 } } peers { permanent_uuid: "100d3fa60c8d48578b0b7fb58579dd71" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 45595 } } peers { permanent_uuid: "e68dfd5e9284483cb007648e1546f088" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 35627 } }
I20260811 08:06:24.294613 30327 raft_consensus.cc:374] T 30d3553afe7e46aca92a1c7c634857e9 P 100d3fa60c8d48578b0b7fb58579dd71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:06:24.294643 30327 raft_consensus.cc:729] T 30d3553afe7e46aca92a1c7c634857e9 P 100d3fa60c8d48578b0b7fb58579dd71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 100d3fa60c8d48578b0b7fb58579dd71, State: Initialized, Role: FOLLOWER
I20260811 08:06:24.294792 30327 consensus_queue.cc:260] T 30d3553afe7e46aca92a1c7c634857e9 P 100d3fa60c8d48578b0b7fb58579dd71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c52f106cbdf42179d43a85ef8855cae" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 38463 } } peers { permanent_uuid: "100d3fa60c8d48578b0b7fb58579dd71" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 45595 } } peers { permanent_uuid: "e68dfd5e9284483cb007648e1546f088" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 35627 } }
I20260811 08:06:24.295001 30331 tablet_bootstrap.cc:492] T 30d3553afe7e46aca92a1c7c634857e9 P 0c52f106cbdf42179d43a85ef8855cae: Bootstrap starting.
I20260811 08:06:24.295113 30327 ts_tablet_manager.cc:1428] T 30d3553afe7e46aca92a1c7c634857e9 P 100d3fa60c8d48578b0b7fb58579dd71: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 08:06:24.295404 30289 heartbeater.cc:503] Master 127.15.36.254:37621 was elected leader, sending a full tablet report...
I20260811 08:06:24.296075 30331 tablet_bootstrap.cc:654] T 30d3553afe7e46aca92a1c7c634857e9 P 0c52f106cbdf42179d43a85ef8855cae: Neither blocks nor log segments found. Creating new log.
I20260811 08:06:24.296674 30331 log.cc:824] T 30d3553afe7e46aca92a1c7c634857e9 P 0c52f106cbdf42179d43a85ef8855cae: Log is configured to *not* fsync() on all Append() calls
I20260811 08:06:24.297736 30331 tablet_bootstrap.cc:492] T 30d3553afe7e46aca92a1c7c634857e9 P 0c52f106cbdf42179d43a85ef8855cae: No bootstrap required, opened a new log
I20260811 08:06:24.297816 30331 ts_tablet_manager.cc:1397] T 30d3553afe7e46aca92a1c7c634857e9 P 0c52f106cbdf42179d43a85ef8855cae: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 08:06:24.300593 30331 raft_consensus.cc:348] T 30d3553afe7e46aca92a1c7c634857e9 P 0c52f106cbdf42179d43a85ef8855cae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c52f106cbdf42179d43a85ef8855cae" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 38463 } } peers { permanent_uuid: "100d3fa60c8d48578b0b7fb58579dd71" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 45595 } } peers { permanent_uuid: "e68dfd5e9284483cb007648e1546f088" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 35627 } }
I20260811 08:06:24.300832 30331 raft_consensus.cc:374] T 30d3553afe7e46aca92a1c7c634857e9 P 0c52f106cbdf42179d43a85ef8855cae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:06:24.300885 30331 raft_consensus.cc:729] T 30d3553afe7e46aca92a1c7c634857e9 P 0c52f106cbdf42179d43a85ef8855cae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c52f106cbdf42179d43a85ef8855cae, State: Initialized, Role: FOLLOWER
I20260811 08:06:24.301049 30331 consensus_queue.cc:260] T 30d3553afe7e46aca92a1c7c634857e9 P 0c52f106cbdf42179d43a85ef8855cae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c52f106cbdf42179d43a85ef8855cae" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 38463 } } peers { permanent_uuid: "100d3fa60c8d48578b0b7fb58579dd71" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 45595 } } peers { permanent_uuid: "e68dfd5e9284483cb007648e1546f088" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 35627 } }
I20260811 08:06:24.301378 30331 ts_tablet_manager.cc:1428] T 30d3553afe7e46aca92a1c7c634857e9 P 0c52f106cbdf42179d43a85ef8855cae: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 08:06:24.301436 30143 heartbeater.cc:503] Master 127.15.36.254:37621 was elected leader, sending a full tablet report...
W20260811 08:06:24.302778 29998 tablet.cc:2369] T 30d3553afe7e46aca92a1c7c634857e9 P e68dfd5e9284483cb007648e1546f088: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:06:24.441251 30332 raft_consensus.cc:482] T 30d3553afe7e46aca92a1c7c634857e9 P 100d3fa60c8d48578b0b7fb58579dd71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:06:24.441432 30332 raft_consensus.cc:504] T 30d3553afe7e46aca92a1c7c634857e9 P 100d3fa60c8d48578b0b7fb58579dd71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c52f106cbdf42179d43a85ef8855cae" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 38463 } } peers { permanent_uuid: "100d3fa60c8d48578b0b7fb58579dd71" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 45595 } } peers { permanent_uuid: "e68dfd5e9284483cb007648e1546f088" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 35627 } }
I20260811 08:06:24.441883 30332 leader_election.cc:288] T 30d3553afe7e46aca92a1c7c634857e9 P 100d3fa60c8d48578b0b7fb58579dd71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c52f106cbdf42179d43a85ef8855cae (127.15.36.194:38463), e68dfd5e9284483cb007648e1546f088 (127.15.36.193:35627)
I20260811 08:06:24.446211 30325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:24.442340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:57713 (local address 127.15.36.194:38463)
0811 08:06:24.442385 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 08:06:24.442388 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:06:24.442514 (+ 126us) server_negotiation.cc:407] Connection header received
0811 08:06:24.442629 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:06:24.442630 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:06:24.442640 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:06:24.442682 (+ 42us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:06:24.442912 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:24.443662 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:24.445232 (+ 1570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:24.445799 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:24.445849 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:24.445859 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 08:06:24.446100 (+ 241us) server_negotiation.cc:299] Negotiation successful
0811 08:06:24.446139 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 08:06:24.446301 30323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:24.442389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:33509 (local address 127.15.36.193:35627)
0811 08:06:24.442432 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 08:06:24.442434 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:06:24.442561 (+ 127us) server_negotiation.cc:407] Connection header received
0811 08:06:24.442673 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:06:24.442674 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:06:24.442684 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:06:24.442714 (+ 30us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:06:24.442951 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:24.443675 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:24.445232 (+ 1557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:24.445805 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:24.445857 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:24.445866 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 08:06:24.446156 (+ 290us) server_negotiation.cc:299] Negotiation successful
0811 08:06:24.446233 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 08:06:24.446586 30335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:24.442171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.193:35627 (local address 127.15.36.195:33509)
0811 08:06:24.442493 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:24.442504 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:06:24.442594 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:06:24.442785 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:06:24.442786 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:06:24.442788 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:06:24.442860 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:24.442862 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:24.443785 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:24.443786 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:24.445122 (+ 1336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:24.445125 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:24.445956 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:24.445957 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:24.446045 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:24.446049 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:06:24.446440 (+ 391us) client_negotiation.cc:240] Negotiation successful
0811 08:06:24.446487 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":304,"mutex_wait_us":81,"thread_start_us":93,"threads_started":1}
I20260811 08:06:24.446753 30336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:24.442089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.194:38463 (local address 127.15.36.195:57713)
0811 08:06:24.442445 (+ 356us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:24.442456 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:06:24.442543 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:06:24.442752 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:06:24.442753 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:06:24.442755 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:06:24.442837 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:24.442840 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:24.443765 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:24.443766 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:24.445119 (+ 1353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:24.445122 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:24.445944 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:24.445945 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:24.446021 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:24.446024 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:06:24.446623 (+ 599us) client_negotiation.cc:240] Negotiation successful
0811 08:06:24.446670 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":338,"mutex_wait_us":55,"thread_start_us":115,"threads_started":1}
I20260811 08:06:24.447118 29943 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30d3553afe7e46aca92a1c7c634857e9" candidate_uuid: "100d3fa60c8d48578b0b7fb58579dd71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e68dfd5e9284483cb007648e1546f088" is_pre_election: true
I20260811 08:06:24.447304 29943 raft_consensus.cc:2454] T 30d3553afe7e46aca92a1c7c634857e9 P e68dfd5e9284483cb007648e1546f088 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 100d3fa60c8d48578b0b7fb58579dd71 in term 0.
I20260811 08:06:24.447257 30083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30d3553afe7e46aca92a1c7c634857e9" candidate_uuid: "100d3fa60c8d48578b0b7fb58579dd71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c52f106cbdf42179d43a85ef8855cae" is_pre_election: true
I20260811 08:06:24.447414 30083 raft_consensus.cc:2454] T 30d3553afe7e46aca92a1c7c634857e9 P 0c52f106cbdf42179d43a85ef8855cae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 100d3fa60c8d48578b0b7fb58579dd71 in term 0.
I20260811 08:06:24.447569 30169 leader_election.cc:302] T 30d3553afe7e46aca92a1c7c634857e9 P 100d3fa60c8d48578b0b7fb58579dd71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 100d3fa60c8d48578b0b7fb58579dd71, e68dfd5e9284483cb007648e1546f088; no voters:
I20260811 08:06:24.447739 30332 raft_consensus.cc:2781] T 30d3553afe7e46aca92a1c7c634857e9 P 100d3fa60c8d48578b0b7fb58579dd71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:06:24.447801 30332 raft_consensus.cc:482] T 30d3553afe7e46aca92a1c7c634857e9 P 100d3fa60c8d48578b0b7fb58579dd71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:06:24.447832 30332 raft_consensus.cc:3037] T 30d3553afe7e46aca92a1c7c634857e9 P 100d3fa60c8d48578b0b7fb58579dd71 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:06:24.448840 30332 raft_consensus.cc:504] T 30d3553afe7e46aca92a1c7c634857e9 P 100d3fa60c8d48578b0b7fb58579dd71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c52f106cbdf42179d43a85ef8855cae" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 38463 } } peers { permanent_uuid: "100d3fa60c8d48578b0b7fb58579dd71" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 45595 } } peers { permanent_uuid: "e68dfd5e9284483cb007648e1546f088" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 35627 } }
I20260811 08:06:24.449160 30332 leader_election.cc:288] T 30d3553afe7e46aca92a1c7c634857e9 P 100d3fa60c8d48578b0b7fb58579dd71 [CANDIDATE]: Term 1 election: Requested vote from peers 0c52f106cbdf42179d43a85ef8855cae (127.15.36.194:38463), e68dfd5e9284483cb007648e1546f088 (127.15.36.193:35627)
I20260811 08:06:24.449476 30083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30d3553afe7e46aca92a1c7c634857e9" candidate_uuid: "100d3fa60c8d48578b0b7fb58579dd71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c52f106cbdf42179d43a85ef8855cae"
I20260811 08:06:24.449568 30083 raft_consensus.cc:3037] T 30d3553afe7e46aca92a1c7c634857e9 P 0c52f106cbdf42179d43a85ef8855cae [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:06:24.450515 30083 raft_consensus.cc:2454] T 30d3553afe7e46aca92a1c7c634857e9 P 0c52f106cbdf42179d43a85ef8855cae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 100d3fa60c8d48578b0b7fb58579dd71 in term 1.
I20260811 08:06:24.450766 30165 leader_election.cc:302] T 30d3553afe7e46aca92a1c7c634857e9 P 100d3fa60c8d48578b0b7fb58579dd71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c52f106cbdf42179d43a85ef8855cae, 100d3fa60c8d48578b0b7fb58579dd71; no voters:
I20260811 08:06:24.451155 29943 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30d3553afe7e46aca92a1c7c634857e9" candidate_uuid: "100d3fa60c8d48578b0b7fb58579dd71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e68dfd5e9284483cb007648e1546f088"
I20260811 08:06:24.451253 29943 raft_consensus.cc:3037] T 30d3553afe7e46aca92a1c7c634857e9 P e68dfd5e9284483cb007648e1546f088 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:06:24.451596 30332 raft_consensus.cc:2781] T 30d3553afe7e46aca92a1c7c634857e9 P 100d3fa60c8d48578b0b7fb58579dd71 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:06:24.451776 30332 raft_consensus.cc:686] T 30d3553afe7e46aca92a1c7c634857e9 P 100d3fa60c8d48578b0b7fb58579dd71 [term 1 LEADER]: Becoming Leader. State: Replica: 100d3fa60c8d48578b0b7fb58579dd71, State: Running, Role: LEADER
I20260811 08:06:24.451881 30332 consensus_queue.cc:237] T 30d3553afe7e46aca92a1c7c634857e9 P 100d3fa60c8d48578b0b7fb58579dd71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c52f106cbdf42179d43a85ef8855cae" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 38463 } } peers { permanent_uuid: "100d3fa60c8d48578b0b7fb58579dd71" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 45595 } } peers { permanent_uuid: "e68dfd5e9284483cb007648e1546f088" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 35627 } }
I20260811 08:06:24.452236 29943 raft_consensus.cc:2454] T 30d3553afe7e46aca92a1c7c634857e9 P e68dfd5e9284483cb007648e1546f088 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 100d3fa60c8d48578b0b7fb58579dd71 in term 1.
I20260811 08:06:24.453083 29781 catalog_manager.cc:5495] T 30d3553afe7e46aca92a1c7c634857e9 P 100d3fa60c8d48578b0b7fb58579dd71 reported cstate change: term changed from 0 to 1, leader changed from <none> to 100d3fa60c8d48578b0b7fb58579dd71 (127.15.36.195). New cstate: current_term: 1 leader_uuid: "100d3fa60c8d48578b0b7fb58579dd71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c52f106cbdf42179d43a85ef8855cae" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 38463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "100d3fa60c8d48578b0b7fb58579dd71" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 45595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e68dfd5e9284483cb007648e1546f088" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 35627 } health_report { overall_health: UNKNOWN } } }
W20260811 08:06:24.467008 30290 tablet.cc:2369] T 30d3553afe7e46aca92a1c7c634857e9 P 100d3fa60c8d48578b0b7fb58579dd71: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 11 08:06:24 dist-test-slave-2w3w krb5kdc[28666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435583, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.254@KRBTEST.COM for HTTP/127.15.36.212@KRBTEST.COM
I20260811 08:06:24.505156 30322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:24.501607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53332 (local address 127.15.36.195:45595)
0811 08:06:24.501655 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 08:06:24.501657 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:06:24.501668 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:06:24.501735 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:06:24.501735 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:06:24.501754 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:06:24.501841 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:06:24.502024 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:24.502796 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:24.503985 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:24.504293 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:24.504357 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:24.504573 (+ 216us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:06:24.504715 (+ 142us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:06:24.504791 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 08:06:24.505042 (+ 251us) server_negotiation.cc:299] Negotiation successful
0811 08:06:24.505067 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 08:06:24.509630 30083 raft_consensus.cc:1261] T 30d3553afe7e46aca92a1c7c634857e9 P 0c52f106cbdf42179d43a85ef8855cae [term 1 FOLLOWER]: Refusing update from remote peer 100d3fa60c8d48578b0b7fb58579dd71: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:06:24.509630 29943 raft_consensus.cc:1261] T 30d3553afe7e46aca92a1c7c634857e9 P e68dfd5e9284483cb007648e1546f088 [term 1 FOLLOWER]: Refusing update from remote peer 100d3fa60c8d48578b0b7fb58579dd71: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:06:24.510012 30338 consensus_queue.cc:1035] T 30d3553afe7e46aca92a1c7c634857e9 P 100d3fa60c8d48578b0b7fb58579dd71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e68dfd5e9284483cb007648e1546f088" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 35627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:06:24.510133 30332 consensus_queue.cc:1035] T 30d3553afe7e46aca92a1c7c634857e9 P 100d3fa60c8d48578b0b7fb58579dd71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c52f106cbdf42179d43a85ef8855cae" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 38463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 08:06:24.514497 30145 tablet.cc:2369] T 30d3553afe7e46aca92a1c7c634857e9 P 0c52f106cbdf42179d43a85ef8855cae: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:06:24.516366 30342 mvcc.cc:205] Tried to move back new op lower bound from 7317240154141339648 to 7317240153915473920. Current Snapshot: MvccSnapshot[applied={T|T < 7317240154141339648}]
I20260811 08:06:24.516598 30344 mvcc.cc:205] Tried to move back new op lower bound from 7317240154141339648 to 7317240153915473920. Current Snapshot: MvccSnapshot[applied={T|T < 7317240154141339648}]
I20260811 08:06:24.519119 30343 mvcc.cc:205] Tried to move back new op lower bound from 7317240154141339648 to 7317240153915473920. Current Snapshot: MvccSnapshot[applied={T|T < 7317240154141339648}]
I20260811 08:06:24.521746 29781 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49940:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:06:24.521878 29781 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49940:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:06:24.522745 29781 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b27dea39d6cf437881b21f4c62b60efa: Sending DeleteTablet for 3 replicas of tablet 30d3553afe7e46aca92a1c7c634857e9
I20260811 08:06:24.523222 30061 tablet_service.cc:1514] Processing DeleteTablet for tablet 30d3553afe7e46aca92a1c7c634857e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:06:24 UTC) from {username='kudu', principal='kudu/127.15.36.254@KRBTEST.COM'} at 127.0.0.1:39688
I20260811 08:06:24.523341 29925 tablet_service.cc:1514] Processing DeleteTablet for tablet 30d3553afe7e46aca92a1c7c634857e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:06:24 UTC) from {username='kudu', principal='kudu/127.15.36.254@KRBTEST.COM'} at 127.0.0.1:49816
I20260811 08:06:24.523829 30217 tablet_service.cc:1514] Processing DeleteTablet for tablet 30d3553afe7e46aca92a1c7c634857e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:06:24 UTC) from {username='kudu', principal='kudu/127.15.36.254@KRBTEST.COM'} at 127.0.0.1:53330
I20260811 08:06:24.524407 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 29823
I20260811 08:06:24.531098 30351 tablet_replica.cc:330] T 30d3553afe7e46aca92a1c7c634857e9 P 0c52f106cbdf42179d43a85ef8855cae: stopping tablet replica
I20260811 08:06:24.531286 30351 raft_consensus.cc:2229] T 30d3553afe7e46aca92a1c7c634857e9 P 0c52f106cbdf42179d43a85ef8855cae [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:06:24.531443 30351 raft_consensus.cc:2258] T 30d3553afe7e46aca92a1c7c634857e9 P 0c52f106cbdf42179d43a85ef8855cae [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 08:06:24.536556 29768 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.36.193:35627 (error 108)
I20260811 08:06:24.537757 30353 tablet_replica.cc:330] T 30d3553afe7e46aca92a1c7c634857e9 P 100d3fa60c8d48578b0b7fb58579dd71: stopping tablet replica
I20260811 08:06:24.537874 30351 ts_tablet_manager.cc:1905] T 30d3553afe7e46aca92a1c7c634857e9 P 0c52f106cbdf42179d43a85ef8855cae: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:06:24.538002 30353 raft_consensus.cc:2229] T 30d3553afe7e46aca92a1c7c634857e9 P 100d3fa60c8d48578b0b7fb58579dd71 [term 1 LEADER]: Raft consensus shutting down.
I20260811 08:06:24.538215 30353 raft_consensus.cc:2258] T 30d3553afe7e46aca92a1c7c634857e9 P 100d3fa60c8d48578b0b7fb58579dd71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:06:24.538225 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 30001
I20260811 08:06:24.542595 30353 ts_tablet_manager.cc:1905] T 30d3553afe7e46aca92a1c7c634857e9 P 100d3fa60c8d48578b0b7fb58579dd71: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:06:24.545969 30324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:24.545809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.193:35627 (local address 127.0.0.1:49832)
0811 08:06:24.545874 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:24.545920 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.193:35627: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260811 08:06:24.546221 29768 catalog_manager.cc:4584] TS e68dfd5e9284483cb007648e1546f088 (127.15.36.193:35627): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 30d3553afe7e46aca92a1c7c634857e9: Network error: Client connection negotiation failed: client connection to 127.15.36.193:35627: connect: Connection refused (error 111)
I20260811 08:06:24.546509 30353 ts_tablet_manager.cc:1918] T 30d3553afe7e46aca92a1c7c634857e9 P 100d3fa60c8d48578b0b7fb58579dd71: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:06:24.546636 30353 log.cc:1196] T 30d3553afe7e46aca92a1c7c634857e9 P 100d3fa60c8d48578b0b7fb58579dd71: Deleting WAL directory at /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786435400844580-15507-0/minicluster-data/ts-2/wal/wals/30d3553afe7e46aca92a1c7c634857e9
I20260811 08:06:24.547050 30353 ts_tablet_manager.cc:1939] T 30d3553afe7e46aca92a1c7c634857e9 P 100d3fa60c8d48578b0b7fb58579dd71: Deleting consensus metadata
I20260811 08:06:24.547631 29767 catalog_manager.cc:4841] TS 100d3fa60c8d48578b0b7fb58579dd71 (127.15.36.195:45595): tablet 30d3553afe7e46aca92a1c7c634857e9 (table test-table [id=38b7a013166244ce98825ae1e0b51e62]) successfully deleted
W20260811 08:06:24.551959 30324 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:06:24.551549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.194:38463 (local address 127.0.0.1:39704)
0811 08:06:24.551606 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:24.551618 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:06:24.551658 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:06:24.551899 (+ 241us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.194:38463: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":37}
I20260811 08:06:24.552619 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 30146
I20260811 08:06:24.563688 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 29748
I20260811 08:06:24.574015 15507 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260811 08:06:24.919977 15507 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260811 08:06:24.920117 15507 mini_ranger.cc:66] Stopping Ranger...
I20260811 08:06:25.265159 15507 mini_ranger.cc:68] Stopped Ranger
2026-08-11 08:06:25.265 UTC [28698] LOG: received smart shutdown request
2026-08-11 08:06:25.270 UTC [28698] LOG: background worker "logical replication launcher" (PID 28707) exited with exit code 1
2026-08-11 08:06:25.271 UTC [28702] LOG: shutting down
2026-08-11 08:06:25.494 UTC [28698] LOG: database system is shut down
2026-08-11T08:06:25Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (54186 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:06:25 dist-test-slave-2w3w krb5kdc[30368](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:06:25 dist-test-slave-2w3w krb5kdc[30368](info): set up 2 sockets
Aug 11 08:06:25 dist-test-slave-2w3w krb5kdc[30368](info): commencing operation
krb5kdc: starting...
W20260811 08:06:26.730381 15507 mini_kdc.cc:121] Time spent starting KDC: real 1.096s user 0.001s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Aug 11 08:06:26 dist-test-slave-2w3w krb5kdc[30368](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435586, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:06:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:06:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.36.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab.
Entry for principal kudu/127.15.36.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab.
I20260811 08:06:26.866143 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:33245
--webserver_interface=127.15.36.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=kudu/127.15.36.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:32813
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.36.254:33245,127.15.36.253:42975,127.15.36.252:35497
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:06:26.950469 30385 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:06:26.950729 30385 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:06:26.950769 30385 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:06:26.951992 30385 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:06:26.952065 30385 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:06:26.952091 30385 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:06:26.952124 30385 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:06:26.952152 30385 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:06:26.953816 30385 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:32813
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.36.254:33245,127.15.36.253:42975,127.15.36.252:35497
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=kudu/127.15.36.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:33245
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.36.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30385
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:06:26.954121 30385 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:06:26.954353 30385 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:06:26.959674 30397 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:06:26.959681 30395 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:06:26.959905 30385 server_base.cc:1034] running on GCE node
W20260811 08:06:26.959719 30394 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:06:26.960253 30385 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:06:26.960593 30385 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:06:26.961768 30385 hybrid_clock.cc:648] HybridClock initialized: now 1786435586961729 us; error 72 us; skew 500 ppm
Aug 11 08:06:26 dist-test-slave-2w3w krb5kdc[30368](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435586, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:06:26.964562 30385 init.cc:377] Logged in from keytab as kudu/127.15.36.254@KRBTEST.COM (short username kudu)
I20260811 08:06:26.965058 30385 webserver.cc:460] Webserver started at http://127.15.36.254:38315/ using document root <none> and password file <none>
I20260811 08:06:26.965308 30385 fs_manager.cc:359] Metadata directory not provided
I20260811 08:06:26.965378 30385 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:06:26.965531 30385 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:06:26.966637 30385 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/minicluster-data/master-0/data/instance:
uuid: "d447b11f882243b691b626038a5924ea"
format_stamp: "Formatted at 2026-08-11 08:06:26 on dist-test-slave-2w3w"
server_key: "0652aee3fbb19285e47281e63aa17f57"
server_key_iv: "5993f2ab00bea7b8fea9c090ccf33390"
server_key_version: "encryptionkey@0"
I20260811 08:06:26.967077 30385 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/minicluster-data/master-0/wal/instance:
uuid: "d447b11f882243b691b626038a5924ea"
format_stamp: "Formatted at 2026-08-11 08:06:26 on dist-test-slave-2w3w"
server_key: "0652aee3fbb19285e47281e63aa17f57"
server_key_iv: "5993f2ab00bea7b8fea9c090ccf33390"
server_key_version: "encryptionkey@0"
I20260811 08:06:26.968509 30385 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:06:26.969339 30405 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:06:26.969676 30385 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:06:26.969791 30385 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/minicluster-data/master-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/minicluster-data/master-0/wal
uuid: "d447b11f882243b691b626038a5924ea"
format_stamp: "Formatted at 2026-08-11 08:06:26 on dist-test-slave-2w3w"
server_key: "0652aee3fbb19285e47281e63aa17f57"
server_key_iv: "5993f2ab00bea7b8fea9c090ccf33390"
server_key_version: "encryptionkey@0"
I20260811 08:06:26.969873 30385 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:06:26.985091 30385 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:06:26.987223 30385 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:06:26.987407 30385 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:06:26.991871 30385 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.254:33245
I20260811 08:06:26.991979 30464 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.254:33245 every 8 connection(s)
I20260811 08:06:26.992327 30385 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
I20260811 08:06:26.993199 30466 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:06:26.994854 30466 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.36.254" port: 33245 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 08:06:26 dist-test-slave-2w3w krb5kdc[30368](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435586, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.254@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:06:27.002290 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 30385
I20260811 08:06:27.002427 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/minicluster-data/master-0/wal/instance
I20260811 08:06:27.002655 15507 external_mini_cluster.cc:1428] Setting key 2c7884c9d19bb8afce58abcc108b557d
I20260811 08:06:27.006116 30468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:26.995674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:33245 (local address 127.0.0.1:44700)
0811 08:06:26.995862 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:26.995908 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 08:06:26.996366 (+ 458us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:06:26.996609 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:06:26.996611 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:06:26.996876 (+ 265us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:06:26.997040 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:26.997044 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:26.998115 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:26.998117 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:26.998949 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:26.998951 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:26.999479 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:26.999479 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:26.999544 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:27.000222 (+ 678us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:06:27.000231 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:06:27.001771 (+ 1540us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:06:27.004153 (+ 2382us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:06:27.004162 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:06:27.004165 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:06:27.004491 (+ 326us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:06:27.004842 (+ 351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:06:27.004843 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:06:27.004843 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:06:27.004954 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:06:27.005546 (+ 592us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:06:27.005553 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:06:27.005623 (+ 70us) client_negotiation.cc:769] Sending connection context
0811 08:06:27.005722 (+ 99us) client_negotiation.cc:240] Negotiation successful
0811 08:06:27.005928 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":105,"threads_started":1}
I20260811 08:06:27.006290 30469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:26.995688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44700 (local address 127.15.36.254:33245)
0811 08:06:26.995878 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0811 08:06:26.995889 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 08:06:26.996003 (+ 114us) server_negotiation.cc:407] Connection header received
0811 08:06:26.996499 (+ 496us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:06:26.996501 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:06:26.996518 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:06:26.996607 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:06:26.997131 (+ 524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:26.997981 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:26.999069 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:26.999393 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:26.999486 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:27.001880 (+ 2394us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:06:27.001887 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:06:27.001887 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:06:27.001894 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:06:27.003952 (+ 2058us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:27.004599 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:27.004603 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:27.004603 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:27.004737 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:27.005062 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:27.005063 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:27.005063 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:27.005450 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:06:27.005553 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 08:06:27.005787 (+ 234us) server_negotiation.cc:299] Negotiation successful
0811 08:06:27.006091 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":192,"server-negotiator.queue_time_us":146,"thread_start_us":115,"threads_started":1}
I20260811 08:06:27.007100 30466 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.36.253" port: 42975 } has no permanent_uuid. Determining permanent_uuid...
I20260811 08:06:27.007529 30468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:27.007384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.253:42975 (local address 127.0.0.1:51916)
0811 08:06:27.007444 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:27.007502 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.253:42975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260811 08:06:27.007726 30406 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.36.253:42975: connect: Connection refused (error 111)
I20260811 08:06:27.008248 30468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:27.008139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.253:42975 (local address 127.0.0.1:51918)
0811 08:06:27.008193 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:27.008229 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.253:42975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260811 08:06:27.008379 30466 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.36.253:42975: Network error: Client connection negotiation failed: client connection to 127.15.36.253:42975: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.15.36.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.253.keytab.
Entry for principal kudu/127.15.36.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.253.keytab.
I20260811 08:06:27.033679 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.253:42975
--webserver_interface=127.15.36.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.253.keytab
--principal=kudu/127.15.36.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:32813
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.36.254:33245,127.15.36.253:42975,127.15.36.252:35497
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 08:06:27.057636 30466 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.36.253" port: 42975 } attempt: 1
I20260811 08:06:27.058156 30468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:27.057992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.253:42975 (local address 127.0.0.1:51922)
0811 08:06:27.058057 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:27.058109 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.253:42975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260811 08:06:27.058573 30468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:27.058467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.253:42975 (local address 127.0.0.1:51924)
0811 08:06:27.058519 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:27.058548 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.253:42975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260811 08:06:27.058702 30466 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.36.253:42975: Network error: Client connection negotiation failed: client connection to 127.15.36.253:42975: connect: Connection refused (error 111)
I20260811 08:06:27.126873 30466 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.36.253" port: 42975 } attempt: 2
I20260811 08:06:27.127477 30468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:27.127320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.253:42975 (local address 127.0.0.1:51928)
0811 08:06:27.127399 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:27.127445 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.253:42975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260811 08:06:27.127895 30468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:27.127806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.253:42975 (local address 127.0.0.1:51936)
0811 08:06:27.127849 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:27.127876 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.253:42975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260811 08:06:27.128031 30466 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.36.253:42975: Network error: Client connection negotiation failed: client connection to 127.15.36.253:42975: connect: Connection refused (error 111)
W20260811 08:06:27.129952 30473 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:06:27.130152 30473 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:06:27.130177 30473 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:06:27.131371 30473 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:06:27.131413 30473 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:06:27.131428 30473 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:06:27.131440 30473 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:06:27.131453 30473 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:06:27.132951 30473 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:32813
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.15.36.254:33245,127.15.36.253:42975,127.15.36.252:35497
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.253.keytab
--principal=kudu/127.15.36.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.253:42975
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.15.36.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30473
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:06:27.133148 30473 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:06:27.133325 30473 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:06:27.138226 30479 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:06:27.138253 30481 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:06:27.138257 30478 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:06:27.138933 30473 server_base.cc:1034] running on GCE node
I20260811 08:06:27.139246 30473 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:06:27.139634 30473 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:06:27.140867 30473 hybrid_clock.cc:648] HybridClock initialized: now 1786435587140830 us; error 51 us; skew 500 ppm
Aug 11 08:06:27 dist-test-slave-2w3w krb5kdc[30368](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435587, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:06:27.144186 30473 init.cc:377] Logged in from keytab as kudu/127.15.36.253@KRBTEST.COM (short username kudu)
I20260811 08:06:27.144652 30473 webserver.cc:460] Webserver started at http://127.15.36.253:35347/ using document root <none> and password file <none>
I20260811 08:06:27.144891 30473 fs_manager.cc:359] Metadata directory not provided
I20260811 08:06:27.144938 30473 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:06:27.145120 30473 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:06:27.146247 30473 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/minicluster-data/master-1/data/instance:
uuid: "38bb62d63d0a4509ad4d72dc434f1e4d"
format_stamp: "Formatted at 2026-08-11 08:06:27 on dist-test-slave-2w3w"
server_key: "2eec4f82421fe1306c981d314140a0b0"
server_key_iv: "ea4af7fa041f7a753c8427e17ddb548b"
server_key_version: "encryptionkey@0"
I20260811 08:06:27.146626 30473 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/minicluster-data/master-1/wal/instance:
uuid: "38bb62d63d0a4509ad4d72dc434f1e4d"
format_stamp: "Formatted at 2026-08-11 08:06:27 on dist-test-slave-2w3w"
server_key: "2eec4f82421fe1306c981d314140a0b0"
server_key_iv: "ea4af7fa041f7a753c8427e17ddb548b"
server_key_version: "encryptionkey@0"
I20260811 08:06:27.148058 30473 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 08:06:27.148778 30489 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:06:27.148964 30473 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:06:27.149056 30473 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/minicluster-data/master-1/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/minicluster-data/master-1/wal
uuid: "38bb62d63d0a4509ad4d72dc434f1e4d"
format_stamp: "Formatted at 2026-08-11 08:06:27 on dist-test-slave-2w3w"
server_key: "2eec4f82421fe1306c981d314140a0b0"
server_key_iv: "ea4af7fa041f7a753c8427e17ddb548b"
server_key_version: "encryptionkey@0"
I20260811 08:06:27.149135 30473 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:06:27.166738 30473 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:06:27.168713 30473 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:06:27.168833 30473 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:06:27.173080 30473 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.253:42975
I20260811 08:06:27.173137 30552 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.253:42975 every 8 connection(s)
I20260811 08:06:27.173524 30473 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/minicluster-data/master-1/data/info.pb
I20260811 08:06:27.174469 30553 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:06:27.176084 30553 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.36.254" port: 33245 } has no permanent_uuid. Determining permanent_uuid...
I20260811 08:06:27.180054 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 30473
I20260811 08:06:27.180143 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/minicluster-data/master-1/wal/instance
I20260811 08:06:27.180276 15507 external_mini_cluster.cc:1428] Setting key 04c665a86835cb1a46b2371b6b6a8a9a
Aug 11 08:06:27 dist-test-slave-2w3w krb5kdc[30368](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435587, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.253@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.15.36.252@KRBTEST.COM; defaulting to no policy
I20260811 08:06:27.190003 30469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:27.176778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44710 (local address 127.15.36.254:33245)
0811 08:06:27.176847 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 08:06:27.176850 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:06:27.177057 (+ 207us) server_negotiation.cc:407] Connection header received
0811 08:06:27.177501 (+ 444us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:06:27.177502 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:06:27.177515 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:06:27.177567 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:06:27.178146 (+ 579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:27.178638 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:27.179657 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:27.179854 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:27.179910 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:27.182450 (+ 2540us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:06:27.182451 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:06:27.182451 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:06:27.182462 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:06:27.188418 (+ 5956us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:27.188871 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:27.188873 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:27.188873 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:27.188963 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:27.189262 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:27.189264 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:27.189264 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:27.189409 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:06:27.189490 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 08:06:27.189798 (+ 308us) server_negotiation.cc:299] Negotiation successful
0811 08:06:27.189897 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 08:06:27.190251 30555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:27.176769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:33245 (local address 127.0.0.1:44710)
0811 08:06:27.176939 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:27.176974 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 08:06:27.177422 (+ 448us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:06:27.177617 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:06:27.177620 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:06:27.177879 (+ 259us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:06:27.178074 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:27.178078 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:27.178720 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:27.178721 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:27.179584 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:27.179587 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:27.180262 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:27.180262 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:27.180417 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:27.180965 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:06:27.180973 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:06:27.182343 (+ 1370us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:06:27.188519 (+ 6176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:06:27.188531 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:06:27.188534 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:06:27.188794 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:06:27.189045 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:06:27.189047 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:06:27.189047 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:06:27.189187 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:06:27.189482 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:06:27.189490 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:06:27.189652 (+ 162us) client_negotiation.cc:769] Sending connection context
0811 08:06:27.189765 (+ 113us) client_negotiation.cc:240] Negotiation successful
0811 08:06:27.189986 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":108,"threads_started":1}
I20260811 08:06:27.190855 30553 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.36.253" port: 42975 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.252@KRBTEST.COM" created.
Aug 11 08:06:27 dist-test-slave-2w3w krb5kdc[30368](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435587, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.253@KRBTEST.COM for kudu/127.15.36.253@KRBTEST.COM
I20260811 08:06:27.199710 30555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:27.191311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.253:42975 (local address 127.0.0.1:51942)
0811 08:06:27.191366 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:27.191377 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:06:27.191422 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:06:27.191704 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:06:27.191706 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:06:27.191883 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:06:27.191949 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:27.191951 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:27.192821 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:27.192822 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:27.193467 (+ 645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:27.193469 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:27.194147 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:27.194148 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:27.194207 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:27.194693 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:06:27.194698 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:06:27.196317 (+ 1619us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:06:27.198595 (+ 2278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:06:27.198596 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:06:27.198596 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:06:27.198762 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:06:27.199044 (+ 282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:06:27.199044 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:06:27.199044 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:06:27.199100 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:06:27.199456 (+ 356us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:06:27.199457 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:06:27.199495 (+ 38us) client_negotiation.cc:769] Sending connection context
0811 08:06:27.199547 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 08:06:27.199635 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260811 08:06:27.199877 30557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:27.191375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51942 (local address 127.15.36.253:42975)
0811 08:06:27.191565 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0811 08:06:27.191569 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:06:27.191583 (+ 14us) server_negotiation.cc:407] Connection header received
0811 08:06:27.191599 (+ 16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:06:27.191601 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:06:27.191611 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:06:27.191670 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:06:27.192031 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:27.192730 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:27.193554 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:27.194063 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:27.194142 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:27.196405 (+ 2263us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:06:27.196416 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:06:27.196416 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:06:27.196424 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:06:27.198497 (+ 2073us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:27.198856 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:27.198859 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:27.198860 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:27.198928 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:27.199169 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:27.199170 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:27.199170 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:27.199383 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:06:27.199480 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0811 08:06:27.199584 (+ 104us) server_negotiation.cc:299] Negotiation successful
0811 08:06:27.199726 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":32,"server-negotiator.queue_time_us":155,"thread_start_us":117,"threads_started":1}
I20260811 08:06:27.200464 30553 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.36.252" port: 35497 } has no permanent_uuid. Determining permanent_uuid...
I20260811 08:06:27.200857 30555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:27.200734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.252:35497 (local address 127.0.0.1:60678)
0811 08:06:27.200787 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:27.200838 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.252:35497: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260811 08:06:27.201064 30493 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.36.252:35497: connect: Connection refused (error 111)
I20260811 08:06:27.201471 30555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:27.201383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.252:35497 (local address 127.0.0.1:60682)
0811 08:06:27.201432 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:27.201456 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.252:35497: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260811 08:06:27.201591 30553 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.36.252:35497: Network error: Client connection negotiation failed: client connection to 127.15.36.252:35497: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.252.keytab.
Entry for principal kudu/127.15.36.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.252.keytab.
I20260811 08:06:27.211220 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.252:35497
--webserver_interface=127.15.36.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.252.keytab
--principal=kudu/127.15.36.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:32813
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.36.254:33245,127.15.36.253:42975,127.15.36.252:35497
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 08:06:27.219177 30466 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.36.253" port: 42975 } attempt: 3
Aug 11 08:06:27 dist-test-slave-2w3w krb5kdc[30368](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435586, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.254@KRBTEST.COM for kudu/127.15.36.253@KRBTEST.COM
I20260811 08:06:27.226609 30468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:27.219563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.253:42975 (local address 127.0.0.1:51958)
0811 08:06:27.219624 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:27.219643 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 08:06:27.219725 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:06:27.219919 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:06:27.219920 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:06:27.220089 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:06:27.220171 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:27.220173 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:27.220888 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:27.220889 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:27.221426 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:27.221427 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:27.221833 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:27.221834 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:27.221925 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:27.222418 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:06:27.222423 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:06:27.223905 (+ 1482us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:06:27.225524 (+ 1619us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:06:27.225526 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:06:27.225527 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:06:27.225703 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:06:27.225917 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:06:27.225918 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:06:27.225918 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:06:27.225986 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:06:27.226243 (+ 257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:06:27.226245 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:06:27.226294 (+ 49us) client_negotiation.cc:769] Sending connection context
0811 08:06:27.226397 (+ 103us) client_negotiation.cc:240] Negotiation successful
0811 08:06:27.226505 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260811 08:06:27.226609 30557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:27.219640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51958 (local address 127.15.36.253:42975)
0811 08:06:27.219712 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 08:06:27.219715 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:06:27.219726 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:06:27.219797 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:06:27.219798 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:06:27.219810 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:06:27.219880 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:06:27.220256 (+ 376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:27.220783 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:27.221515 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:27.221750 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:27.221835 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:27.224004 (+ 2169us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:06:27.224006 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:06:27.224006 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:06:27.224015 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:06:27.225431 (+ 1416us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:27.225780 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:27.225781 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:27.225781 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:27.225845 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:27.226057 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:27.226058 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:27.226058 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:27.226176 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:06:27.226252 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 08:06:27.226422 (+ 170us) server_negotiation.cc:299] Negotiation successful
0811 08:06:27.226507 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 08:06:27.227294 30466 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.36.252" port: 35497 } has no permanent_uuid. Determining permanent_uuid...
I20260811 08:06:27.227660 30468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:27.227563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.252:35497 (local address 127.0.0.1:60690)
0811 08:06:27.227610 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:27.227641 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.252:35497: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260811 08:06:27.227981 30468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:27.227892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.252:35497 (local address 127.0.0.1:60704)
0811 08:06:27.227937 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:27.227960 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.252:35497: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260811 08:06:27.228083 30466 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.36.252:35497: Network error: Client connection negotiation failed: client connection to 127.15.36.252:35497: connect: Connection refused (error 111)
I20260811 08:06:27.250864 30553 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.36.252" port: 35497 } attempt: 1
I20260811 08:06:27.251410 30555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:27.251279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.252:35497 (local address 127.0.0.1:60720)
0811 08:06:27.251342 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:27.251383 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.252:35497: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260811 08:06:27.251746 30555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:27.251645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.252:35497 (local address 127.0.0.1:60722)
0811 08:06:27.251692 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:27.251717 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.252:35497: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260811 08:06:27.251835 30553 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.36.252:35497: Network error: Client connection negotiation failed: client connection to 127.15.36.252:35497: connect: Connection refused (error 111)
I20260811 08:06:27.259223 30466 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.36.252" port: 35497 } attempt: 1
I20260811 08:06:27.259652 30468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:27.259525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.252:35497 (local address 127.0.0.1:60726)
0811 08:06:27.259587 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:27.259624 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.252:35497: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260811 08:06:27.259994 30468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:27.259898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.252:35497 (local address 127.0.0.1:60734)
0811 08:06:27.259944 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:27.259968 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.252:35497: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260811 08:06:27.260082 30466 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.36.252:35497: Network error: Client connection negotiation failed: client connection to 127.15.36.252:35497: connect: Connection refused (error 111)
W20260811 08:06:27.296911 30560 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:06:27.297133 30560 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:06:27.297158 30560 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:06:27.298352 30560 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:06:27.298413 30560 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:06:27.298429 30560 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:06:27.298442 30560 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:06:27.298454 30560 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:06:27.300146 30560 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:32813
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.15.36.254:33245,127.15.36.253:42975,127.15.36.252:35497
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.252.keytab
--principal=kudu/127.15.36.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.252:35497
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.15.36.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30560
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:06:27.300452 30560 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:06:27.300716 30560 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:06:27.305941 30567 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:06:27.305945 30569 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:06:27.305946 30566 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:06:27.306602 30560 server_base.cc:1034] running on GCE node
I20260811 08:06:27.306854 30560 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:06:27.307216 30560 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:06:27.308372 30560 hybrid_clock.cc:648] HybridClock initialized: now 1786435587308360 us; error 33 us; skew 500 ppm
Aug 11 08:06:27 dist-test-slave-2w3w krb5kdc[30368](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435587, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:06:27.311159 30560 init.cc:377] Logged in from keytab as kudu/127.15.36.252@KRBTEST.COM (short username kudu)
I20260811 08:06:27.311627 30560 webserver.cc:460] Webserver started at http://127.15.36.252:46059/ using document root <none> and password file <none>
I20260811 08:06:27.311892 30560 fs_manager.cc:359] Metadata directory not provided
I20260811 08:06:27.311965 30560 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:06:27.312126 30560 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:06:27.313222 30560 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/minicluster-data/master-2/data/instance:
uuid: "a9aa5a6c8d9b4ab3a52251165ec9f463"
format_stamp: "Formatted at 2026-08-11 08:06:27 on dist-test-slave-2w3w"
server_key: "1e3890c0c2748183be1928ca96648225"
server_key_iv: "44c8f52f38435c325530842ad7e48581"
server_key_version: "encryptionkey@0"
I20260811 08:06:27.313594 30560 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/minicluster-data/master-2/wal/instance:
uuid: "a9aa5a6c8d9b4ab3a52251165ec9f463"
format_stamp: "Formatted at 2026-08-11 08:06:27 on dist-test-slave-2w3w"
server_key: "1e3890c0c2748183be1928ca96648225"
server_key_iv: "44c8f52f38435c325530842ad7e48581"
server_key_version: "encryptionkey@0"
I20260811 08:06:27.315101 30560 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 08:06:27.315912 30578 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:06:27.316146 30560 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:06:27.316256 30560 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/minicluster-data/master-2/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/minicluster-data/master-2/wal
uuid: "a9aa5a6c8d9b4ab3a52251165ec9f463"
format_stamp: "Formatted at 2026-08-11 08:06:27 on dist-test-slave-2w3w"
server_key: "1e3890c0c2748183be1928ca96648225"
server_key_iv: "44c8f52f38435c325530842ad7e48581"
server_key_version: "encryptionkey@0"
I20260811 08:06:27.316352 30560 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:06:27.320024 30553 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.36.252" port: 35497 } attempt: 2
I20260811 08:06:27.320472 30555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:27.320326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.252:35497 (local address 127.0.0.1:60738)
0811 08:06:27.320401 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:27.320440 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.252:35497: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260811 08:06:27.320876 30555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:27.320761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.252:35497 (local address 127.0.0.1:60744)
0811 08:06:27.320818 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:27.320847 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.252:35497: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260811 08:06:27.320963 30553 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.36.252:35497: Network error: Client connection negotiation failed: client connection to 127.15.36.252:35497: connect: Connection refused (error 111)
I20260811 08:06:27.335222 30466 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.36.252" port: 35497 } attempt: 2
I20260811 08:06:27.336042 30468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:27.335890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.252:35497 (local address 127.0.0.1:60760)
0811 08:06:27.335960 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:27.336008 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.252:35497: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260811 08:06:27.336493 30468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:27.336406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.252:35497 (local address 127.0.0.1:60764)
0811 08:06:27.336453 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:27.336477 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.252:35497: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260811 08:06:27.336598 30466 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.36.252:35497: Network error: Client connection negotiation failed: client connection to 127.15.36.252:35497: connect: Connection refused (error 111)
I20260811 08:06:27.340776 30560 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:06:27.342831 30560 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:06:27.342947 30560 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:06:27.347048 30560 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.252:35497
I20260811 08:06:27.347111 30633 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.252:35497 every 8 connection(s)
I20260811 08:06:27.347486 30560 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/minicluster-data/master-2/data/info.pb
I20260811 08:06:27.348438 30634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:06:27.350044 30634 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.36.254" port: 33245 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 08:06:27 dist-test-slave-2w3w krb5kdc[30368](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435587, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.252@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:06:27.357275 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 30560
I20260811 08:06:27.357381 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786435400844580-15507-0/minicluster-data/master-2/wal/instance
I20260811 08:06:27.357700 15507 external_mini_cluster.cc:1428] Setting key 3412baeae85eaba9943302e0bc4ea80f
I20260811 08:06:27.359817 30469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:27.350795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44726 (local address 127.15.36.254:33245)
0811 08:06:27.350866 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 08:06:27.350869 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:06:27.351138 (+ 269us) server_negotiation.cc:407] Connection header received
0811 08:06:27.351651 (+ 513us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:06:27.351653 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:06:27.351666 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:06:27.351713 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:06:27.352400 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:27.352958 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:27.354067 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:27.354260 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:27.354349 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:27.356645 (+ 2296us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:06:27.356647 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:06:27.356647 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:06:27.356654 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:06:27.358292 (+ 1638us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:27.358730 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:27.358731 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:27.358732 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:27.358796 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:27.359129 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:27.359130 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:27.359131 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:27.359265 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:06:27.359348 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 08:06:27.359633 (+ 285us) server_negotiation.cc:299] Negotiation successful
0811 08:06:27.359725 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 08:06:27.360078 30636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:27.350766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:33245 (local address 127.0.0.1:44726)
0811 08:06:27.351009 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:27.351053 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 08:06:27.351534 (+ 481us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:06:27.351796 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:06:27.351799 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:06:27.352084 (+ 285us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:06:27.352285 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:27.352289 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:27.353052 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:27.353054 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:27.353977 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:27.353979 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:27.354356 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:27.354357 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:27.354493 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:27.355067 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:06:27.355075 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:06:27.356551 (+ 1476us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:06:27.358400 (+ 1849us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:06:27.358405 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:06:27.358408 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:06:27.358645 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:06:27.358880 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:06:27.358881 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:06:27.358881 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:06:27.359058 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:06:27.359342 (+ 284us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:06:27.359351 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:06:27.359493 (+ 142us) client_negotiation.cc:769] Sending connection context
0811 08:06:27.359596 (+ 103us) client_negotiation.cc:240] Negotiation successful
0811 08:06:27.359763 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":96,"threads_started":1}
I20260811 08:06:27.360670 30634 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.36.253" port: 42975 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 08:06:27 dist-test-slave-2w3w krb5kdc[30368](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435586, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.36.252@KRBTEST.COM
Aug 11 08:06:27 dist-test-slave-2w3w krb5kdc[30368](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435587, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.252@KRBTEST.COM for kudu/127.15.36.253@KRBTEST.COM
I20260811 08:06:27.367475 30638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:27.358255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60780 (local address 127.15.36.252:35497)
0811 08:06:27.358448 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0811 08:06:27.358454 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 08:06:27.358482 (+ 28us) server_negotiation.cc:407] Connection header received
0811 08:06:27.358545 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:06:27.358549 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:06:27.358563 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:06:27.358655 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:06:27.359340 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:27.360175 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:27.361128 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:27.361595 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:27.361646 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:27.364300 (+ 2654us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:06:27.364309 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:06:27.364310 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:06:27.364317 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:06:27.366082 (+ 1765us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:27.366460 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:27.366463 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:27.366463 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:27.366553 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:27.366775 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:27.366776 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:27.366776 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:27.366929 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:06:27.367202 (+ 273us) server_negotiation.cc:1035] Waiting for connection context
0811 08:06:27.367250 (+ 48us) server_negotiation.cc:299] Negotiation successful
0811 08:06:27.367331 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":117,"threads_started":1}
I20260811 08:06:27.367524 30557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:27.361074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51964 (local address 127.15.36.253:42975)
0811 08:06:27.361122 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 08:06:27.361124 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:06:27.361132 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:06:27.361157 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:06:27.361158 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:06:27.361167 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:06:27.361221 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:06:27.361505 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:27.362136 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:27.362767 (+ 631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:27.363122 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:27.363193 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:27.364869 (+ 1676us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:06:27.364871 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:06:27.364871 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:06:27.364879 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:06:27.366324 (+ 1445us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:27.366715 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:27.366717 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:27.366717 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:27.366778 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:27.367000 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:27.367001 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:27.367001 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:27.367118 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:06:27.367190 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 08:06:27.367347 (+ 157us) server_negotiation.cc:299] Negotiation successful
0811 08:06:27.367428 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 08:06:27.367552 30636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:27.360987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.253:42975 (local address 127.0.0.1:51964)
0811 08:06:27.361035 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:27.361046 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:06:27.361103 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:06:27.361223 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:06:27.361224 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:06:27.361374 (+ 150us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:06:27.361433 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:27.361434 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:27.362205 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:27.362206 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:27.362682 (+ 476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:27.362684 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:27.363196 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:27.363197 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:27.363278 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:27.363634 (+ 356us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:06:27.363639 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:06:27.364780 (+ 1141us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:06:27.366458 (+ 1678us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:06:27.366459 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:06:27.366459 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:06:27.366642 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:06:27.366846 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:06:27.366847 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:06:27.366848 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:06:27.366916 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:06:27.367195 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:06:27.367196 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:06:27.367238 (+ 42us) client_negotiation.cc:769] Sending connection context
0811 08:06:27.367321 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 08:06:27.367420 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260811 08:06:27.368088 30634 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.36.252" port: 35497 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 08:06:27 dist-test-slave-2w3w krb5kdc[30368](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435587, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.252@KRBTEST.COM for kudu/127.15.36.252@KRBTEST.COM
Aug 11 08:06:27 dist-test-slave-2w3w krb5kdc[30368](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435586, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:06:27.375135 30636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:27.368344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.252:35497 (local address 127.0.0.1:60792)
0811 08:06:27.368375 (+ 31us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:27.368395 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 08:06:27.368433 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:06:27.368687 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:06:27.368688 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:06:27.368798 (+ 110us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:06:27.368827 (+ 29us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:27.368828 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:27.369546 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:27.369547 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:27.370067 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:27.370069 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:27.370516 (+ 447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:27.370517 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:27.370570 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:27.371036 (+ 466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:06:27.371040 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:06:27.372252 (+ 1212us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:06:27.373970 (+ 1718us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:06:27.373971 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:06:27.373971 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:06:27.374212 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:06:27.374421 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:06:27.374422 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:06:27.374422 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:06:27.374487 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:06:27.374728 (+ 241us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:06:27.374729 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:06:27.374779 (+ 50us) client_negotiation.cc:769] Sending connection context
0811 08:06:27.374861 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 08:06:27.374952 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16}
I20260811 08:06:27.375249 30638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:27.368416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60792 (local address 127.15.36.252:35497)
0811 08:06:27.368584 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0811 08:06:27.368586 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:06:27.368593 (+ 7us) server_negotiation.cc:407] Connection header received
0811 08:06:27.368610 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:06:27.368611 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:06:27.368621 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:06:27.368679 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:06:27.368901 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:27.369471 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:27.370143 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:27.370452 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:27.370502 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:27.372334 (+ 1832us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:06:27.372335 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:06:27.372335 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:06:27.372341 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:06:27.373898 (+ 1557us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:27.374298 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:27.374299 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:27.374300 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:27.374349 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:27.374554 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:27.374554 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:27.374554 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:27.374652 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:06:27.374700 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 08:06:27.374905 (+ 205us) server_negotiation.cc:299] Negotiation successful
0811 08:06:27.375043 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149}
I20260811 08:06:27.376358 30469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:27.368365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44728 (local address 127.15.36.254:33245)
0811 08:06:27.368412 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 08:06:27.368413 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:06:27.368422 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:06:27.368459 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:06:27.368460 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:06:27.368469 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:06:27.368528 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:06:27.369129 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:27.369637 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:27.370380 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:27.370632 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:27.370709 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:27.372960 (+ 2251us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:06:27.372961 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:06:27.372962 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:06:27.372970 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:06:27.374791 (+ 1821us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:27.375190 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:27.375191 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:27.375191 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:27.375255 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:27.375446 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:27.375447 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:27.375448 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:27.375598 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:06:27.375982 (+ 384us) server_negotiation.cc:1035] Waiting for connection context
0811 08:06:27.376185 (+ 203us) server_negotiation.cc:299] Negotiation successful
0811 08:06:27.376277 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 08:06:27.377270 30634 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a9aa5a6c8d9b4ab3a52251165ec9f463: Bootstrap starting.
I20260811 08:06:27.378106 30634 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a9aa5a6c8d9b4ab3a52251165ec9f463: Neither blocks nor log segments found. Creating new log.
I20260811 08:06:27.378413 30634 log.cc:824] T 00000000000000000000000000000000 P a9aa5a6c8d9b4ab3a52251165ec9f463: Log is configured to *not* fsync() on all Append() calls
I20260811 08:06:27.379308 30634 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a9aa5a6c8d9b4ab3a52251165ec9f463: No bootstrap required, opened a new log
I20260811 08:06:27.381120 30634 raft_consensus.cc:348] T 00000000000000000000000000000000 P a9aa5a6c8d9b4ab3a52251165ec9f463 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d447b11f882243b691b626038a5924ea" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 33245 } } peers { permanent_uuid: "38bb62d63d0a4509ad4d72dc434f1e4d" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 42975 } } peers { permanent_uuid: "a9aa5a6c8d9b4ab3a52251165ec9f463" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 35497 } }
Aug 11 08:06:27 dist-test-slave-2w3w krb5kdc[30368](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435586, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.36.253@KRBTEST.COM
I20260811 08:06:27.381287 30634 raft_consensus.cc:374] T 00000000000000000000000000000000 P a9aa5a6c8d9b4ab3a52251165ec9f463 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:06:27.381326 30634 raft_consensus.cc:729] T 00000000000000000000000000000000 P a9aa5a6c8d9b4ab3a52251165ec9f463 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9aa5a6c8d9b4ab3a52251165ec9f463, State: Initialized, Role: FOLLOWER
I20260811 08:06:27.381474 30634 consensus_queue.cc:260] T 00000000000000000000000000000000 P a9aa5a6c8d9b4ab3a52251165ec9f463 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d447b11f882243b691b626038a5924ea" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 33245 } } peers { permanent_uuid: "38bb62d63d0a4509ad4d72dc434f1e4d" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 42975 } } peers { permanent_uuid: "a9aa5a6c8d9b4ab3a52251165ec9f463" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 35497 } }
I20260811 08:06:27.381855 30634 sys_catalog.cc:564] T 00000000000000000000000000000000 P a9aa5a6c8d9b4ab3a52251165ec9f463 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:06:27.381793 30640 sys_catalog.cc:455] T 00000000000000000000000000000000 P a9aa5a6c8d9b4ab3a52251165ec9f463 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d447b11f882243b691b626038a5924ea" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 33245 } } peers { permanent_uuid: "38bb62d63d0a4509ad4d72dc434f1e4d" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 42975 } } peers { permanent_uuid: "a9aa5a6c8d9b4ab3a52251165ec9f463" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 35497 } } }
I20260811 08:06:27.381942 30640 sys_catalog.cc:458] T 00000000000000000000000000000000 P a9aa5a6c8d9b4ab3a52251165ec9f463 [sys.catalog]: This master's current role is: FOLLOWER
W20260811 08:06:27.384071 30653 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a9aa5a6c8d9b4ab3a52251165ec9f463: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 08:06:27.384177 30653 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 08:06:27.385002 30557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:27.377001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51972 (local address 127.15.36.253:42975)
0811 08:06:27.377051 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 08:06:27.377054 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:06:27.377063 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:06:27.377086 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:06:27.377087 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:06:27.377097 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:06:27.377150 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:06:27.377691 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:27.378200 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:27.379089 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:27.379289 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:27.379367 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:27.381862 (+ 2495us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:06:27.381864 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:06:27.381865 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:06:27.381873 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:06:27.383719 (+ 1846us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:27.384127 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:27.384128 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:27.384129 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:27.384193 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:27.384414 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:27.384416 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:27.384416 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:27.384584 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:06:27.384787 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0811 08:06:27.384826 (+ 39us) server_negotiation.cc:299] Negotiation successful
0811 08:06:27.384909 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 08:06:27.386801 15507 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:06:27.384531 30560 master_runner.cc:186] Error getting master registration for 127.15.36.254:33245: OK, instance_id { permanent_uuid: "d447b11f882243b691b626038a5924ea" instance_seqno: 1786435586990533 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 08:06:27.387215 30560 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 08:06:27.397830 30638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:27.388547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60808 (local address 127.15.36.252:35497)
0811 08:06:27.388594 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 08:06:27.388597 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:06:27.388890 (+ 293us) server_negotiation.cc:407] Connection header received
0811 08:06:27.389082 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:06:27.389084 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:06:27.389102 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:06:27.389151 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:06:27.390054 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:27.390825 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:27.392023 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:27.392358 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:27.392397 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:27.394443 (+ 2046us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:06:27.394444 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:06:27.394445 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:06:27.394454 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:06:27.396225 (+ 1771us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:27.396712 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:27.396713 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:27.396714 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:27.396773 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:27.396998 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:27.396999 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:27.396999 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:27.397207 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:06:27.397329 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0811 08:06:27.397575 (+ 246us) server_negotiation.cc:299] Negotiation successful
0811 08:06:27.397689 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 08:06:27.397871 30469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:27.388636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44730 (local address 127.15.36.254:33245)
0811 08:06:27.388712 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 08:06:27.388715 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:06:27.389005 (+ 290us) server_negotiation.cc:407] Connection header received
0811 08:06:27.389100 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:06:27.389101 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:06:27.389111 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:06:27.389142 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:06:27.389985 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:27.390829 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:27.392084 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:27.392387 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:27.392464 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:27.394499 (+ 2035us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:06:27.394501 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:06:27.394501 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:06:27.394509 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:06:27.396483 (+ 1974us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:27.396960 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:27.396962 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:27.396962 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:27.397020 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:27.397224 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:27.397225 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:27.397225 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:27.397370 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:06:27.397452 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 08:06:27.397669 (+ 217us) server_negotiation.cc:299] Negotiation successful
0811 08:06:27.397773 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 08:06:27.399106 30557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:27.388512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51988 (local address 127.15.36.253:42975)
0811 08:06:27.388557 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 08:06:27.388559 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:06:27.388856 (+ 297us) server_negotiation.cc:407] Connection header received
0811 08:06:27.388923 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:06:27.388924 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:06:27.388935 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:06:27.389095 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:06:27.390055 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:27.390827 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:27.392029 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:27.392335 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:27.392384 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:27.394512 (+ 2128us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:06:27.394514 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:06:27.394514 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:06:27.394522 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:06:27.397114 (+ 2592us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:27.397509 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:27.397511 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:27.397511 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:27.397573 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:27.397807 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:27.397808 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:27.397809 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:27.397946 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:06:27.398561 (+ 615us) server_negotiation.cc:1035] Waiting for connection context
0811 08:06:27.398777 (+ 216us) server_negotiation.cc:299] Negotiation successful
0811 08:06:27.398862 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 08:06:27.412112 30553 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.36.252" port: 35497 } attempt: 3
Aug 11 08:06:27 dist-test-slave-2w3w krb5kdc[30368](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435587, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.253@KRBTEST.COM for kudu/127.15.36.252@KRBTEST.COM
I20260811 08:06:27.419644 30555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:27.412449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.252:35497 (local address 127.0.0.1:60820)
0811 08:06:27.412507 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:27.412520 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 08:06:27.412592 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:06:27.412713 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:06:27.412714 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:06:27.412905 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:06:27.412950 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:27.412953 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:27.413613 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:27.413615 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:27.414125 (+ 510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:27.414127 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:27.414528 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:27.414529 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:27.414593 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:27.415156 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:06:27.415161 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:06:27.416604 (+ 1443us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:06:27.418308 (+ 1704us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:06:27.418309 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:06:27.418309 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:06:27.418505 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:06:27.418727 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:06:27.418728 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:06:27.418728 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:06:27.418798 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:06:27.419268 (+ 470us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:06:27.419270 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:06:27.419328 (+ 58us) client_negotiation.cc:769] Sending connection context
0811 08:06:27.419424 (+ 96us) client_negotiation.cc:240] Negotiation successful
0811 08:06:27.419540 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260811 08:06:27.419643 30638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:27.412525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60820 (local address 127.15.36.252:35497)
0811 08:06:27.412593 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 08:06:27.412595 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:06:27.412605 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:06:27.412650 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:06:27.412651 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:06:27.412661 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:06:27.412711 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:06:27.413036 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:27.413520 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:27.414220 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:27.414419 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:27.414507 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:27.416704 (+ 2197us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:06:27.416705 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:06:27.416706 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:06:27.416720 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:06:27.418163 (+ 1443us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:27.418583 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:27.418584 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:27.418585 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:27.418648 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:27.418867 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:27.418868 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:27.418869 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:27.419078 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:06:27.419267 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0811 08:06:27.419452 (+ 185us) server_negotiation.cc:299] Negotiation successful
0811 08:06:27.419540 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 08:06:27.421654 30553 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38bb62d63d0a4509ad4d72dc434f1e4d: Bootstrap starting.
I20260811 08:06:27.422462 30553 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 38bb62d63d0a4509ad4d72dc434f1e4d: Neither blocks nor log segments found. Creating new log.
I20260811 08:06:27.422803 30553 log.cc:824] T 00000000000000000000000000000000 P 38bb62d63d0a4509ad4d72dc434f1e4d: Log is configured to *not* fsync() on all Append() calls
I20260811 08:06:27.423734 30553 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38bb62d63d0a4509ad4d72dc434f1e4d: No bootstrap required, opened a new log
I20260811 08:06:27.425800 30553 raft_consensus.cc:348] T 00000000000000000000000000000000 P 38bb62d63d0a4509ad4d72dc434f1e4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d447b11f882243b691b626038a5924ea" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 33245 } } peers { permanent_uuid: "38bb62d63d0a4509ad4d72dc434f1e4d" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 42975 } } peers { permanent_uuid: "a9aa5a6c8d9b4ab3a52251165ec9f463" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 35497 } }
I20260811 08:06:27.425963 30553 raft_consensus.cc:374] T 00000000000000000000000000000000 P 38bb62d63d0a4509ad4d72dc434f1e4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:06:27.425997 30553 raft_consensus.cc:729] T 00000000000000000000000000000000 P 38bb62d63d0a4509ad4d72dc434f1e4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38bb62d63d0a4509ad4d72dc434f1e4d, State: Initialized, Role: FOLLOWER
I20260811 08:06:27.426108 30553 consensus_queue.cc:260] T 00000000000000000000000000000000 P 38bb62d63d0a4509ad4d72dc434f1e4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d447b11f882243b691b626038a5924ea" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 33245 } } peers { permanent_uuid: "38bb62d63d0a4509ad4d72dc434f1e4d" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 42975 } } peers { permanent_uuid: "a9aa5a6c8d9b4ab3a52251165ec9f463" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 35497 } }
I20260811 08:06:27.426435 30553 sys_catalog.cc:564] T 00000000000000000000000000000000 P 38bb62d63d0a4509ad4d72dc434f1e4d [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:06:27.426394 30665 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38bb62d63d0a4509ad4d72dc434f1e4d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d447b11f882243b691b626038a5924ea" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 33245 } } peers { permanent_uuid: "38bb62d63d0a4509ad4d72dc434f1e4d" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 42975 } } peers { permanent_uuid: "a9aa5a6c8d9b4ab3a52251165ec9f463" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 35497 } } }
I20260811 08:06:27.426515 30665 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38bb62d63d0a4509ad4d72dc434f1e4d [sys.catalog]: This master's current role is: FOLLOWER
W20260811 08:06:27.428406 30677 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 38bb62d63d0a4509ad4d72dc434f1e4d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 08:06:27.428462 30677 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 08:06:27.428666 30473 master_runner.cc:186] Error getting master registration for 127.15.36.254:33245: OK, instance_id { permanent_uuid: "d447b11f882243b691b626038a5924ea" instance_seqno: 1786435586990533 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 08:06:27.430913 30473 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 08:06:27.435736 30466 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.36.252" port: 35497 } attempt: 3
Aug 11 08:06:27 dist-test-slave-2w3w krb5kdc[30368](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435586, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.254@KRBTEST.COM for kudu/127.15.36.252@KRBTEST.COM
I20260811 08:06:27.443435 30468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:27.436072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.252:35497 (local address 127.0.0.1:60836)
0811 08:06:27.436126 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:27.436140 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 08:06:27.436189 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:06:27.436309 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:06:27.436309 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:06:27.436507 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:06:27.436553 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:27.436555 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:27.437223 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:27.437229 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:27.437713 (+ 484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:27.437714 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:27.438162 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:27.438163 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:27.438227 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:27.438724 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:06:27.438729 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:06:27.440601 (+ 1872us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:06:27.442288 (+ 1687us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:06:27.442290 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:06:27.442291 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:06:27.442479 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:06:27.442698 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:06:27.442699 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:06:27.442699 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:06:27.442764 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:06:27.443078 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:06:27.443079 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:06:27.443130 (+ 51us) client_negotiation.cc:769] Sending connection context
0811 08:06:27.443215 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 08:06:27.443327 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260811 08:06:27.443429 30638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:27.436162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60836 (local address 127.15.36.252:35497)
0811 08:06:27.436206 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 08:06:27.436208 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:06:27.436218 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:06:27.436245 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:06:27.436246 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:06:27.436256 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:06:27.436306 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:06:27.436645 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:27.437129 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:27.437797 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:27.438083 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:27.438162 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:27.440695 (+ 2533us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:06:27.440697 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:06:27.440698 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:06:27.440705 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:06:27.442178 (+ 1473us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:27.442556 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:27.442557 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:27.442558 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:27.442621 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:27.442835 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:27.442836 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:27.442836 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:27.443019 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:06:27.443088 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 08:06:27.443243 (+ 155us) server_negotiation.cc:299] Negotiation successful
0811 08:06:27.443327 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 08:06:27.445109 30466 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d447b11f882243b691b626038a5924ea: Bootstrap starting.
I20260811 08:06:27.445804 30466 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d447b11f882243b691b626038a5924ea: Neither blocks nor log segments found. Creating new log.
I20260811 08:06:27.446110 30466 log.cc:824] T 00000000000000000000000000000000 P d447b11f882243b691b626038a5924ea: Log is configured to *not* fsync() on all Append() calls
I20260811 08:06:27.446907 30466 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d447b11f882243b691b626038a5924ea: No bootstrap required, opened a new log
I20260811 08:06:27.448361 30466 raft_consensus.cc:348] T 00000000000000000000000000000000 P d447b11f882243b691b626038a5924ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d447b11f882243b691b626038a5924ea" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 33245 } } peers { permanent_uuid: "38bb62d63d0a4509ad4d72dc434f1e4d" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 42975 } } peers { permanent_uuid: "a9aa5a6c8d9b4ab3a52251165ec9f463" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 35497 } }
I20260811 08:06:27.448510 30466 raft_consensus.cc:374] T 00000000000000000000000000000000 P d447b11f882243b691b626038a5924ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:06:27.448554 30466 raft_consensus.cc:729] T 00000000000000000000000000000000 P d447b11f882243b691b626038a5924ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d447b11f882243b691b626038a5924ea, State: Initialized, Role: FOLLOWER
I20260811 08:06:27.448695 30466 consensus_queue.cc:260] T 00000000000000000000000000000000 P d447b11f882243b691b626038a5924ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d447b11f882243b691b626038a5924ea" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 33245 } } peers { permanent_uuid: "38bb62d63d0a4509ad4d72dc434f1e4d" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 42975 } } peers { permanent_uuid: "a9aa5a6c8d9b4ab3a52251165ec9f463" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 35497 } }
I20260811 08:06:27.448985 30680 sys_catalog.cc:455] T 00000000000000000000000000000000 P d447b11f882243b691b626038a5924ea [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d447b11f882243b691b626038a5924ea" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 33245 } } peers { permanent_uuid: "38bb62d63d0a4509ad4d72dc434f1e4d" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 42975 } } peers { permanent_uuid: "a9aa5a6c8d9b4ab3a52251165ec9f463" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 35497 } } }
I20260811 08:06:27.449036 30466 sys_catalog.cc:564] T 00000000000000000000000000000000 P d447b11f882243b691b626038a5924ea [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:06:27.449108 30680 sys_catalog.cc:458] T 00000000000000000000000000000000 P d447b11f882243b691b626038a5924ea [sys.catalog]: This master's current role is: FOLLOWER
W20260811 08:06:27.450947 30692 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d447b11f882243b691b626038a5924ea: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 08:06:27.451085 30692 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 08:06:27.454016 30385 master_runner.cc:263] No leader master found from master d447b11f882243b691b626038a5924ea
I20260811 08:06:27.454090 30385 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260811 08:06:27.488293 30413 tablet.cc:2369] T 00000000000000000000000000000000 P d447b11f882243b691b626038a5924ea: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 08:06:27.593622 30584 tablet.cc:2369] T 00000000000000000000000000000000 P a9aa5a6c8d9b4ab3a52251165ec9f463: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:06:27.604487 30680 raft_consensus.cc:482] T 00000000000000000000000000000000 P d447b11f882243b691b626038a5924ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:06:27.604621 30680 raft_consensus.cc:504] T 00000000000000000000000000000000 P d447b11f882243b691b626038a5924ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d447b11f882243b691b626038a5924ea" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 33245 } } peers { permanent_uuid: "38bb62d63d0a4509ad4d72dc434f1e4d" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 42975 } } peers { permanent_uuid: "a9aa5a6c8d9b4ab3a52251165ec9f463" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 35497 } }
I20260811 08:06:27.604956 30680 leader_election.cc:288] T 00000000000000000000000000000000 P d447b11f882243b691b626038a5924ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 38bb62d63d0a4509ad4d72dc434f1e4d (127.15.36.253:42975), a9aa5a6c8d9b4ab3a52251165ec9f463 (127.15.36.252:35497)
I20260811 08:06:27.605252 30521 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d447b11f882243b691b626038a5924ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38bb62d63d0a4509ad4d72dc434f1e4d" is_pre_election: true
I20260811 08:06:27.605432 30521 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 38bb62d63d0a4509ad4d72dc434f1e4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d447b11f882243b691b626038a5924ea in term 0.
I20260811 08:06:27.605341 30606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d447b11f882243b691b626038a5924ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9aa5a6c8d9b4ab3a52251165ec9f463" is_pre_election: true
I20260811 08:06:27.605535 30606 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a9aa5a6c8d9b4ab3a52251165ec9f463 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d447b11f882243b691b626038a5924ea in term 0.
I20260811 08:06:27.605667 30406 leader_election.cc:302] T 00000000000000000000000000000000 P d447b11f882243b691b626038a5924ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38bb62d63d0a4509ad4d72dc434f1e4d, d447b11f882243b691b626038a5924ea; no voters:
I20260811 08:06:27.605829 30680 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d447b11f882243b691b626038a5924ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:06:27.605885 30680 raft_consensus.cc:482] T 00000000000000000000000000000000 P d447b11f882243b691b626038a5924ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:06:27.605911 30680 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d447b11f882243b691b626038a5924ea [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:06:27.606679 30680 raft_consensus.cc:504] T 00000000000000000000000000000000 P d447b11f882243b691b626038a5924ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d447b11f882243b691b626038a5924ea" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 33245 } } peers { permanent_uuid: "38bb62d63d0a4509ad4d72dc434f1e4d" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 42975 } } peers { permanent_uuid: "a9aa5a6c8d9b4ab3a52251165ec9f463" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 35497 } }
I20260811 08:06:27.606837 30680 leader_election.cc:288] T 00000000000000000000000000000000 P d447b11f882243b691b626038a5924ea [CANDIDATE]: Term 1 election: Requested vote from peers 38bb62d63d0a4509ad4d72dc434f1e4d (127.15.36.253:42975), a9aa5a6c8d9b4ab3a52251165ec9f463 (127.15.36.252:35497)
I20260811 08:06:27.607072 30606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d447b11f882243b691b626038a5924ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9aa5a6c8d9b4ab3a52251165ec9f463"
I20260811 08:06:27.607090 30521 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d447b11f882243b691b626038a5924ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38bb62d63d0a4509ad4d72dc434f1e4d"
I20260811 08:06:27.607174 30606 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a9aa5a6c8d9b4ab3a52251165ec9f463 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:06:27.607192 30521 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 38bb62d63d0a4509ad4d72dc434f1e4d [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:06:27.607841 30521 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 38bb62d63d0a4509ad4d72dc434f1e4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d447b11f882243b691b626038a5924ea in term 1.
I20260811 08:06:27.608052 30606 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a9aa5a6c8d9b4ab3a52251165ec9f463 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d447b11f882243b691b626038a5924ea in term 1.
I20260811 08:06:27.608098 30406 leader_election.cc:302] T 00000000000000000000000000000000 P d447b11f882243b691b626038a5924ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38bb62d63d0a4509ad4d72dc434f1e4d, d447b11f882243b691b626038a5924ea; no voters:
I20260811 08:06:27.608196 30680 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d447b11f882243b691b626038a5924ea [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:06:27.608321 30680 raft_consensus.cc:686] T 00000000000000000000000000000000 P d447b11f882243b691b626038a5924ea [term 1 LEADER]: Becoming Leader. State: Replica: d447b11f882243b691b626038a5924ea, State: Running, Role: LEADER
I20260811 08:06:27.608410 30680 consensus_queue.cc:237] T 00000000000000000000000000000000 P d447b11f882243b691b626038a5924ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d447b11f882243b691b626038a5924ea" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 33245 } } peers { permanent_uuid: "38bb62d63d0a4509ad4d72dc434f1e4d" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 42975 } } peers { permanent_uuid: "a9aa5a6c8d9b4ab3a52251165ec9f463" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 35497 } }
I20260811 08:06:27.608901 30695 sys_catalog.cc:455] T 00000000000000000000000000000000 P d447b11f882243b691b626038a5924ea [sys.catalog]: SysCatalogTable state changed. Reason: New leader d447b11f882243b691b626038a5924ea. Latest consensus state: current_term: 1 leader_uuid: "d447b11f882243b691b626038a5924ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d447b11f882243b691b626038a5924ea" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 33245 } } peers { permanent_uuid: "38bb62d63d0a4509ad4d72dc434f1e4d" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 42975 } } peers { permanent_uuid: "a9aa5a6c8d9b4ab3a52251165ec9f463" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 35497 } } }
I20260811 08:06:27.608996 30695 sys_catalog.cc:458] T 00000000000000000000000000000000 P d447b11f882243b691b626038a5924ea [sys.catalog]: This master's current role is: LEADER
I20260811 08:06:27.609220 30698 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:06:27.609412 30698 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:06:27.610771 30521 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 38bb62d63d0a4509ad4d72dc434f1e4d [term 1 FOLLOWER]: Refusing update from remote peer d447b11f882243b691b626038a5924ea: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:06:27.610857 30606 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a9aa5a6c8d9b4ab3a52251165ec9f463 [term 1 FOLLOWER]: Refusing update from remote peer d447b11f882243b691b626038a5924ea: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:06:27.611148 30680 consensus_queue.cc:1035] T 00000000000000000000000000000000 P d447b11f882243b691b626038a5924ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9aa5a6c8d9b4ab3a52251165ec9f463" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 35497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:06:27.611285 30695 consensus_queue.cc:1035] T 00000000000000000000000000000000 P d447b11f882243b691b626038a5924ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "38bb62d63d0a4509ad4d72dc434f1e4d" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:06:27.613118 30665 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38bb62d63d0a4509ad4d72dc434f1e4d [sys.catalog]: SysCatalogTable state changed. Reason: New leader d447b11f882243b691b626038a5924ea. Latest consensus state: current_term: 1 leader_uuid: "d447b11f882243b691b626038a5924ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d447b11f882243b691b626038a5924ea" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 33245 } } peers { permanent_uuid: "38bb62d63d0a4509ad4d72dc434f1e4d" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 42975 } } peers { permanent_uuid: "a9aa5a6c8d9b4ab3a52251165ec9f463" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 35497 } } }
I20260811 08:06:27.613211 30665 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38bb62d63d0a4509ad4d72dc434f1e4d [sys.catalog]: This master's current role is: FOLLOWER
I20260811 08:06:27.613456 30640 sys_catalog.cc:455] T 00000000000000000000000000000000 P a9aa5a6c8d9b4ab3a52251165ec9f463 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d447b11f882243b691b626038a5924ea. Latest consensus state: current_term: 1 leader_uuid: "d447b11f882243b691b626038a5924ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d447b11f882243b691b626038a5924ea" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 33245 } } peers { permanent_uuid: "38bb62d63d0a4509ad4d72dc434f1e4d" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 42975 } } peers { permanent_uuid: "a9aa5a6c8d9b4ab3a52251165ec9f463" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 35497 } } }
I20260811 08:06:27.613543 30640 sys_catalog.cc:458] T 00000000000000000000000000000000 P a9aa5a6c8d9b4ab3a52251165ec9f463 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 08:06:27.614178 30680 sys_catalog.cc:455] T 00000000000000000000000000000000 P d447b11f882243b691b626038a5924ea [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d447b11f882243b691b626038a5924ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d447b11f882243b691b626038a5924ea" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 33245 } } peers { permanent_uuid: "38bb62d63d0a4509ad4d72dc434f1e4d" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 42975 } } peers { permanent_uuid: "a9aa5a6c8d9b4ab3a52251165ec9f463" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 35497 } } }
I20260811 08:06:27.614261 30680 sys_catalog.cc:458] T 00000000000000000000000000000000 P d447b11f882243b691b626038a5924ea [sys.catalog]: This master's current role is: LEADER
I20260811 08:06:27.614390 30680 sys_catalog.cc:455] T 00000000000000000000000000000000 P d447b11f882243b691b626038a5924ea [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d447b11f882243b691b626038a5924ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d447b11f882243b691b626038a5924ea" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 33245 } } peers { permanent_uuid: "38bb62d63d0a4509ad4d72dc434f1e4d" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 42975 } } peers { permanent_uuid: "a9aa5a6c8d9b4ab3a52251165ec9f463" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 35497 } } }
I20260811 08:06:27.614480 30680 sys_catalog.cc:458] T 00000000000000000000000000000000 P d447b11f882243b691b626038a5924ea [sys.catalog]: This master's current role is: LEADER
I20260811 08:06:27.614480 30665 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38bb62d63d0a4509ad4d72dc434f1e4d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d447b11f882243b691b626038a5924ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d447b11f882243b691b626038a5924ea" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 33245 } } peers { permanent_uuid: "38bb62d63d0a4509ad4d72dc434f1e4d" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 42975 } } peers { permanent_uuid: "a9aa5a6c8d9b4ab3a52251165ec9f463" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 35497 } } }
I20260811 08:06:27.614570 30665 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38bb62d63d0a4509ad4d72dc434f1e4d [sys.catalog]: This master's current role is: FOLLOWER
I20260811 08:06:27.614568 30699 mvcc.cc:205] Tried to move back new op lower bound from 7317240166851518464 to 7317240166844612608. Current Snapshot: MvccSnapshot[applied={T|T < 7317240166851518464}]
I20260811 08:06:27.614710 30640 sys_catalog.cc:455] T 00000000000000000000000000000000 P a9aa5a6c8d9b4ab3a52251165ec9f463 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d447b11f882243b691b626038a5924ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d447b11f882243b691b626038a5924ea" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 33245 } } peers { permanent_uuid: "38bb62d63d0a4509ad4d72dc434f1e4d" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 42975 } } peers { permanent_uuid: "a9aa5a6c8d9b4ab3a52251165ec9f463" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 35497 } } }
I20260811 08:06:27.614807 30640 sys_catalog.cc:458] T 00000000000000000000000000000000 P a9aa5a6c8d9b4ab3a52251165ec9f463 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 08:06:27.614939 30700 mvcc.cc:205] Tried to move back new op lower bound from 7317240166851518464 to 7317240166844612608. Current Snapshot: MvccSnapshot[applied={T|T < 7317240166851518464}]
I20260811 08:06:27.615060 30701 mvcc.cc:205] Tried to move back new op lower bound from 7317240166851518464 to 7317240166844612608. Current Snapshot: MvccSnapshot[applied={T|T < 7317240166851518464}]
I20260811 08:06:27.615708 30698 catalog_manager.cc:1347] Generated new cluster ID: 4f79c25a30614dc49a3e5e6b73c112b1
I20260811 08:06:27.615767 30698 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:06:27.643016 30698 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:06:27.643585 30698 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:06:27.649349 30698 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d447b11f882243b691b626038a5924ea: Generated new TSK 0
I20260811 08:06:27.649608 30698 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:06:28.384718 30653 catalog_manager.cc:1259] Loaded cluster ID: 4f79c25a30614dc49a3e5e6b73c112b1
I20260811 08:06:28.384888 30653 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a9aa5a6c8d9b4ab3a52251165ec9f463: loading cluster ID for follower catalog manager: success
I20260811 08:06:28.385740 30653 catalog_manager.cc:1574] T 00000000000000000000000000000000 P a9aa5a6c8d9b4ab3a52251165ec9f463: acquiring CA information for follower catalog manager: success
I20260811 08:06:28.386082 30653 catalog_manager.cc:1602] T 00000000000000000000000000000000 P a9aa5a6c8d9b4ab3a52251165ec9f463: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 08:06:28.428943 30677 catalog_manager.cc:1259] Loaded cluster ID: 4f79c25a30614dc49a3e5e6b73c112b1
I20260811 08:06:28.429044 30677 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 38bb62d63d0a4509ad4d72dc434f1e4d: loading cluster ID for follower catalog manager: success
I20260811 08:06:28.429916 30677 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 38bb62d63d0a4509ad4d72dc434f1e4d: acquiring CA information for follower catalog manager: success
I20260811 08:06:28.430238 30677 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 38bb62d63d0a4509ad4d72dc434f1e4d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 08:06:28.711050 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 30385
I20260811 08:06:28.717955 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 30473
I20260811 08:06:28.725682 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 30560
2026-08-11T08:06:28Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3113 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786435400844580-15507-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:06:28 dist-test-slave-2w3w krb5kdc[30716](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:06:28 dist-test-slave-2w3w krb5kdc[30716](info): set up 2 sockets
Aug 11 08:06:28 dist-test-slave-2w3w krb5kdc[30716](info): commencing operation
krb5kdc: starting...
W20260811 08:06:29.839617 15507 mini_kdc.cc:121] Time spent starting KDC: real 1.091s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Aug 11 08:06:29 dist-test-slave-2w3w krb5kdc[30716](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435589, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:06:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:06:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.36.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab.
Entry for principal kudu/127.15.36.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab.
I20260811 08:06:29.975741 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786435400844580-15507-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786435400844580-15507-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786435400844580-15507-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:40549
--webserver_interface=127.15.36.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=kudu/127.15.36.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:46513
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.36.254:40549
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:06:30.064322 30730 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:06:30.064553 30730 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:06:30.064626 30730 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:06:30.065856 30730 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:06:30.065905 30730 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:06:30.065919 30730 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:06:30.065932 30730 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:06:30.065945 30730 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:06:30.067530 30730 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:46513
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786435400844580-15507-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786435400844580-15507-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.36.254:40549
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=kudu/127.15.36.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:40549
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.36.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30730
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786435400844580-15507-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:06:30.067826 30730 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:06:30.068090 30730 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:06:30.073321 30736 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:06:30.073398 30730 server_base.cc:1034] running on GCE node
W20260811 08:06:30.073344 30735 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:06:30.073361 30738 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:06:30.073873 30730 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:06:30.074234 30730 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:06:30.075380 30730 hybrid_clock.cc:648] HybridClock initialized: now 1786435590075367 us; error 26 us; skew 500 ppm
Aug 11 08:06:30 dist-test-slave-2w3w krb5kdc[30716](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435590, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:06:30.078186 30730 init.cc:377] Logged in from keytab as kudu/127.15.36.254@KRBTEST.COM (short username kudu)
I20260811 08:06:30.078713 30730 webserver.cc:460] Webserver started at http://127.15.36.254:33775/ using document root <none> and password file <none>
I20260811 08:06:30.079001 30730 fs_manager.cc:359] Metadata directory not provided
I20260811 08:06:30.079087 30730 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:06:30.079253 30730 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:06:30.080364 30730 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786435400844580-15507-0/minicluster-data/master-0/data/instance:
uuid: "9de4e58d109d46a48d00d3c5c2a9efe0"
format_stamp: "Formatted at 2026-08-11 08:06:30 on dist-test-slave-2w3w"
server_key: "62d4913adb9c289e3b2d12d998189ade"
server_key_iv: "cfd04c65c92987ff725fa7a029ca6cb2"
server_key_version: "encryptionkey@0"
I20260811 08:06:30.080745 30730 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786435400844580-15507-0/minicluster-data/master-0/wal/instance:
uuid: "9de4e58d109d46a48d00d3c5c2a9efe0"
format_stamp: "Formatted at 2026-08-11 08:06:30 on dist-test-slave-2w3w"
server_key: "62d4913adb9c289e3b2d12d998189ade"
server_key_iv: "cfd04c65c92987ff725fa7a029ca6cb2"
server_key_version: "encryptionkey@0"
I20260811 08:06:30.082175 30730 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 08:06:30.083082 30746 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:06:30.083277 30730 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:06:30.083387 30730 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786435400844580-15507-0/minicluster-data/master-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786435400844580-15507-0/minicluster-data/master-0/wal
uuid: "9de4e58d109d46a48d00d3c5c2a9efe0"
format_stamp: "Formatted at 2026-08-11 08:06:30 on dist-test-slave-2w3w"
server_key: "62d4913adb9c289e3b2d12d998189ade"
server_key_iv: "cfd04c65c92987ff725fa7a029ca6cb2"
server_key_version: "encryptionkey@0"
I20260811 08:06:30.083480 30730 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786435400844580-15507-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786435400844580-15507-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786435400844580-15507-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:06:30.110540 30730 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:06:30.113122 30730 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:06:30.113303 30730 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:06:30.117466 30730 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.254:40549
I20260811 08:06:30.117504 30802 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.254:40549 every 8 connection(s)
I20260811 08:06:30.117887 30730 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
I20260811 08:06:30.118829 30804 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:06:30.121270 30804 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9de4e58d109d46a48d00d3c5c2a9efe0: Bootstrap starting.
I20260811 08:06:30.121902 30804 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9de4e58d109d46a48d00d3c5c2a9efe0: Neither blocks nor log segments found. Creating new log.
I20260811 08:06:30.122226 30804 log.cc:824] T 00000000000000000000000000000000 P 9de4e58d109d46a48d00d3c5c2a9efe0: Log is configured to *not* fsync() on all Append() calls
I20260811 08:06:30.122285 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 30730
I20260811 08:06:30.122416 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786435400844580-15507-0/minicluster-data/master-0/wal/instance
I20260811 08:06:30.122658 15507 external_mini_cluster.cc:1428] Setting key 48febb10f1b602b4110738f3b232b0f4
I20260811 08:06:30.123167 30804 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9de4e58d109d46a48d00d3c5c2a9efe0: No bootstrap required, opened a new log
I20260811 08:06:30.124944 30804 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9de4e58d109d46a48d00d3c5c2a9efe0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9de4e58d109d46a48d00d3c5c2a9efe0" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 40549 } }
I20260811 08:06:30.125116 30804 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9de4e58d109d46a48d00d3c5c2a9efe0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:06:30.125159 30804 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9de4e58d109d46a48d00d3c5c2a9efe0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9de4e58d109d46a48d00d3c5c2a9efe0, State: Initialized, Role: FOLLOWER
I20260811 08:06:30.125331 30804 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9de4e58d109d46a48d00d3c5c2a9efe0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9de4e58d109d46a48d00d3c5c2a9efe0" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 40549 } }
I20260811 08:06:30.125424 30804 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9de4e58d109d46a48d00d3c5c2a9efe0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:06:30.125474 30804 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9de4e58d109d46a48d00d3c5c2a9efe0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:06:30.125530 30804 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9de4e58d109d46a48d00d3c5c2a9efe0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:06:30.126271 30804 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9de4e58d109d46a48d00d3c5c2a9efe0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9de4e58d109d46a48d00d3c5c2a9efe0" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 40549 } }
I20260811 08:06:30.126362 30804 leader_election.cc:302] T 00000000000000000000000000000000 P 9de4e58d109d46a48d00d3c5c2a9efe0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9de4e58d109d46a48d00d3c5c2a9efe0; no voters:
I20260811 08:06:30.126585 30804 leader_election.cc:288] T 00000000000000000000000000000000 P 9de4e58d109d46a48d00d3c5c2a9efe0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:06:30.126617 30811 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9de4e58d109d46a48d00d3c5c2a9efe0 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:06:30.126730 30811 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9de4e58d109d46a48d00d3c5c2a9efe0 [term 1 LEADER]: Becoming Leader. State: Replica: 9de4e58d109d46a48d00d3c5c2a9efe0, State: Running, Role: LEADER
I20260811 08:06:30.126879 30811 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9de4e58d109d46a48d00d3c5c2a9efe0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9de4e58d109d46a48d00d3c5c2a9efe0" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 40549 } }
I20260811 08:06:30.126884 30804 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9de4e58d109d46a48d00d3c5c2a9efe0 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:06:30.127410 30813 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9de4e58d109d46a48d00d3c5c2a9efe0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9de4e58d109d46a48d00d3c5c2a9efe0. Latest consensus state: current_term: 1 leader_uuid: "9de4e58d109d46a48d00d3c5c2a9efe0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9de4e58d109d46a48d00d3c5c2a9efe0" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 40549 } } }
I20260811 08:06:30.127414 30812 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9de4e58d109d46a48d00d3c5c2a9efe0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9de4e58d109d46a48d00d3c5c2a9efe0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9de4e58d109d46a48d00d3c5c2a9efe0" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 40549 } } }
I20260811 08:06:30.127543 30813 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9de4e58d109d46a48d00d3c5c2a9efe0 [sys.catalog]: This master's current role is: LEADER
I20260811 08:06:30.127548 30812 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9de4e58d109d46a48d00d3c5c2a9efe0 [sys.catalog]: This master's current role is: LEADER
I20260811 08:06:30.127748 30817 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:06:30.128316 30817 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:06:30.130384 30817 catalog_manager.cc:1347] Generated new cluster ID: 586b917f424040f4b909a71a21988721
I20260811 08:06:30.130447 30817 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 08:06:30 dist-test-slave-2w3w krb5kdc[30716](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435589, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:06:30.136765 30808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:30.123233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52490 (local address 127.15.36.254:40549)
0811 08:06:30.123424 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0811 08:06:30.123434 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 08:06:30.123487 (+ 53us) server_negotiation.cc:407] Connection header received
0811 08:06:30.124931 (+ 1444us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:06:30.124939 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:06:30.124994 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:06:30.125142 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:06:30.125987 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:30.127752 (+ 1765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:30.128973 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:30.129569 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:30.129688 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:30.132748 (+ 3060us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:06:30.132753 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:06:30.132753 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:06:30.132766 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:06:30.134916 (+ 2150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:30.135400 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:30.135404 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:30.135404 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:30.135568 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:30.135779 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:30.135780 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:30.135781 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:30.136121 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:06:30.136295 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0811 08:06:30.136393 (+ 98us) server_negotiation.cc:299] Negotiation successful
0811 08:06:30.136544 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":101,"threads_started":1}
I20260811 08:06:30.137864 15507 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:06:30.149760 30817 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:06:30.150341 30817 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:06:30.153986 30817 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9de4e58d109d46a48d00d3c5c2a9efe0: Generated new TSK 0
I20260811 08:06:30.154194 30817 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:06:30.192303 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 30730
2026-08-11T08:06:30Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1464 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:06:30 dist-test-slave-2w3w krb5kdc[30834](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:06:30 dist-test-slave-2w3w krb5kdc[30834](info): set up 2 sockets
Aug 11 08:06:30 dist-test-slave-2w3w krb5kdc[30834](info): commencing operation
krb5kdc: starting...
W20260811 08:06:31.295512 15507 mini_kdc.cc:121] Time spent starting KDC: real 1.082s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Aug 11 08:06:31 dist-test-slave-2w3w krb5kdc[30834](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435591, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:06:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:06:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.36.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab.
Entry for principal kudu/127.15.36.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab.
I20260811 08:06:31.431147 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:40173
--webserver_interface=127.15.36.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=kudu/127.15.36.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:34085
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.36.254:40173
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:06:31.514284 30852 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:06:31.514503 30852 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:06:31.514526 30852 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:06:31.515674 30852 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:06:31.515717 30852 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:06:31.515733 30852 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:06:31.515744 30852 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:06:31.515763 30852 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:06:31.517204 30852 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:34085
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.36.254:40173
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=kudu/127.15.36.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:40173
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.36.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30852
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:06:31.517414 30852 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:06:31.517594 30852 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:06:31.522691 30857 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:06:31.522713 30860 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:06:31.522730 30858 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:06:31.523030 30852 server_base.cc:1034] running on GCE node
I20260811 08:06:31.523478 30852 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:06:31.523823 30852 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:06:31.525031 30852 hybrid_clock.cc:648] HybridClock initialized: now 1786435591525018 us; error 49 us; skew 500 ppm
Aug 11 08:06:31 dist-test-slave-2w3w krb5kdc[30834](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435591, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:06:31.532130 30852 init.cc:377] Logged in from keytab as kudu/127.15.36.254@KRBTEST.COM (short username kudu)
I20260811 08:06:31.532693 30852 webserver.cc:460] Webserver started at http://127.15.36.254:38169/ using document root <none> and password file <none>
I20260811 08:06:31.532960 30852 fs_manager.cc:359] Metadata directory not provided
I20260811 08:06:31.533035 30852 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:06:31.533192 30852 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:06:31.534300 30852 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/master-0/data/instance:
uuid: "1767bedafd404afdbb667219a20a6440"
format_stamp: "Formatted at 2026-08-11 08:06:31 on dist-test-slave-2w3w"
server_key: "118e4a9af2741bb7983ef8ccf5aaaf62"
server_key_iv: "12d4557d27ec4c7b902376f4aec51911"
server_key_version: "encryptionkey@0"
I20260811 08:06:31.534684 30852 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/master-0/wal/instance:
uuid: "1767bedafd404afdbb667219a20a6440"
format_stamp: "Formatted at 2026-08-11 08:06:31 on dist-test-slave-2w3w"
server_key: "118e4a9af2741bb7983ef8ccf5aaaf62"
server_key_iv: "12d4557d27ec4c7b902376f4aec51911"
server_key_version: "encryptionkey@0"
I20260811 08:06:31.536175 30852 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 08:06:31.537081 30868 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:06:31.537261 30852 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:06:31.537357 30852 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/master-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/master-0/wal
uuid: "1767bedafd404afdbb667219a20a6440"
format_stamp: "Formatted at 2026-08-11 08:06:31 on dist-test-slave-2w3w"
server_key: "118e4a9af2741bb7983ef8ccf5aaaf62"
server_key_iv: "12d4557d27ec4c7b902376f4aec51911"
server_key_version: "encryptionkey@0"
I20260811 08:06:31.537458 30852 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:06:31.550261 30852 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:06:31.552651 30852 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:06:31.552825 30852 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:06:31.557539 30852 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.254:40173
I20260811 08:06:31.557578 30927 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.254:40173 every 8 connection(s)
I20260811 08:06:31.557950 30852 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
I20260811 08:06:31.558954 30928 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:06:31.561414 30928 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1767bedafd404afdbb667219a20a6440: Bootstrap starting.
I20260811 08:06:31.562037 30928 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1767bedafd404afdbb667219a20a6440: Neither blocks nor log segments found. Creating new log.
I20260811 08:06:31.562340 30928 log.cc:824] T 00000000000000000000000000000000 P 1767bedafd404afdbb667219a20a6440: Log is configured to *not* fsync() on all Append() calls
I20260811 08:06:31.563194 30928 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1767bedafd404afdbb667219a20a6440: No bootstrap required, opened a new log
I20260811 08:06:31.564894 30928 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1767bedafd404afdbb667219a20a6440 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1767bedafd404afdbb667219a20a6440" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 40173 } }
I20260811 08:06:31.565053 30928 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1767bedafd404afdbb667219a20a6440 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:06:31.565078 30928 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1767bedafd404afdbb667219a20a6440 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1767bedafd404afdbb667219a20a6440, State: Initialized, Role: FOLLOWER
I20260811 08:06:31.565237 30928 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1767bedafd404afdbb667219a20a6440 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1767bedafd404afdbb667219a20a6440" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 40173 } }
I20260811 08:06:31.565323 30928 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1767bedafd404afdbb667219a20a6440 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:06:31.565369 30928 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1767bedafd404afdbb667219a20a6440 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:06:31.565442 30928 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1767bedafd404afdbb667219a20a6440 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:06:31.566329 30928 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1767bedafd404afdbb667219a20a6440 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1767bedafd404afdbb667219a20a6440" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 40173 } }
I20260811 08:06:31.566454 30928 leader_election.cc:302] T 00000000000000000000000000000000 P 1767bedafd404afdbb667219a20a6440 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1767bedafd404afdbb667219a20a6440; no voters:
I20260811 08:06:31.566649 30928 leader_election.cc:288] T 00000000000000000000000000000000 P 1767bedafd404afdbb667219a20a6440 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:06:31.566704 30932 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1767bedafd404afdbb667219a20a6440 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:06:31.566931 30928 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1767bedafd404afdbb667219a20a6440 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:06:31.567178 30932 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1767bedafd404afdbb667219a20a6440 [term 1 LEADER]: Becoming Leader. State: Replica: 1767bedafd404afdbb667219a20a6440, State: Running, Role: LEADER
I20260811 08:06:31.567225 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 30852
I20260811 08:06:31.567345 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/master-0/wal/instance
I20260811 08:06:31.567366 30932 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1767bedafd404afdbb667219a20a6440 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1767bedafd404afdbb667219a20a6440" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 40173 } }
I20260811 08:06:31.567556 15507 external_mini_cluster.cc:1428] Setting key 3ba460b0d85e319db214d2e6df808548
I20260811 08:06:31.567780 30933 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1767bedafd404afdbb667219a20a6440 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1767bedafd404afdbb667219a20a6440" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1767bedafd404afdbb667219a20a6440" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 40173 } } }
I20260811 08:06:31.567879 30933 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1767bedafd404afdbb667219a20a6440 [sys.catalog]: This master's current role is: LEADER
I20260811 08:06:31.568059 30934 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1767bedafd404afdbb667219a20a6440 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1767bedafd404afdbb667219a20a6440. Latest consensus state: current_term: 1 leader_uuid: "1767bedafd404afdbb667219a20a6440" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1767bedafd404afdbb667219a20a6440" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 40173 } } }
I20260811 08:06:31.568122 30934 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1767bedafd404afdbb667219a20a6440 [sys.catalog]: This master's current role is: LEADER
I20260811 08:06:31.568548 30943 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:06:31.569139 30943 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:06:31.570812 30943 catalog_manager.cc:1347] Generated new cluster ID: 4c7befe33c884de1ab74448e8864744c
I20260811 08:06:31.570873 30943 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 08:06:31 dist-test-slave-2w3w krb5kdc[30834](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435591, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:06:31.575470 30943 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:06:31.576203 30943 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:06:31.578462 30950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:31.568270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47424 (local address 127.15.36.254:40173)
0811 08:06:31.568824 (+ 554us) server_negotiation.cc:206] Beginning negotiation
0811 08:06:31.568837 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 08:06:31.568880 (+ 43us) server_negotiation.cc:407] Connection header received
0811 08:06:31.569017 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:06:31.569022 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:06:31.569069 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:06:31.569247 (+ 178us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:06:31.569896 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:31.571112 (+ 1216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:31.571904 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:31.572343 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:31.572466 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:31.574933 (+ 2467us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:06:31.574939 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:06:31.574940 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:06:31.575003 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:06:31.576873 (+ 1870us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:31.577254 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:31.577257 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:31.577258 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:31.577352 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:31.577587 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:31.577588 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:31.577588 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:31.577815 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:06:31.577997 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0811 08:06:31.578117 (+ 120us) server_negotiation.cc:299] Negotiation successful
0811 08:06:31.578280 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":502,"thread_start_us":120,"threads_started":1}
I20260811 08:06:31.580052 30943 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1767bedafd404afdbb667219a20a6440: Generated new TSK 0
I20260811 08:06:31.580248 30943 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.36.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab.
Entry for principal kudu/127.15.36.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab.
I20260811 08:06:31.615477 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.193:0
--local_ip_for_outbound_sockets=127.15.36.193
--webserver_interface=127.15.36.193
--webserver_port=0
--tserver_master_addrs=127.15.36.254:40173
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab
--principal=kudu/127.15.36.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:34085
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:06:31.714618 30958 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:06:31.714874 30958 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:06:31.714901 30958 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:06:31.716156 30958 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:06:31.716214 30958 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:06:31.716244 30958 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.193
I20260811 08:06:31.717790 30958 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:34085
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab
--principal=kudu/127.15.36.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.36.193
--webserver_port=0
--tserver_master_addrs=127.15.36.254:40173
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30958
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.193
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:06:31.718068 30958 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:06:31.718355 30958 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:06:31.725179 30964 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:06:31.725189 30965 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:06:31.725270 30967 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:06:31.725487 30958 server_base.cc:1034] running on GCE node
I20260811 08:06:31.725744 30958 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:06:31.726086 30958 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:06:31.727273 30958 hybrid_clock.cc:648] HybridClock initialized: now 1786435591727249 us; error 39 us; skew 500 ppm
Aug 11 08:06:31 dist-test-slave-2w3w krb5kdc[30834](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435591, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:06:31.734066 30958 init.cc:377] Logged in from keytab as kudu/127.15.36.193@KRBTEST.COM (short username kudu)
I20260811 08:06:31.734602 30958 webserver.cc:460] Webserver started at http://127.15.36.193:36107/ using document root <none> and password file <none>
I20260811 08:06:31.734853 30958 fs_manager.cc:359] Metadata directory not provided
I20260811 08:06:31.734931 30958 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:06:31.735118 30958 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:06:31.736222 30958 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-0/data/instance:
uuid: "929b168c73e648dfa25f494e90a0ed3c"
format_stamp: "Formatted at 2026-08-11 08:06:31 on dist-test-slave-2w3w"
server_key: "2b0fd6bc146982af62e1c0f877165719"
server_key_iv: "0c0f914d5c03f13c6d67ca14dba29b15"
server_key_version: "encryptionkey@0"
I20260811 08:06:31.736599 30958 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-0/wal/instance:
uuid: "929b168c73e648dfa25f494e90a0ed3c"
format_stamp: "Formatted at 2026-08-11 08:06:31 on dist-test-slave-2w3w"
server_key: "2b0fd6bc146982af62e1c0f877165719"
server_key_iv: "0c0f914d5c03f13c6d67ca14dba29b15"
server_key_version: "encryptionkey@0"
I20260811 08:06:31.738073 30958 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 08:06:31.738883 30976 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:06:31.739185 30958 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:06:31.739288 30958 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-0/wal
uuid: "929b168c73e648dfa25f494e90a0ed3c"
format_stamp: "Formatted at 2026-08-11 08:06:31 on dist-test-slave-2w3w"
server_key: "2b0fd6bc146982af62e1c0f877165719"
server_key_iv: "0c0f914d5c03f13c6d67ca14dba29b15"
server_key_version: "encryptionkey@0"
I20260811 08:06:31.739362 30958 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:06:31.755858 30958 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:06:31.758464 30958 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:06:31.758595 30958 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:06:31.758817 30958 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:06:31.759222 30958 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:06:31.759262 30958 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:06:31.759289 30958 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:06:31.759330 30958 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:06:31.765760 30958 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.193:35083
I20260811 08:06:31.765842 31100 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.193:35083 every 8 connection(s)
I20260811 08:06:31.766209 30958 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
Aug 11 08:06:31 dist-test-slave-2w3w krb5kdc[30834](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435591, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.193@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:06:31.772701 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 30958
I20260811 08:06:31.772804 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-0/wal/instance
I20260811 08:06:31.773041 15507 external_mini_cluster.cc:1428] Setting key 0125fc963e43a88548cbead25d3c7d33
I20260811 08:06:31.777119 30950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:31.767029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:57479 (local address 127.15.36.254:40173)
0811 08:06:31.767095 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 08:06:31.767097 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:06:31.767339 (+ 242us) server_negotiation.cc:407] Connection header received
0811 08:06:31.767881 (+ 542us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:06:31.767882 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:06:31.767894 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:06:31.767939 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:06:31.769073 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:31.769600 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:31.770625 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:31.770847 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:31.770929 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:31.773366 (+ 2437us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:06:31.773368 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:06:31.773368 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:06:31.773389 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:06:31.775534 (+ 2145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:31.775988 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:31.775989 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:31.775989 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:31.776074 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:31.776434 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:31.776435 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:31.776435 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:31.776548 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:06:31.776612 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 08:06:31.776968 (+ 356us) server_negotiation.cc:299] Negotiation successful
0811 08:06:31.777051 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 08:06:31.777441 31103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:31.767008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:40173 (local address 127.15.36.193:57479)
0811 08:06:31.767212 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:31.767250 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 08:06:31.767771 (+ 521us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:06:31.768098 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:06:31.768101 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:06:31.768706 (+ 605us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:06:31.768950 (+ 244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:31.768955 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:31.769708 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:31.769709 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:31.770525 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:31.770528 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:31.770939 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:31.770940 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:31.771092 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:31.771610 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:06:31.771618 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:06:31.773209 (+ 1591us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:06:31.775653 (+ 2444us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:06:31.775661 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:06:31.775663 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:06:31.775899 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:06:31.776180 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:06:31.776181 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:06:31.776182 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:06:31.776362 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:06:31.776619 (+ 257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:06:31.776626 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:06:31.776810 (+ 184us) client_negotiation.cc:769] Sending connection context
0811 08:06:31.776938 (+ 128us) client_negotiation.cc:240] Negotiation successful
0811 08:06:31.777139 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":89,"threads_started":1}
I20260811 08:06:31.778064 31101 heartbeater.cc:347] Connected to a master server at 127.15.36.254:40173
I20260811 08:06:31.778178 31101 heartbeater.cc:464] Registering TS with master...
I20260811 08:06:31.778381 31101 heartbeater.cc:511] Master 127.15.36.254:40173 requested a full tablet report, sending...
I20260811 08:06:31.779072 30888 ts_manager.cc:194] Registered new tserver with Master: 929b168c73e648dfa25f494e90a0ed3c (127.15.36.193:35083)
I20260811 08:06:31.779729 30888 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.36.193@KRBTEST.COM'} at 127.15.36.193:57479
WARNING: no policy specified for kudu/127.15.36.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab.
Entry for principal kudu/127.15.36.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab.
I20260811 08:06:31.808228 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.194:0
--local_ip_for_outbound_sockets=127.15.36.194
--webserver_interface=127.15.36.194
--webserver_port=0
--tserver_master_addrs=127.15.36.254:40173
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab
--principal=kudu/127.15.36.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:34085
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:06:31.893676 31106 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:06:31.893998 31106 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:06:31.894027 31106 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:06:31.895231 31106 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:06:31.895273 31106 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:06:31.895301 31106 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.194
I20260811 08:06:31.896749 31106 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:34085
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab
--principal=kudu/127.15.36.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.36.194
--webserver_port=0
--tserver_master_addrs=127.15.36.254:40173
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31106
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.194
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:06:31.896991 31106 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:06:31.897194 31106 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:06:31.902412 31113 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:06:31.902431 31116 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:06:31.902412 31112 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:06:31.902746 31106 server_base.cc:1034] running on GCE node
I20260811 08:06:31.903045 31106 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:06:31.903332 31106 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:06:31.904501 31106 hybrid_clock.cc:648] HybridClock initialized: now 1786435591904479 us; error 45 us; skew 500 ppm
Aug 11 08:06:31 dist-test-slave-2w3w krb5kdc[30834](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435591, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:06:31.907274 31106 init.cc:377] Logged in from keytab as kudu/127.15.36.194@KRBTEST.COM (short username kudu)
I20260811 08:06:31.907755 31106 webserver.cc:460] Webserver started at http://127.15.36.194:35375/ using document root <none> and password file <none>
I20260811 08:06:31.908003 31106 fs_manager.cc:359] Metadata directory not provided
I20260811 08:06:31.908075 31106 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:06:31.908233 31106 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:06:31.909399 31106 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-1/data/instance:
uuid: "64adbd65b8404e7180a20b86ad63bca9"
format_stamp: "Formatted at 2026-08-11 08:06:31 on dist-test-slave-2w3w"
server_key: "1fc5d2c099ed50f6eefa074e18b40eca"
server_key_iv: "db1d2b5dba17dceecea686704526c775"
server_key_version: "encryptionkey@0"
I20260811 08:06:31.909781 31106 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-1/wal/instance:
uuid: "64adbd65b8404e7180a20b86ad63bca9"
format_stamp: "Formatted at 2026-08-11 08:06:31 on dist-test-slave-2w3w"
server_key: "1fc5d2c099ed50f6eefa074e18b40eca"
server_key_iv: "db1d2b5dba17dceecea686704526c775"
server_key_version: "encryptionkey@0"
I20260811 08:06:31.911312 31106 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260811 08:06:31.912166 31124 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:06:31.912390 31106 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:06:31.912513 31106 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-1/wal
uuid: "64adbd65b8404e7180a20b86ad63bca9"
format_stamp: "Formatted at 2026-08-11 08:06:31 on dist-test-slave-2w3w"
server_key: "1fc5d2c099ed50f6eefa074e18b40eca"
server_key_iv: "db1d2b5dba17dceecea686704526c775"
server_key_version: "encryptionkey@0"
I20260811 08:06:31.912602 31106 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:06:31.944090 31106 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:06:31.946192 31106 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:06:31.946378 31106 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:06:31.946633 31106 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:06:31.947013 31106 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:06:31.947065 31106 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:06:31.947088 31106 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:06:31.947132 31106 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:06:31.954329 31106 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.194:40745
I20260811 08:06:31.954420 31252 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.194:40745 every 8 connection(s)
I20260811 08:06:31.955017 31106 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
Aug 11 08:06:31 dist-test-slave-2w3w krb5kdc[30834](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435591, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.194@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:06:31.965123 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 31106
I20260811 08:06:31.965274 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-1/wal/instance
I20260811 08:06:31.965509 15507 external_mini_cluster.cc:1428] Setting key 35eff8eab3c77adcc4d02d64329e24e0
I20260811 08:06:31.968588 30950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:31.956535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:41599 (local address 127.15.36.254:40173)
0811 08:06:31.956597 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 08:06:31.956598 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:06:31.956610 (+ 12us) server_negotiation.cc:407] Connection header received
0811 08:06:31.957378 (+ 768us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:06:31.957379 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:06:31.957393 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:06:31.957453 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:06:31.958921 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:31.959819 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:31.961017 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:31.961317 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:31.961396 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:31.964470 (+ 3074us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:06:31.964472 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:06:31.964473 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:06:31.964486 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:06:31.966376 (+ 1890us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:31.967039 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:31.967041 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:31.967041 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:31.967123 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:31.967550 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:31.967552 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:31.967552 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:31.967779 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:06:31.967872 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 08:06:31.968353 (+ 481us) server_negotiation.cc:299] Negotiation successful
0811 08:06:31.968447 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 08:06:31.968818 31255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:31.956174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:40173 (local address 127.15.36.194:41599)
0811 08:06:31.956406 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:31.956475 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0811 08:06:31.957238 (+ 763us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:06:31.957607 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:06:31.957611 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:06:31.958491 (+ 880us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:06:31.958800 (+ 309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:31.958807 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:31.959933 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:31.959935 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:31.960934 (+ 999us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:31.960938 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:31.961418 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:31.961419 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:31.961584 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:31.962302 (+ 718us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:06:31.962314 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:06:31.964332 (+ 2018us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:06:31.966500 (+ 2168us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:06:31.966511 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:06:31.966514 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:06:31.966911 (+ 397us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:06:31.967239 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:06:31.967240 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:06:31.967240 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:06:31.967411 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:06:31.967871 (+ 460us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:06:31.967880 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:06:31.968129 (+ 249us) client_negotiation.cc:769] Sending connection context
0811 08:06:31.968316 (+ 187us) client_negotiation.cc:240] Negotiation successful
0811 08:06:31.968519 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":107,"threads_started":1}
I20260811 08:06:31.969323 31253 heartbeater.cc:347] Connected to a master server at 127.15.36.254:40173
I20260811 08:06:31.969451 31253 heartbeater.cc:464] Registering TS with master...
I20260811 08:06:31.969676 31253 heartbeater.cc:511] Master 127.15.36.254:40173 requested a full tablet report, sending...
I20260811 08:06:31.970670 30888 ts_manager.cc:194] Registered new tserver with Master: 64adbd65b8404e7180a20b86ad63bca9 (127.15.36.194:40745)
I20260811 08:06:31.971326 30888 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.36.194@KRBTEST.COM'} at 127.15.36.194:41599
WARNING: no policy specified for kudu/127.15.36.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab.
Entry for principal kudu/127.15.36.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab.
I20260811 08:06:31.998469 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.195:0
--local_ip_for_outbound_sockets=127.15.36.195
--webserver_interface=127.15.36.195
--webserver_port=0
--tserver_master_addrs=127.15.36.254:40173
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab
--principal=kudu/127.15.36.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:34085
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:06:32.084836 31260 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:06:32.085063 31260 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:06:32.085090 31260 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:06:32.086220 31260 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:06:32.086261 31260 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:06:32.086288 31260 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.195
I20260811 08:06:32.087846 31260 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:34085
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab
--principal=kudu/127.15.36.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.36.195
--webserver_port=0
--tserver_master_addrs=127.15.36.254:40173
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31260
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.195
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:06:32.088065 31260 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:06:32.088279 31260 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 08:06:32.093766 31260 server_base.cc:1034] running on GCE node
W20260811 08:06:32.093732 31266 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:06:32.093709 31268 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:06:32.093719 31265 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:06:32.094277 31260 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:06:32.094551 31260 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:06:32.095745 31260 hybrid_clock.cc:648] HybridClock initialized: now 1786435592095740 us; error 42 us; skew 500 ppm
Aug 11 08:06:32 dist-test-slave-2w3w krb5kdc[30834](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435592, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:06:32.098469 31260 init.cc:377] Logged in from keytab as kudu/127.15.36.195@KRBTEST.COM (short username kudu)
I20260811 08:06:32.099048 31260 webserver.cc:460] Webserver started at http://127.15.36.195:43185/ using document root <none> and password file <none>
I20260811 08:06:32.099252 31260 fs_manager.cc:359] Metadata directory not provided
I20260811 08:06:32.099293 31260 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:06:32.099390 31260 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:06:32.100507 31260 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-2/data/instance:
uuid: "c472ff7214044afdb58b3e8c9c52a44f"
format_stamp: "Formatted at 2026-08-11 08:06:32 on dist-test-slave-2w3w"
server_key: "77ddd1edaeda8bde221ab1e564df28c6"
server_key_iv: "81f5503f09b2a707635afabbd0b3d13c"
server_key_version: "encryptionkey@0"
I20260811 08:06:32.100823 31260 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-2/wal/instance:
uuid: "c472ff7214044afdb58b3e8c9c52a44f"
format_stamp: "Formatted at 2026-08-11 08:06:32 on dist-test-slave-2w3w"
server_key: "77ddd1edaeda8bde221ab1e564df28c6"
server_key_iv: "81f5503f09b2a707635afabbd0b3d13c"
server_key_version: "encryptionkey@0"
I20260811 08:06:32.102176 31260 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 08:06:32.102934 31277 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:06:32.103164 31260 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:06:32.103262 31260 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-2/wal
uuid: "c472ff7214044afdb58b3e8c9c52a44f"
format_stamp: "Formatted at 2026-08-11 08:06:32 on dist-test-slave-2w3w"
server_key: "77ddd1edaeda8bde221ab1e564df28c6"
server_key_iv: "81f5503f09b2a707635afabbd0b3d13c"
server_key_version: "encryptionkey@0"
I20260811 08:06:32.103324 31260 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:06:32.109865 31260 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:06:32.111991 31260 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:06:32.112109 31260 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:06:32.112306 31260 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:06:32.112583 31260 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:06:32.112614 31260 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:06:32.112636 31260 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:06:32.112649 31260 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:06:32.118731 31260 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.195:43709
I20260811 08:06:32.118814 31403 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.195:43709 every 8 connection(s)
I20260811 08:06:32.119187 31260 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
I20260811 08:06:32.124823 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 31260
I20260811 08:06:32.124939 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-2/wal/instance
I20260811 08:06:32.125133 15507 external_mini_cluster.cc:1428] Setting key 5df7fbc784f0a1f408309bcf4ef502ec
Aug 11 08:06:32 dist-test-slave-2w3w krb5kdc[30834](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435592, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.195@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:06:32.129792 30950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:32.120059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:46285 (local address 127.15.36.254:40173)
0811 08:06:32.120133 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0811 08:06:32.120135 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:06:32.120426 (+ 291us) server_negotiation.cc:407] Connection header received
0811 08:06:32.120921 (+ 495us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:06:32.120921 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:06:32.120935 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:06:32.121001 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:06:32.122040 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:32.122560 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:32.123678 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:32.123876 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:32.123948 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:32.126733 (+ 2785us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:06:32.126734 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:06:32.126735 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:06:32.126743 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:06:32.128272 (+ 1529us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:32.128736 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:32.128737 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:32.128738 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:32.128800 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:32.129074 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:32.129075 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:32.129075 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:32.129206 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:06:32.129280 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 08:06:32.129591 (+ 311us) server_negotiation.cc:299] Negotiation successful
0811 08:06:32.129694 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 08:06:32.130002 31406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:32.120028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:40173 (local address 127.15.36.195:46285)
0811 08:06:32.120288 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:32.120328 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 08:06:32.120805 (+ 477us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:06:32.121073 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:06:32.121077 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:06:32.121678 (+ 601us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:06:32.121890 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:32.121895 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:32.122656 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:32.122656 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:32.123587 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:32.123590 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:32.123981 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:32.123982 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:32.124089 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:32.124732 (+ 643us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:06:32.124742 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:06:32.126622 (+ 1880us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:06:32.128382 (+ 1760us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:06:32.128392 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:06:32.128395 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:06:32.128644 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:06:32.128883 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:06:32.128883 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:06:32.128884 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:06:32.129002 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:06:32.129283 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:06:32.129291 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:06:32.129446 (+ 155us) client_negotiation.cc:769] Sending connection context
0811 08:06:32.129554 (+ 108us) client_negotiation.cc:240] Negotiation successful
0811 08:06:32.129730 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":145,"threads_started":1}
I20260811 08:06:32.130527 31404 heartbeater.cc:347] Connected to a master server at 127.15.36.254:40173
I20260811 08:06:32.130617 31404 heartbeater.cc:464] Registering TS with master...
I20260811 08:06:32.130831 31404 heartbeater.cc:511] Master 127.15.36.254:40173 requested a full tablet report, sending...
I20260811 08:06:32.131310 30888 ts_manager.cc:194] Registered new tserver with Master: c472ff7214044afdb58b3e8c9c52a44f (127.15.36.195:43709)
I20260811 08:06:32.131711 30888 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.36.195@KRBTEST.COM'} at 127.15.36.195:46285
I20260811 08:06:32.136948 15507 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 08:06:32.145005 30950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:32.138311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47440 (local address 127.15.36.254:40173)
0811 08:06:32.138408 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0811 08:06:32.138410 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:06:32.138508 (+ 98us) server_negotiation.cc:407] Connection header received
0811 08:06:32.138615 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:06:32.138615 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:06:32.138627 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:06:32.138674 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:06:32.139334 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:32.139836 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:32.140660 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:32.140874 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:32.140968 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:32.142350 (+ 1382us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:06:32.142352 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:06:32.142352 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:06:32.142360 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:06:32.143778 (+ 1418us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:32.144149 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:32.144151 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:32.144152 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:32.144209 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:32.144417 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:32.144418 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:32.144418 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:32.144579 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:06:32.144686 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0811 08:06:32.144798 (+ 112us) server_negotiation.cc:299] Negotiation successful
0811 08:06:32.144887 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 08:06:32.146651 30888 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47440:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:06:32.148312 30888 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:06:32.154873 31421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:32.151052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46246 (local address 127.15.36.193:35083)
0811 08:06:32.151234 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0811 08:06:32.151238 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:06:32.151247 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:06:32.151281 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:06:32.151282 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:06:32.151295 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:06:32.151358 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:06:32.151576 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:32.152468 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:32.153691 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:32.154432 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:32.154515 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:32.154577 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 08:06:32.154741 (+ 164us) server_negotiation.cc:299] Negotiation successful
0811 08:06:32.154782 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":75,"threads_started":1}
I20260811 08:06:32.154903 31416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:32.150755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.193:35083 (local address 127.0.0.1:46246)
0811 08:06:32.151086 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:32.151096 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:06:32.151138 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:06:32.151406 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:06:32.151409 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:06:32.151411 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:06:32.151482 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:32.151484 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:32.152573 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:32.152574 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:32.153593 (+ 1019us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:32.153595 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:32.154516 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:32.154517 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:32.154607 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:32.154621 (+ 14us) client_negotiation.cc:769] Sending connection context
0811 08:06:32.154721 (+ 100us) client_negotiation.cc:240] Negotiation successful
0811 08:06:32.154778 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":320,"thread_start_us":105,"threads_started":1}
I20260811 08:06:32.155382 31417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:32.150737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.194:40745 (local address 127.0.0.1:35738)
0811 08:06:32.150978 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:32.151021 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 08:06:32.151089 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:06:32.151804 (+ 715us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:06:32.151804 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:06:32.151806 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:06:32.151845 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:32.151847 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:32.153179 (+ 1332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:32.153180 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:32.154249 (+ 1069us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:32.154252 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:32.155144 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:32.155145 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:32.155205 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:32.155209 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:06:32.155258 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 08:06:32.155297 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180,"mutex_wait_us":2,"thread_start_us":52,"threads_started":1}
I20260811 08:06:32.155402 31419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:32.150890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35738 (local address 127.15.36.194:40745)
0811 08:06:32.151584 (+ 694us) server_negotiation.cc:206] Beginning negotiation
0811 08:06:32.151588 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:06:32.151597 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:06:32.151637 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:06:32.151638 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:06:32.151654 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:06:32.151725 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:06:32.151923 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:32.153058 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:32.154337 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:32.155085 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:32.155145 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:32.155195 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 08:06:32.155269 (+ 74us) server_negotiation.cc:299] Negotiation successful
0811 08:06:32.155317 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":652,"thread_start_us":109,"threads_started":1}
I20260811 08:06:32.155556 31420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:32.151023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38702 (local address 127.15.36.195:43709)
0811 08:06:32.151288 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0811 08:06:32.151293 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:06:32.151303 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:06:32.151343 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:06:32.151344 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:06:32.151361 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:06:32.151447 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:06:32.152028 (+ 581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:32.153087 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:32.154216 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:32.155009 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:32.155081 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:32.155135 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 08:06:32.155427 (+ 292us) server_negotiation.cc:299] Negotiation successful
0811 08:06:32.155476 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":224,"thread_start_us":97,"threads_started":1}
I20260811 08:06:32.155793 31418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:32.150757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.195:43709 (local address 127.0.0.1:38702)
0811 08:06:32.151198 (+ 441us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:32.151206 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 08:06:32.151246 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:06:32.151925 (+ 679us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:06:32.151926 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:06:32.151927 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:06:32.151954 (+ 27us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:32.151954 (+ 0us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:32.153197 (+ 1243us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:32.153198 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:32.154126 (+ 928us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:32.154128 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:32.155174 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:32.155175 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:32.155247 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:32.155252 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 08:06:32.155304 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 08:06:32.155342 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":425,"spinlock_wait_cycles":384,"thread_start_us":107,"threads_started":1}
I20260811 08:06:32.156040 31029 tablet_service.cc:1467] Processing CreateTablet for tablet 577af21e1ff0426cbfa4f9b21cb60397 (DEFAULT_TABLE table=test-table [id=1a53cf6b723d4ee49351209dad182643]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:06:32.156455 31029 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 577af21e1ff0426cbfa4f9b21cb60397. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:06:32.156559 31332 tablet_service.cc:1467] Processing CreateTablet for tablet 577af21e1ff0426cbfa4f9b21cb60397 (DEFAULT_TABLE table=test-table [id=1a53cf6b723d4ee49351209dad182643]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:06:32.156857 31332 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 577af21e1ff0426cbfa4f9b21cb60397. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:06:32.159668 31182 tablet_service.cc:1467] Processing CreateTablet for tablet 577af21e1ff0426cbfa4f9b21cb60397 (DEFAULT_TABLE table=test-table [id=1a53cf6b723d4ee49351209dad182643]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:06:32.159992 31182 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 577af21e1ff0426cbfa4f9b21cb60397. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:06:32.161412 31423 tablet_bootstrap.cc:492] T 577af21e1ff0426cbfa4f9b21cb60397 P c472ff7214044afdb58b3e8c9c52a44f: Bootstrap starting.
I20260811 08:06:32.162079 31422 tablet_bootstrap.cc:492] T 577af21e1ff0426cbfa4f9b21cb60397 P 929b168c73e648dfa25f494e90a0ed3c: Bootstrap starting.
I20260811 08:06:32.162830 31423 tablet_bootstrap.cc:654] T 577af21e1ff0426cbfa4f9b21cb60397 P c472ff7214044afdb58b3e8c9c52a44f: Neither blocks nor log segments found. Creating new log.
I20260811 08:06:32.163498 31423 log.cc:824] T 577af21e1ff0426cbfa4f9b21cb60397 P c472ff7214044afdb58b3e8c9c52a44f: Log is configured to *not* fsync() on all Append() calls
I20260811 08:06:32.163677 31425 tablet_bootstrap.cc:492] T 577af21e1ff0426cbfa4f9b21cb60397 P 64adbd65b8404e7180a20b86ad63bca9: Bootstrap starting.
I20260811 08:06:32.163920 31422 tablet_bootstrap.cc:654] T 577af21e1ff0426cbfa4f9b21cb60397 P 929b168c73e648dfa25f494e90a0ed3c: Neither blocks nor log segments found. Creating new log.
I20260811 08:06:32.164475 31425 tablet_bootstrap.cc:654] T 577af21e1ff0426cbfa4f9b21cb60397 P 64adbd65b8404e7180a20b86ad63bca9: Neither blocks nor log segments found. Creating new log.
I20260811 08:06:32.164502 31422 log.cc:824] T 577af21e1ff0426cbfa4f9b21cb60397 P 929b168c73e648dfa25f494e90a0ed3c: Log is configured to *not* fsync() on all Append() calls
I20260811 08:06:32.165163 31425 log.cc:824] T 577af21e1ff0426cbfa4f9b21cb60397 P 64adbd65b8404e7180a20b86ad63bca9: Log is configured to *not* fsync() on all Append() calls
I20260811 08:06:32.166091 31425 tablet_bootstrap.cc:492] T 577af21e1ff0426cbfa4f9b21cb60397 P 64adbd65b8404e7180a20b86ad63bca9: No bootstrap required, opened a new log
I20260811 08:06:32.166168 31425 ts_tablet_manager.cc:1397] T 577af21e1ff0426cbfa4f9b21cb60397 P 64adbd65b8404e7180a20b86ad63bca9: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 08:06:32.167275 31423 tablet_bootstrap.cc:492] T 577af21e1ff0426cbfa4f9b21cb60397 P c472ff7214044afdb58b3e8c9c52a44f: No bootstrap required, opened a new log
I20260811 08:06:32.167361 31423 ts_tablet_manager.cc:1397] T 577af21e1ff0426cbfa4f9b21cb60397 P c472ff7214044afdb58b3e8c9c52a44f: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260811 08:06:32.168231 31422 tablet_bootstrap.cc:492] T 577af21e1ff0426cbfa4f9b21cb60397 P 929b168c73e648dfa25f494e90a0ed3c: No bootstrap required, opened a new log
I20260811 08:06:32.168397 31422 ts_tablet_manager.cc:1397] T 577af21e1ff0426cbfa4f9b21cb60397 P 929b168c73e648dfa25f494e90a0ed3c: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260811 08:06:32.168476 31425 raft_consensus.cc:348] T 577af21e1ff0426cbfa4f9b21cb60397 P 64adbd65b8404e7180a20b86ad63bca9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64adbd65b8404e7180a20b86ad63bca9" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 40745 } } peers { permanent_uuid: "929b168c73e648dfa25f494e90a0ed3c" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 35083 } } peers { permanent_uuid: "c472ff7214044afdb58b3e8c9c52a44f" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 43709 } }
I20260811 08:06:32.168673 31425 raft_consensus.cc:374] T 577af21e1ff0426cbfa4f9b21cb60397 P 64adbd65b8404e7180a20b86ad63bca9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:06:32.168720 31425 raft_consensus.cc:729] T 577af21e1ff0426cbfa4f9b21cb60397 P 64adbd65b8404e7180a20b86ad63bca9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64adbd65b8404e7180a20b86ad63bca9, State: Initialized, Role: FOLLOWER
I20260811 08:06:32.168881 31425 consensus_queue.cc:260] T 577af21e1ff0426cbfa4f9b21cb60397 P 64adbd65b8404e7180a20b86ad63bca9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64adbd65b8404e7180a20b86ad63bca9" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 40745 } } peers { permanent_uuid: "929b168c73e648dfa25f494e90a0ed3c" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 35083 } } peers { permanent_uuid: "c472ff7214044afdb58b3e8c9c52a44f" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 43709 } }
I20260811 08:06:32.169445 31425 ts_tablet_manager.cc:1428] T 577af21e1ff0426cbfa4f9b21cb60397 P 64adbd65b8404e7180a20b86ad63bca9: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 08:06:32.169584 31253 heartbeater.cc:503] Master 127.15.36.254:40173 was elected leader, sending a full tablet report...
I20260811 08:06:32.169646 31423 raft_consensus.cc:348] T 577af21e1ff0426cbfa4f9b21cb60397 P c472ff7214044afdb58b3e8c9c52a44f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64adbd65b8404e7180a20b86ad63bca9" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 40745 } } peers { permanent_uuid: "929b168c73e648dfa25f494e90a0ed3c" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 35083 } } peers { permanent_uuid: "c472ff7214044afdb58b3e8c9c52a44f" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 43709 } }
I20260811 08:06:32.169811 31423 raft_consensus.cc:374] T 577af21e1ff0426cbfa4f9b21cb60397 P c472ff7214044afdb58b3e8c9c52a44f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:06:32.169853 31423 raft_consensus.cc:729] T 577af21e1ff0426cbfa4f9b21cb60397 P c472ff7214044afdb58b3e8c9c52a44f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c472ff7214044afdb58b3e8c9c52a44f, State: Initialized, Role: FOLLOWER
I20260811 08:06:32.169991 31423 consensus_queue.cc:260] T 577af21e1ff0426cbfa4f9b21cb60397 P c472ff7214044afdb58b3e8c9c52a44f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64adbd65b8404e7180a20b86ad63bca9" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 40745 } } peers { permanent_uuid: "929b168c73e648dfa25f494e90a0ed3c" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 35083 } } peers { permanent_uuid: "c472ff7214044afdb58b3e8c9c52a44f" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 43709 } }
I20260811 08:06:32.170267 31423 ts_tablet_manager.cc:1428] T 577af21e1ff0426cbfa4f9b21cb60397 P c472ff7214044afdb58b3e8c9c52a44f: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20260811 08:06:32.170411 31404 heartbeater.cc:503] Master 127.15.36.254:40173 was elected leader, sending a full tablet report...
I20260811 08:06:32.172041 31422 raft_consensus.cc:348] T 577af21e1ff0426cbfa4f9b21cb60397 P 929b168c73e648dfa25f494e90a0ed3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64adbd65b8404e7180a20b86ad63bca9" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 40745 } } peers { permanent_uuid: "929b168c73e648dfa25f494e90a0ed3c" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 35083 } } peers { permanent_uuid: "c472ff7214044afdb58b3e8c9c52a44f" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 43709 } }
I20260811 08:06:32.172226 31422 raft_consensus.cc:374] T 577af21e1ff0426cbfa4f9b21cb60397 P 929b168c73e648dfa25f494e90a0ed3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:06:32.172303 31422 raft_consensus.cc:729] T 577af21e1ff0426cbfa4f9b21cb60397 P 929b168c73e648dfa25f494e90a0ed3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 929b168c73e648dfa25f494e90a0ed3c, State: Initialized, Role: FOLLOWER
I20260811 08:06:32.172413 31422 consensus_queue.cc:260] T 577af21e1ff0426cbfa4f9b21cb60397 P 929b168c73e648dfa25f494e90a0ed3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64adbd65b8404e7180a20b86ad63bca9" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 40745 } } peers { permanent_uuid: "929b168c73e648dfa25f494e90a0ed3c" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 35083 } } peers { permanent_uuid: "c472ff7214044afdb58b3e8c9c52a44f" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 43709 } }
I20260811 08:06:32.172744 31422 ts_tablet_manager.cc:1428] T 577af21e1ff0426cbfa4f9b21cb60397 P 929b168c73e648dfa25f494e90a0ed3c: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260811 08:06:32.172780 31101 heartbeater.cc:503] Master 127.15.36.254:40173 was elected leader, sending a full tablet report...
W20260811 08:06:32.205772 31254 tablet.cc:2369] T 577af21e1ff0426cbfa4f9b21cb60397 P 64adbd65b8404e7180a20b86ad63bca9: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 08:06:32.267158 31102 tablet.cc:2369] T 577af21e1ff0426cbfa4f9b21cb60397 P 929b168c73e648dfa25f494e90a0ed3c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 08:06:32.369895 31405 tablet.cc:2369] T 577af21e1ff0426cbfa4f9b21cb60397 P c472ff7214044afdb58b3e8c9c52a44f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:06:32.569569 31433 raft_consensus.cc:482] T 577af21e1ff0426cbfa4f9b21cb60397 P 929b168c73e648dfa25f494e90a0ed3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:06:32.569710 31433 raft_consensus.cc:504] T 577af21e1ff0426cbfa4f9b21cb60397 P 929b168c73e648dfa25f494e90a0ed3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64adbd65b8404e7180a20b86ad63bca9" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 40745 } } peers { permanent_uuid: "929b168c73e648dfa25f494e90a0ed3c" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 35083 } } peers { permanent_uuid: "c472ff7214044afdb58b3e8c9c52a44f" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 43709 } }
I20260811 08:06:32.570062 31433 leader_election.cc:288] T 577af21e1ff0426cbfa4f9b21cb60397 P 929b168c73e648dfa25f494e90a0ed3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 64adbd65b8404e7180a20b86ad63bca9 (127.15.36.194:40745), c472ff7214044afdb58b3e8c9c52a44f (127.15.36.195:43709)
I20260811 08:06:32.574446 31419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:32.570415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:41301 (local address 127.15.36.194:40745)
0811 08:06:32.570472 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 08:06:32.570475 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:06:32.570572 (+ 97us) server_negotiation.cc:407] Connection header received
0811 08:06:32.570634 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:06:32.570635 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:06:32.570649 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:06:32.570713 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:06:32.570949 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:32.571719 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:32.573379 (+ 1660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:32.573940 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:32.574023 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:32.574032 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 08:06:32.574310 (+ 278us) server_negotiation.cc:299] Negotiation successful
0811 08:06:32.574375 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 08:06:32.574465 31420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:32.570386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:41027 (local address 127.15.36.195:43709)
0811 08:06:32.570464 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0811 08:06:32.570466 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:06:32.570574 (+ 108us) server_negotiation.cc:407] Connection header received
0811 08:06:32.570634 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:06:32.570635 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:06:32.570646 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:06:32.570711 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:06:32.570931 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:32.571717 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:32.573379 (+ 1662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:32.573944 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:32.574024 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:32.574032 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 08:06:32.574360 (+ 328us) server_negotiation.cc:299] Negotiation successful
0811 08:06:32.574398 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 08:06:32.574492 31435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:32.570292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.195:43709 (local address 127.15.36.193:41027)
0811 08:06:32.570472 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:32.570485 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 08:06:32.570571 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:06:32.570732 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:06:32.570733 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:06:32.570735 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:06:32.570841 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:32.570844 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:32.571824 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:32.571825 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:32.573276 (+ 1451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:32.573280 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:32.574079 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:32.574080 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:32.574214 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:32.574216 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 08:06:32.574336 (+ 120us) client_negotiation.cc:240] Negotiation successful
0811 08:06:32.574367 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"mutex_wait_us":79,"thread_start_us":65,"threads_started":1}
I20260811 08:06:32.574492 31436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:32.570282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.194:40745 (local address 127.15.36.193:41301)
0811 08:06:32.570472 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:32.570485 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 08:06:32.570571 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:06:32.570733 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:06:32.570733 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:06:32.570737 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:06:32.570848 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:32.570850 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:32.571824 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:32.571825 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:32.573276 (+ 1451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:32.573280 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:32.574077 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:32.574079 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:32.574207 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:32.574213 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 08:06:32.574294 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 08:06:32.574354 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"mutex_wait_us":102,"thread_start_us":71,"threads_started":1}
I20260811 08:06:32.575146 31354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "577af21e1ff0426cbfa4f9b21cb60397" candidate_uuid: "929b168c73e648dfa25f494e90a0ed3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c472ff7214044afdb58b3e8c9c52a44f" is_pre_election: true
I20260811 08:06:32.575289 31206 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "577af21e1ff0426cbfa4f9b21cb60397" candidate_uuid: "929b168c73e648dfa25f494e90a0ed3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64adbd65b8404e7180a20b86ad63bca9" is_pre_election: true
I20260811 08:06:32.575368 31354 raft_consensus.cc:2454] T 577af21e1ff0426cbfa4f9b21cb60397 P c472ff7214044afdb58b3e8c9c52a44f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 929b168c73e648dfa25f494e90a0ed3c in term 0.
I20260811 08:06:32.575407 31206 raft_consensus.cc:2454] T 577af21e1ff0426cbfa4f9b21cb60397 P 64adbd65b8404e7180a20b86ad63bca9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 929b168c73e648dfa25f494e90a0ed3c in term 0.
I20260811 08:06:32.575623 30979 leader_election.cc:302] T 577af21e1ff0426cbfa4f9b21cb60397 P 929b168c73e648dfa25f494e90a0ed3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 929b168c73e648dfa25f494e90a0ed3c, c472ff7214044afdb58b3e8c9c52a44f; no voters:
I20260811 08:06:32.575788 31433 raft_consensus.cc:2781] T 577af21e1ff0426cbfa4f9b21cb60397 P 929b168c73e648dfa25f494e90a0ed3c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:06:32.575850 31433 raft_consensus.cc:482] T 577af21e1ff0426cbfa4f9b21cb60397 P 929b168c73e648dfa25f494e90a0ed3c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:06:32.575878 31433 raft_consensus.cc:3037] T 577af21e1ff0426cbfa4f9b21cb60397 P 929b168c73e648dfa25f494e90a0ed3c [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:06:32.576666 31433 raft_consensus.cc:504] T 577af21e1ff0426cbfa4f9b21cb60397 P 929b168c73e648dfa25f494e90a0ed3c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64adbd65b8404e7180a20b86ad63bca9" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 40745 } } peers { permanent_uuid: "929b168c73e648dfa25f494e90a0ed3c" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 35083 } } peers { permanent_uuid: "c472ff7214044afdb58b3e8c9c52a44f" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 43709 } }
I20260811 08:06:32.576820 31433 leader_election.cc:288] T 577af21e1ff0426cbfa4f9b21cb60397 P 929b168c73e648dfa25f494e90a0ed3c [CANDIDATE]: Term 1 election: Requested vote from peers 64adbd65b8404e7180a20b86ad63bca9 (127.15.36.194:40745), c472ff7214044afdb58b3e8c9c52a44f (127.15.36.195:43709)
I20260811 08:06:32.577003 31354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "577af21e1ff0426cbfa4f9b21cb60397" candidate_uuid: "929b168c73e648dfa25f494e90a0ed3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c472ff7214044afdb58b3e8c9c52a44f"
I20260811 08:06:32.577000 31206 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "577af21e1ff0426cbfa4f9b21cb60397" candidate_uuid: "929b168c73e648dfa25f494e90a0ed3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64adbd65b8404e7180a20b86ad63bca9"
I20260811 08:06:32.577088 31354 raft_consensus.cc:3037] T 577af21e1ff0426cbfa4f9b21cb60397 P c472ff7214044afdb58b3e8c9c52a44f [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:06:32.577088 31206 raft_consensus.cc:3037] T 577af21e1ff0426cbfa4f9b21cb60397 P 64adbd65b8404e7180a20b86ad63bca9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:06:32.578038 31206 raft_consensus.cc:2454] T 577af21e1ff0426cbfa4f9b21cb60397 P 64adbd65b8404e7180a20b86ad63bca9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 929b168c73e648dfa25f494e90a0ed3c in term 1.
I20260811 08:06:32.578038 31354 raft_consensus.cc:2454] T 577af21e1ff0426cbfa4f9b21cb60397 P c472ff7214044afdb58b3e8c9c52a44f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 929b168c73e648dfa25f494e90a0ed3c in term 1.
I20260811 08:06:32.578281 30978 leader_election.cc:302] T 577af21e1ff0426cbfa4f9b21cb60397 P 929b168c73e648dfa25f494e90a0ed3c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64adbd65b8404e7180a20b86ad63bca9, 929b168c73e648dfa25f494e90a0ed3c; no voters:
I20260811 08:06:32.578418 31433 raft_consensus.cc:2781] T 577af21e1ff0426cbfa4f9b21cb60397 P 929b168c73e648dfa25f494e90a0ed3c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:06:32.578591 31433 raft_consensus.cc:686] T 577af21e1ff0426cbfa4f9b21cb60397 P 929b168c73e648dfa25f494e90a0ed3c [term 1 LEADER]: Becoming Leader. State: Replica: 929b168c73e648dfa25f494e90a0ed3c, State: Running, Role: LEADER
I20260811 08:06:32.578711 31433 consensus_queue.cc:237] T 577af21e1ff0426cbfa4f9b21cb60397 P 929b168c73e648dfa25f494e90a0ed3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64adbd65b8404e7180a20b86ad63bca9" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 40745 } } peers { permanent_uuid: "929b168c73e648dfa25f494e90a0ed3c" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 35083 } } peers { permanent_uuid: "c472ff7214044afdb58b3e8c9c52a44f" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 43709 } }
I20260811 08:06:32.579766 30887 catalog_manager.cc:5495] T 577af21e1ff0426cbfa4f9b21cb60397 P 929b168c73e648dfa25f494e90a0ed3c reported cstate change: term changed from 0 to 1, leader changed from <none> to 929b168c73e648dfa25f494e90a0ed3c (127.15.36.193). New cstate: current_term: 1 leader_uuid: "929b168c73e648dfa25f494e90a0ed3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64adbd65b8404e7180a20b86ad63bca9" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 40745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "929b168c73e648dfa25f494e90a0ed3c" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 35083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c472ff7214044afdb58b3e8c9c52a44f" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 43709 } health_report { overall_health: UNKNOWN } } }
I20260811 08:06:32.596891 31421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:32.594307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46252 (local address 127.15.36.193:35083)
0811 08:06:32.594380 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 08:06:32.594382 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:06:32.594392 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:06:32.594480 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:06:32.594482 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:06:32.594500 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:06:32.594593 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:06:32.594748 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:32.595313 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:32.596097 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:32.596294 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:32.596373 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:32.596545 (+ 172us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:06:32.596653 (+ 108us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:06:32.596746 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 08:06:32.596769 (+ 23us) server_negotiation.cc:299] Negotiation successful
0811 08:06:32.596794 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 08:06:32.598773 31206 raft_consensus.cc:1261] T 577af21e1ff0426cbfa4f9b21cb60397 P 64adbd65b8404e7180a20b86ad63bca9 [term 1 FOLLOWER]: Refusing update from remote peer 929b168c73e648dfa25f494e90a0ed3c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:06:32.598788 31354 raft_consensus.cc:1261] T 577af21e1ff0426cbfa4f9b21cb60397 P c472ff7214044afdb58b3e8c9c52a44f [term 1 FOLLOWER]: Refusing update from remote peer 929b168c73e648dfa25f494e90a0ed3c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:06:32.599187 31437 consensus_queue.cc:1035] T 577af21e1ff0426cbfa4f9b21cb60397 P 929b168c73e648dfa25f494e90a0ed3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "64adbd65b8404e7180a20b86ad63bca9" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 40745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:06:32.599335 31433 consensus_queue.cc:1035] T 577af21e1ff0426cbfa4f9b21cb60397 P 929b168c73e648dfa25f494e90a0ed3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c472ff7214044afdb58b3e8c9c52a44f" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 43709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:06:32.601837 31440 mvcc.cc:205] Tried to move back new op lower bound from 7317240187281588224 to 7317240187203088384. Current Snapshot: MvccSnapshot[applied={T|T < 7317240187281588224}]
I20260811 08:06:32.602450 31442 mvcc.cc:205] Tried to move back new op lower bound from 7317240187281588224 to 7317240187203088384. Current Snapshot: MvccSnapshot[applied={T|T < 7317240187281588224}]
I20260811 08:06:32.605160 30888 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47440:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:06:32.605263 30888 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47440:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:06:32.606112 30888 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1767bedafd404afdbb667219a20a6440: Sending DeleteTablet for 3 replicas of tablet 577af21e1ff0426cbfa4f9b21cb60397
I20260811 08:06:32.606459 31029 tablet_service.cc:1514] Processing DeleteTablet for tablet 577af21e1ff0426cbfa4f9b21cb60397 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:06:32 UTC) from {username='kudu', principal='kudu/127.15.36.254@KRBTEST.COM'} at 127.0.0.1:46246
I20260811 08:06:32.606534 31182 tablet_service.cc:1514] Processing DeleteTablet for tablet 577af21e1ff0426cbfa4f9b21cb60397 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:06:32 UTC) from {username='kudu', principal='kudu/127.15.36.254@KRBTEST.COM'} at 127.0.0.1:35738
I20260811 08:06:32.606566 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 30958
I20260811 08:06:32.609289 31332 tablet_service.cc:1514] Processing DeleteTablet for tablet 577af21e1ff0426cbfa4f9b21cb60397 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:06:32 UTC) from {username='kudu', principal='kudu/127.15.36.254@KRBTEST.COM'} at 127.0.0.1:38702
I20260811 08:06:32.609522 31452 tablet_replica.cc:330] T 577af21e1ff0426cbfa4f9b21cb60397 P c472ff7214044afdb58b3e8c9c52a44f: stopping tablet replica
I20260811 08:06:32.609624 31452 raft_consensus.cc:2229] T 577af21e1ff0426cbfa4f9b21cb60397 P c472ff7214044afdb58b3e8c9c52a44f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:06:32.609714 31452 raft_consensus.cc:2258] T 577af21e1ff0426cbfa4f9b21cb60397 P c472ff7214044afdb58b3e8c9c52a44f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:06:32.610185 31452 ts_tablet_manager.cc:1905] T 577af21e1ff0426cbfa4f9b21cb60397 P c472ff7214044afdb58b3e8c9c52a44f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:06:32.611713 31451 tablet_replica.cc:330] T 577af21e1ff0426cbfa4f9b21cb60397 P 64adbd65b8404e7180a20b86ad63bca9: stopping tablet replica
I20260811 08:06:32.611909 31451 raft_consensus.cc:2229] T 577af21e1ff0426cbfa4f9b21cb60397 P 64adbd65b8404e7180a20b86ad63bca9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:06:32.611969 31452 ts_tablet_manager.cc:1918] T 577af21e1ff0426cbfa4f9b21cb60397 P c472ff7214044afdb58b3e8c9c52a44f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:06:32.612093 31451 raft_consensus.cc:2258] T 577af21e1ff0426cbfa4f9b21cb60397 P 64adbd65b8404e7180a20b86ad63bca9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:06:32.612099 31452 log.cc:1196] T 577af21e1ff0426cbfa4f9b21cb60397 P c472ff7214044afdb58b3e8c9c52a44f: Deleting WAL directory at /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-2/wal/wals/577af21e1ff0426cbfa4f9b21cb60397
I20260811 08:06:32.612390 31452 ts_tablet_manager.cc:1939] T 577af21e1ff0426cbfa4f9b21cb60397 P c472ff7214044afdb58b3e8c9c52a44f: Deleting consensus metadata
I20260811 08:06:32.612620 31451 ts_tablet_manager.cc:1905] T 577af21e1ff0426cbfa4f9b21cb60397 P 64adbd65b8404e7180a20b86ad63bca9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:06:32.612986 30872 catalog_manager.cc:4841] TS c472ff7214044afdb58b3e8c9c52a44f (127.15.36.195:43709): tablet 577af21e1ff0426cbfa4f9b21cb60397 (table test-table [id=1a53cf6b723d4ee49351209dad182643]) successfully deleted
I20260811 08:06:32.614178 31451 ts_tablet_manager.cc:1918] T 577af21e1ff0426cbfa4f9b21cb60397 P 64adbd65b8404e7180a20b86ad63bca9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:06:32.614287 31451 log.cc:1196] T 577af21e1ff0426cbfa4f9b21cb60397 P 64adbd65b8404e7180a20b86ad63bca9: Deleting WAL directory at /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-1/wal/wals/577af21e1ff0426cbfa4f9b21cb60397
I20260811 08:06:32.614531 31451 ts_tablet_manager.cc:1939] T 577af21e1ff0426cbfa4f9b21cb60397 P 64adbd65b8404e7180a20b86ad63bca9: Deleting consensus metadata
I20260811 08:06:32.615033 30871 catalog_manager.cc:4841] TS 64adbd65b8404e7180a20b86ad63bca9 (127.15.36.194:40745): tablet 577af21e1ff0426cbfa4f9b21cb60397 (table test-table [id=1a53cf6b723d4ee49351209dad182643]) successfully deleted
W20260811 08:06:32.615931 30870 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.36.193:35083 (error 108)
I20260811 08:06:32.616533 31418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:32.616385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.193:35083 (local address 127.0.0.1:46260)
0811 08:06:32.616447 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:32.616491 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.193:35083: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260811 08:06:32.616684 30870 catalog_manager.cc:4584] TS 929b168c73e648dfa25f494e90a0ed3c (127.15.36.193:35083): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 577af21e1ff0426cbfa4f9b21cb60397: Network error: Client connection negotiation failed: client connection to 127.15.36.193:35083: connect: Connection refused (error 111)
I20260811 08:06:32.616750 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 31106
I20260811 08:06:32.627151 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 31260
I20260811 08:06:32.634779 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 30852
I20260811 08:06:32.642271 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:40173
--webserver_interface=127.15.36.254
--webserver_port=38169
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=kudu/127.15.36.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:34085
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.36.254:40173
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:06:32.726285 31454 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:06:32.726529 31454 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:06:32.726553 31454 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:06:32.727813 31454 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:06:32.727861 31454 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:06:32.727875 31454 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:06:32.727888 31454 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:06:32.727901 31454 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:06:32.729435 31454 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:34085
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.15.36.254:40173
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=kudu/127.15.36.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:40173
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.36.254
--webserver_port=38169
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31454
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:06:32.729717 31454 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:06:32.729961 31454 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:06:32.739796 31460 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:06:32.739820 31461 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:06:32.739941 31454 server_base.cc:1034] running on GCE node
W20260811 08:06:32.739820 31463 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:06:32.740340 31454 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:06:32.740697 31454 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:06:32.741848 31454 hybrid_clock.cc:648] HybridClock initialized: now 1786435592741832 us; error 38 us; skew 500 ppm
Aug 11 08:06:32 dist-test-slave-2w3w krb5kdc[30834](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435592, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:06:32.744745 31454 init.cc:377] Logged in from keytab as kudu/127.15.36.254@KRBTEST.COM (short username kudu)
I20260811 08:06:32.745226 31454 webserver.cc:460] Webserver started at http://127.15.36.254:38169/ using document root <none> and password file <none>
I20260811 08:06:32.745499 31454 fs_manager.cc:359] Metadata directory not provided
I20260811 08:06:32.745596 31454 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:06:32.747185 31454 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:06:32.748054 31472 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:06:32.748266 31454 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:06:32.748391 31454 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/master-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/master-0/wal
uuid: "1767bedafd404afdbb667219a20a6440"
format_stamp: "Formatted at 2026-08-11 08:06:31 on dist-test-slave-2w3w"
server_key: "118e4a9af2741bb7983ef8ccf5aaaf62"
server_key_iv: "12d4557d27ec4c7b902376f4aec51911"
server_key_version: "encryptionkey@0"
I20260811 08:06:32.748819 31454 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:06:32.761245 31454 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:06:32.763803 31454 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:06:32.763984 31454 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:06:32.768476 31454 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.254:40173
I20260811 08:06:32.768534 31531 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.254:40173 every 8 connection(s)
I20260811 08:06:32.768988 31454 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
I20260811 08:06:32.770884 31533 sys_catalog.cc:263] Verifying existing consensus state
I20260811 08:06:32.771653 31533 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1767bedafd404afdbb667219a20a6440: Bootstrap starting.
I20260811 08:06:32.778167 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 31454
I20260811 08:06:32.778502 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.193:35083
--local_ip_for_outbound_sockets=127.15.36.193
--tserver_master_addrs=127.15.36.254:40173
--webserver_port=36107
--webserver_interface=127.15.36.193
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab
--principal=kudu/127.15.36.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:34085
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 08:06:32.780789 31533 log.cc:824] T 00000000000000000000000000000000 P 1767bedafd404afdbb667219a20a6440: Log is configured to *not* fsync() on all Append() calls
I20260811 08:06:32.783849 31533 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1767bedafd404afdbb667219a20a6440: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 08:06:32.784255 31533 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1767bedafd404afdbb667219a20a6440: Bootstrap complete.
I20260811 08:06:32.788697 31533 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1767bedafd404afdbb667219a20a6440 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1767bedafd404afdbb667219a20a6440" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 40173 } }
I20260811 08:06:32.789147 31533 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1767bedafd404afdbb667219a20a6440 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1767bedafd404afdbb667219a20a6440, State: Initialized, Role: FOLLOWER
I20260811 08:06:32.789345 31533 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1767bedafd404afdbb667219a20a6440 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1767bedafd404afdbb667219a20a6440" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 40173 } }
I20260811 08:06:32.789441 31533 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1767bedafd404afdbb667219a20a6440 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:06:32.789508 31533 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1767bedafd404afdbb667219a20a6440 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:06:32.789570 31533 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1767bedafd404afdbb667219a20a6440 [term 1 FOLLOWER]: Advancing to term 2
I20260811 08:06:32.791409 31533 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1767bedafd404afdbb667219a20a6440 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1767bedafd404afdbb667219a20a6440" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 40173 } }
I20260811 08:06:32.791532 31533 leader_election.cc:302] T 00000000000000000000000000000000 P 1767bedafd404afdbb667219a20a6440 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1767bedafd404afdbb667219a20a6440; no voters:
I20260811 08:06:32.791725 31533 leader_election.cc:288] T 00000000000000000000000000000000 P 1767bedafd404afdbb667219a20a6440 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 08:06:32.791815 31538 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1767bedafd404afdbb667219a20a6440 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 08:06:32.792002 31533 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1767bedafd404afdbb667219a20a6440 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:06:32.792061 31538 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1767bedafd404afdbb667219a20a6440 [term 2 LEADER]: Becoming Leader. State: Replica: 1767bedafd404afdbb667219a20a6440, State: Running, Role: LEADER
I20260811 08:06:32.792218 31538 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1767bedafd404afdbb667219a20a6440 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1767bedafd404afdbb667219a20a6440" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 40173 } }
I20260811 08:06:32.792598 31539 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1767bedafd404afdbb667219a20a6440 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "1767bedafd404afdbb667219a20a6440" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1767bedafd404afdbb667219a20a6440" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 40173 } } }
I20260811 08:06:32.792680 31539 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1767bedafd404afdbb667219a20a6440 [sys.catalog]: This master's current role is: LEADER
I20260811 08:06:32.792997 31540 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1767bedafd404afdbb667219a20a6440 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1767bedafd404afdbb667219a20a6440. Latest consensus state: current_term: 2 leader_uuid: "1767bedafd404afdbb667219a20a6440" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1767bedafd404afdbb667219a20a6440" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 40173 } } }
I20260811 08:06:32.793077 31540 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1767bedafd404afdbb667219a20a6440 [sys.catalog]: This master's current role is: LEADER
I20260811 08:06:32.793306 31547 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:06:32.794409 31547 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:06:32.794517 31547 catalog_manager.cc:1259] Loaded cluster ID: 4c7befe33c884de1ab74448e8864744c
I20260811 08:06:32.794550 31547 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:06:32.794853 31547 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260811 08:06:32.799585 31547 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260811 08:06:32.802420 31547 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:06:32.802677 31547 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 1767bedafd404afdbb667219a20a6440: Loaded TSK: 0
I20260811 08:06:32.802912 31547 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 08:06:32.868896 31535 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:06:32.869166 31535 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:06:32.869211 31535 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:06:32.870445 31535 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:06:32.870525 31535 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:06:32.870574 31535 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.193
I20260811 08:06:32.872218 31535 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:34085
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab
--principal=kudu/127.15.36.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.193:35083
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.36.193
--webserver_port=36107
--tserver_master_addrs=127.15.36.254:40173
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31535
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.193
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:06:32.872517 31535 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:06:32.872776 31535 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:06:32.879158 31564 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:06:32.879168 31562 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:06:32.879185 31561 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:06:32.879516 31535 server_base.cc:1034] running on GCE node
I20260811 08:06:32.879729 31535 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:06:32.879999 31535 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:06:32.881184 31535 hybrid_clock.cc:648] HybridClock initialized: now 1786435592881158 us; error 42 us; skew 500 ppm
Aug 11 08:06:32 dist-test-slave-2w3w krb5kdc[30834](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435592, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:06:32.883888 31535 init.cc:377] Logged in from keytab as kudu/127.15.36.193@KRBTEST.COM (short username kudu)
I20260811 08:06:32.884357 31535 webserver.cc:460] Webserver started at http://127.15.36.193:36107/ using document root <none> and password file <none>
I20260811 08:06:32.884641 31535 fs_manager.cc:359] Metadata directory not provided
I20260811 08:06:32.884737 31535 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:06:32.886230 31535 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 08:06:32.887012 31572 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:06:32.887192 31535 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:06:32.887295 31535 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-0/wal
uuid: "929b168c73e648dfa25f494e90a0ed3c"
format_stamp: "Formatted at 2026-08-11 08:06:31 on dist-test-slave-2w3w"
server_key: "2b0fd6bc146982af62e1c0f877165719"
server_key_iv: "0c0f914d5c03f13c6d67ca14dba29b15"
server_key_version: "encryptionkey@0"
I20260811 08:06:32.887686 31535 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:06:32.906286 31535 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:06:32.908802 31535 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:06:32.908990 31535 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:06:32.909260 31535 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:06:32.909823 31580 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 08:06:32.911475 31535 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 08:06:32.911537 31535 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260811 08:06:32.911566 31535 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 08:06:32.912250 31535 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 08:06:32.912298 31535 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260811 08:06:32.912344 31580 tablet_bootstrap.cc:492] T 577af21e1ff0426cbfa4f9b21cb60397 P 929b168c73e648dfa25f494e90a0ed3c: Bootstrap starting.
I20260811 08:06:32.920621 31535 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.193:35083
I20260811 08:06:32.920693 31699 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.193:35083 every 8 connection(s)
I20260811 08:06:32.921283 31535 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
I20260811 08:06:32.924469 31580 log.cc:824] T 577af21e1ff0426cbfa4f9b21cb60397 P 929b168c73e648dfa25f494e90a0ed3c: Log is configured to *not* fsync() on all Append() calls
I20260811 08:06:32.925631 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 31535
I20260811 08:06:32.925944 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.194:40745
--local_ip_for_outbound_sockets=127.15.36.194
--tserver_master_addrs=127.15.36.254:40173
--webserver_port=35375
--webserver_interface=127.15.36.194
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab
--principal=kudu/127.15.36.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:34085
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 08:06:32.927520 31580 tablet_bootstrap.cc:492] T 577af21e1ff0426cbfa4f9b21cb60397 P 929b168c73e648dfa25f494e90a0ed3c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 08:06:32.927845 31580 tablet_bootstrap.cc:492] T 577af21e1ff0426cbfa4f9b21cb60397 P 929b168c73e648dfa25f494e90a0ed3c: Bootstrap complete.
I20260811 08:06:32.929045 31580 ts_tablet_manager.cc:1397] T 577af21e1ff0426cbfa4f9b21cb60397 P 929b168c73e648dfa25f494e90a0ed3c: Time spent bootstrapping tablet: real 0.017s user 0.004s sys 0.011s
Aug 11 08:06:32 dist-test-slave-2w3w krb5kdc[30834](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435592, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.193@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:06:32.931174 31580 raft_consensus.cc:348] T 577af21e1ff0426cbfa4f9b21cb60397 P 929b168c73e648dfa25f494e90a0ed3c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64adbd65b8404e7180a20b86ad63bca9" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 40745 } } peers { permanent_uuid: "929b168c73e648dfa25f494e90a0ed3c" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 35083 } } peers { permanent_uuid: "c472ff7214044afdb58b3e8c9c52a44f" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 43709 } }
I20260811 08:06:32.931447 31580 raft_consensus.cc:729] T 577af21e1ff0426cbfa4f9b21cb60397 P 929b168c73e648dfa25f494e90a0ed3c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 929b168c73e648dfa25f494e90a0ed3c, State: Initialized, Role: FOLLOWER
I20260811 08:06:32.931635 31580 consensus_queue.cc:260] T 577af21e1ff0426cbfa4f9b21cb60397 P 929b168c73e648dfa25f494e90a0ed3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64adbd65b8404e7180a20b86ad63bca9" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 40745 } } peers { permanent_uuid: "929b168c73e648dfa25f494e90a0ed3c" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 35083 } } peers { permanent_uuid: "c472ff7214044afdb58b3e8c9c52a44f" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 43709 } }
I20260811 08:06:32.931974 31580 ts_tablet_manager.cc:1428] T 577af21e1ff0426cbfa4f9b21cb60397 P 929b168c73e648dfa25f494e90a0ed3c: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260811 08:06:32.935415 31704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:32.922289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:60871 (local address 127.15.36.254:40173)
0811 08:06:32.922493 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0811 08:06:32.922503 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 08:06:32.922787 (+ 284us) server_negotiation.cc:407] Connection header received
0811 08:06:32.923666 (+ 879us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:06:32.923676 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:06:32.923757 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:06:32.923936 (+ 179us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:06:32.924815 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:32.926232 (+ 1417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:32.927782 (+ 1550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:32.928402 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:32.928515 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:32.931079 (+ 2564us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:06:32.931084 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:06:32.931084 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:06:32.931096 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:06:32.933162 (+ 2066us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:32.933744 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:32.933747 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:32.933748 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:32.933862 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:32.934194 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:32.934195 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:32.934195 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:32.934503 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:06:32.934589 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 08:06:32.935042 (+ 453us) server_negotiation.cc:299] Negotiation successful
0811 08:06:32.935188 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":94,"threads_started":1}
I20260811 08:06:32.935459 31703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:32.922218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:40173 (local address 127.15.36.193:60871)
0811 08:06:32.922584 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:32.922632 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 08:06:32.923385 (+ 753us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:06:32.923981 (+ 596us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:06:32.923986 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:06:32.924399 (+ 413us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:06:32.924672 (+ 273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:32.924680 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:32.926383 (+ 1703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:32.926384 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:32.927681 (+ 1297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:32.927683 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:32.928522 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:32.928523 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:32.928679 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:32.929287 (+ 608us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:06:32.929297 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:06:32.930903 (+ 1606us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:06:32.933267 (+ 2364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:06:32.933276 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:06:32.933278 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:06:32.933633 (+ 355us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:06:32.933944 (+ 311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:06:32.933945 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:06:32.933946 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:06:32.934105 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:06:32.934586 (+ 481us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:06:32.934594 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:06:32.934790 (+ 196us) client_negotiation.cc:769] Sending connection context
0811 08:06:32.934918 (+ 128us) client_negotiation.cc:240] Negotiation successful
0811 08:06:32.935171 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":323,"thread_start_us":99,"threads_started":1}
I20260811 08:06:32.936220 31701 heartbeater.cc:347] Connected to a master server at 127.15.36.254:40173
I20260811 08:06:32.936342 31701 heartbeater.cc:464] Registering TS with master...
I20260811 08:06:32.936532 31701 heartbeater.cc:511] Master 127.15.36.254:40173 requested a full tablet report, sending...
I20260811 08:06:32.937301 31490 ts_manager.cc:194] Registered new tserver with Master: 929b168c73e648dfa25f494e90a0ed3c (127.15.36.193:35083)
I20260811 08:06:32.938421 31490 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.36.193@KRBTEST.COM'} at 127.15.36.193:60871
I20260811 08:06:32.939401 31701 heartbeater.cc:503] Master 127.15.36.254:40173 was elected leader, sending a full tablet report...
Aug 11 08:06:32 dist-test-slave-2w3w krb5kdc[30834](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435592, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.254@KRBTEST.COM for kudu/127.15.36.193@KRBTEST.COM
I20260811 08:06:32.947027 31709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:32.938267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46272 (local address 127.15.36.193:35083)
0811 08:06:32.938415 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0811 08:06:32.938420 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:06:32.938430 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:06:32.938465 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:06:32.938466 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:06:32.938482 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:06:32.938554 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:06:32.939248 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:32.940115 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:32.941349 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:32.941638 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:32.941703 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:32.943976 (+ 2273us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:06:32.943985 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:06:32.943985 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:06:32.944000 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:06:32.945676 (+ 1676us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:32.946100 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:32.946102 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:32.946103 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:32.946156 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:32.946363 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:32.946364 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:32.946365 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:32.946519 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:06:32.946614 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 08:06:32.946797 (+ 183us) server_negotiation.cc:299] Negotiation successful
0811 08:06:32.946900 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":82,"threads_started":1}
I20260811 08:06:32.947021 31708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:32.937961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.193:35083 (local address 127.0.0.1:46272)
0811 08:06:32.938170 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:32.938208 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 08:06:32.938275 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:06:32.938583 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:06:32.938590 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:06:32.939076 (+ 486us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:06:32.939152 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:32.939155 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:32.940196 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:32.940197 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:32.941253 (+ 1056us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:32.941258 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:32.941719 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:32.941721 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:32.941819 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:32.942345 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:06:32.942351 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:06:32.943883 (+ 1532us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:06:32.945771 (+ 1888us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:06:32.945777 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:06:32.945779 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:06:32.945997 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:06:32.946225 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:06:32.946226 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:06:32.946226 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:06:32.946292 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:06:32.946593 (+ 301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:06:32.946599 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:06:32.946654 (+ 55us) client_negotiation.cc:769] Sending connection context
0811 08:06:32.946758 (+ 104us) client_negotiation.cc:240] Negotiation successful
0811 08:06:32.946895 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":119,"threads_started":1}
I20260811 08:06:32.947448 31612 tablet_service.cc:1514] Processing DeleteTablet for tablet 577af21e1ff0426cbfa4f9b21cb60397 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:06:32 UTC) from {username='kudu', principal='kudu/127.15.36.254@KRBTEST.COM'} at 127.0.0.1:46272
I20260811 08:06:32.947978 31710 tablet_replica.cc:330] stopping tablet replica
I20260811 08:06:32.948096 31710 raft_consensus.cc:2229] T 577af21e1ff0426cbfa4f9b21cb60397 P 929b168c73e648dfa25f494e90a0ed3c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:06:32.948168 31710 raft_consensus.cc:2258] T 577af21e1ff0426cbfa4f9b21cb60397 P 929b168c73e648dfa25f494e90a0ed3c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:06:32.948499 31710 ts_tablet_manager.cc:1905] T 577af21e1ff0426cbfa4f9b21cb60397 P 929b168c73e648dfa25f494e90a0ed3c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:06:32.951116 31710 ts_tablet_manager.cc:1918] T 577af21e1ff0426cbfa4f9b21cb60397 P 929b168c73e648dfa25f494e90a0ed3c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:06:32.951210 31710 log.cc:1196] T 577af21e1ff0426cbfa4f9b21cb60397 P 929b168c73e648dfa25f494e90a0ed3c: Deleting WAL directory at /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-0/wal/wals/577af21e1ff0426cbfa4f9b21cb60397
I20260811 08:06:32.951455 31710 ts_tablet_manager.cc:1939] T 577af21e1ff0426cbfa4f9b21cb60397 P 929b168c73e648dfa25f494e90a0ed3c: Deleting consensus metadata
I20260811 08:06:32.952028 31473 catalog_manager.cc:4841] TS 929b168c73e648dfa25f494e90a0ed3c (127.15.36.193:35083): tablet 577af21e1ff0426cbfa4f9b21cb60397 (table test-table [id=1a53cf6b723d4ee49351209dad182643]) successfully deleted
W20260811 08:06:33.019343 31706 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:06:33.019573 31706 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:06:33.019598 31706 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:06:33.020833 31706 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:06:33.020891 31706 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:06:33.020921 31706 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.194
I20260811 08:06:33.022454 31706 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:34085
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab
--principal=kudu/127.15.36.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.194:40745
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.36.194
--webserver_port=35375
--tserver_master_addrs=127.15.36.254:40173
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31706
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.194
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:06:33.022740 31706 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:06:33.023053 31706 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:06:33.028327 31717 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:06:33.028316 31715 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:06:33.028309 31719 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:06:33.028569 31706 server_base.cc:1034] running on GCE node
I20260811 08:06:33.028805 31706 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:06:33.029057 31706 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:06:33.030203 31706 hybrid_clock.cc:648] HybridClock initialized: now 1786435593030179 us; error 38 us; skew 500 ppm
Aug 11 08:06:33 dist-test-slave-2w3w krb5kdc[30834](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435593, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:06:33.032881 31706 init.cc:377] Logged in from keytab as kudu/127.15.36.194@KRBTEST.COM (short username kudu)
I20260811 08:06:33.033356 31706 webserver.cc:460] Webserver started at http://127.15.36.194:35375/ using document root <none> and password file <none>
I20260811 08:06:33.033620 31706 fs_manager.cc:359] Metadata directory not provided
I20260811 08:06:33.033716 31706 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:06:33.035208 31706 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:06:33.035892 31728 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:06:33.036110 31706 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:06:33.036233 31706 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-1/wal
uuid: "64adbd65b8404e7180a20b86ad63bca9"
format_stamp: "Formatted at 2026-08-11 08:06:31 on dist-test-slave-2w3w"
server_key: "1fc5d2c099ed50f6eefa074e18b40eca"
server_key_iv: "db1d2b5dba17dceecea686704526c775"
server_key_version: "encryptionkey@0"
I20260811 08:06:33.036643 31706 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:06:33.062142 31706 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:06:33.064234 31706 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:06:33.064404 31706 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:06:33.064654 31706 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:06:33.064990 31706 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:06:33.065047 31706 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:06:33.065114 31706 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:06:33.065158 31706 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:06:33.071257 31706 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.194:40745
I20260811 08:06:33.071319 31856 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.194:40745 every 8 connection(s)
I20260811 08:06:33.071677 31706 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
I20260811 08:06:33.075919 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 31706
I20260811 08:06:33.076272 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.195:43709
--local_ip_for_outbound_sockets=127.15.36.195
--tserver_master_addrs=127.15.36.254:40173
--webserver_port=43185
--webserver_interface=127.15.36.195
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab
--principal=kudu/127.15.36.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:34085
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 08:06:33 dist-test-slave-2w3w krb5kdc[30834](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435593, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.194@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:06:33.082715 31704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:33.072485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:48941 (local address 127.15.36.254:40173)
0811 08:06:33.072552 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 08:06:33.072554 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:06:33.072762 (+ 208us) server_negotiation.cc:407] Connection header received
0811 08:06:33.073273 (+ 511us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:06:33.073274 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:06:33.073285 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:06:33.073337 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:06:33.074387 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:33.074942 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:33.076014 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:33.076386 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:33.076464 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:33.079415 (+ 2951us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:06:33.079416 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:06:33.079416 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:06:33.079424 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:06:33.080946 (+ 1522us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:33.081515 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:33.081516 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:33.081516 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:33.081570 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:33.081957 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:33.081958 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:33.081958 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:33.082072 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:06:33.082125 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 08:06:33.082550 (+ 425us) server_negotiation.cc:299] Negotiation successful
0811 08:06:33.082633 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 08:06:33.083096 31859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:33.072465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:40173 (local address 127.15.36.194:48941)
0811 08:06:33.072628 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:33.072664 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 08:06:33.073162 (+ 498us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:06:33.073415 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:06:33.073418 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:06:33.074012 (+ 594us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:06:33.074271 (+ 259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:33.074278 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:33.075092 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:33.075092 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:33.075908 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:33.075910 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:33.076544 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:33.076544 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:33.076697 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:33.077268 (+ 571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:06:33.077279 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:06:33.079289 (+ 2010us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:06:33.081037 (+ 1748us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:06:33.081047 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:06:33.081050 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:06:33.081432 (+ 382us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:06:33.081643 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:06:33.081644 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:06:33.081645 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:06:33.081883 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:06:33.082162 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:06:33.082170 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:06:33.082388 (+ 218us) client_negotiation.cc:769] Sending connection context
0811 08:06:33.082539 (+ 151us) client_negotiation.cc:240] Negotiation successful
0811 08:06:33.082752 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":94,"threads_started":1}
I20260811 08:06:33.083765 31857 heartbeater.cc:347] Connected to a master server at 127.15.36.254:40173
I20260811 08:06:33.083868 31857 heartbeater.cc:464] Registering TS with master...
I20260811 08:06:33.084076 31857 heartbeater.cc:511] Master 127.15.36.254:40173 requested a full tablet report, sending...
I20260811 08:06:33.084494 31490 ts_manager.cc:194] Registered new tserver with Master: 64adbd65b8404e7180a20b86ad63bca9 (127.15.36.194:40745)
I20260811 08:06:33.084873 31490 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.36.194@KRBTEST.COM'} at 127.15.36.194:48941
W20260811 08:06:33.165177 31860 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:06:33.165453 31860 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:06:33.165496 31860 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:06:33.166668 31860 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:06:33.166754 31860 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:06:33.166806 31860 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.195
I20260811 08:06:33.168465 31860 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:34085
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab
--principal=kudu/127.15.36.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.195:43709
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.36.195
--webserver_port=43185
--tserver_master_addrs=127.15.36.254:40173
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31860
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.195
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:06:33.168771 31860 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:06:33.169026 31860 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:06:33.175160 31870 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:06:33.175130 31867 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:06:33.175125 31868 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:06:33.175815 31860 server_base.cc:1034] running on GCE node
I20260811 08:06:33.176071 31860 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:06:33.176362 31860 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:06:33.177546 31860 hybrid_clock.cc:648] HybridClock initialized: now 1786435593177528 us; error 28 us; skew 500 ppm
Aug 11 08:06:33 dist-test-slave-2w3w krb5kdc[30834](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435593, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:06:33.180313 31860 init.cc:377] Logged in from keytab as kudu/127.15.36.195@KRBTEST.COM (short username kudu)
I20260811 08:06:33.180824 31860 webserver.cc:460] Webserver started at http://127.15.36.195:43185/ using document root <none> and password file <none>
I20260811 08:06:33.181093 31860 fs_manager.cc:359] Metadata directory not provided
I20260811 08:06:33.181190 31860 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:06:33.182718 31860 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 08:06:33.183471 31877 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:06:33.183663 31860 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 08:06:33.183775 31860 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-2/wal
uuid: "c472ff7214044afdb58b3e8c9c52a44f"
format_stamp: "Formatted at 2026-08-11 08:06:32 on dist-test-slave-2w3w"
server_key: "77ddd1edaeda8bde221ab1e564df28c6"
server_key_iv: "81f5503f09b2a707635afabbd0b3d13c"
server_key_version: "encryptionkey@0"
I20260811 08:06:33.184162 31860 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:06:33.193876 31860 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:06:33.196295 31860 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:06:33.196489 31860 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:06:33.196758 31860 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:06:33.197105 31860 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:06:33.197165 31860 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:06:33.197206 31860 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:06:33.197258 31860 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:06:33.204080 31860 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.195:43709
I20260811 08:06:33.204140 32004 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.195:43709 every 8 connection(s)
I20260811 08:06:33.204528 31860 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
Aug 11 08:06:33 dist-test-slave-2w3w krb5kdc[30834](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435593, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.195@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:06:33.212968 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 31860
I20260811 08:06:33.215197 31704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:33.205541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:54249 (local address 127.15.36.254:40173)
0811 08:06:33.205607 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 08:06:33.205609 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:06:33.205926 (+ 317us) server_negotiation.cc:407] Connection header received
0811 08:06:33.206441 (+ 515us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:06:33.206442 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:06:33.206454 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:06:33.206517 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:06:33.207633 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:33.208152 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:33.209242 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:33.209428 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:33.209479 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:33.211828 (+ 2349us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:06:33.211830 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:06:33.211830 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:06:33.211837 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:06:33.213496 (+ 1659us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:33.214099 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:33.214101 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:33.214101 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:33.214158 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:33.214457 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:33.214457 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:33.214458 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:33.214619 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:06:33.214688 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 08:06:33.215015 (+ 327us) server_negotiation.cc:299] Negotiation successful
0811 08:06:33.215098 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 08:06:33.215400 32007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:33.205481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:40173 (local address 127.15.36.195:54249)
0811 08:06:33.205766 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:33.205805 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 08:06:33.206317 (+ 512us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:06:33.206573 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:06:33.206576 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:06:33.207290 (+ 714us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:06:33.207514 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:33.207519 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:33.208245 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:33.208246 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:33.209159 (+ 913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:33.209161 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:33.209508 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:33.209509 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:33.209618 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:33.210116 (+ 498us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:06:33.210125 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:06:33.211726 (+ 1601us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:06:33.213576 (+ 1850us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:06:33.213587 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:06:33.213589 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:06:33.213996 (+ 407us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:06:33.214234 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:06:33.214235 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:06:33.214236 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:06:33.214385 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:06:33.214695 (+ 310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:06:33.214701 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:06:33.214842 (+ 141us) client_negotiation.cc:769] Sending connection context
0811 08:06:33.214939 (+ 97us) client_negotiation.cc:240] Negotiation successful
0811 08:06:33.215157 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":115,"threads_started":1}
I20260811 08:06:33.215940 32005 heartbeater.cc:347] Connected to a master server at 127.15.36.254:40173
I20260811 08:06:33.216053 32005 heartbeater.cc:464] Registering TS with master...
I20260811 08:06:33.216238 32005 heartbeater.cc:511] Master 127.15.36.254:40173 requested a full tablet report, sending...
I20260811 08:06:33.216683 31490 ts_manager.cc:194] Registered new tserver with Master: c472ff7214044afdb58b3e8c9c52a44f (127.15.36.195:43709)
I20260811 08:06:33.217177 31490 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.36.195@KRBTEST.COM'} at 127.15.36.195:54249
I20260811 08:06:33.220741 32010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:33.213436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47452 (local address 127.15.36.254:40173)
0811 08:06:33.213572 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0811 08:06:33.213575 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:06:33.213658 (+ 83us) server_negotiation.cc:407] Connection header received
0811 08:06:33.213714 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:06:33.213715 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:06:33.213724 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:06:33.213787 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:06:33.214540 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:33.215247 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:33.216402 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:33.216681 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:33.216736 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:33.218132 (+ 1396us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:06:33.218134 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:06:33.218134 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:06:33.218140 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:06:33.219653 (+ 1513us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:33.219965 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:33.219965 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:33.219966 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:33.220016 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:33.220239 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:33.220240 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:33.220241 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:33.220367 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:06:33.220504 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0811 08:06:33.220536 (+ 32us) server_negotiation.cc:299] Negotiation successful
0811 08:06:33.220620 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":70,"threads_started":1}
I20260811 08:06:33.221619 15507 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 08:06:33.224920 32010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:33.221971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47460 (local address 127.15.36.254:40173)
0811 08:06:33.222156 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0811 08:06:33.222158 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:06:33.222262 (+ 104us) server_negotiation.cc:407] Connection header received
0811 08:06:33.222356 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:06:33.222357 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:06:33.222398 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:06:33.222544 (+ 146us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:06:33.222685 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:33.223280 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:33.224058 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:33.224281 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:33.224365 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:33.224562 (+ 197us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:06:33.224674 (+ 112us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:06:33.224762 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 08:06:33.224811 (+ 49us) server_negotiation.cc:299] Negotiation successful
0811 08:06:33.224837 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160}
I20260811 08:06:33.225262 31490 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:47460:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:06:33.226853 31490 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:06:33.229072 31612 tablet_service.cc:1467] Processing CreateTablet for tablet 9db08a04839748d6a6633e138e179667 (DEFAULT_TABLE table=test-table [id=92a6c240ea154d0ab5e5cc2d109fd930]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:06:33.229303 31612 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9db08a04839748d6a6633e138e179667. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:06:33.230943 31580 tablet_bootstrap.cc:492] T 9db08a04839748d6a6633e138e179667 P 929b168c73e648dfa25f494e90a0ed3c: Bootstrap starting.
I20260811 08:06:33.231359 31580 tablet_bootstrap.cc:654] T 9db08a04839748d6a6633e138e179667 P 929b168c73e648dfa25f494e90a0ed3c: Neither blocks nor log segments found. Creating new log.
I20260811 08:06:33.231982 31580 tablet_bootstrap.cc:492] T 9db08a04839748d6a6633e138e179667 P 929b168c73e648dfa25f494e90a0ed3c: No bootstrap required, opened a new log
I20260811 08:06:33.232039 31580 ts_tablet_manager.cc:1397] T 9db08a04839748d6a6633e138e179667 P 929b168c73e648dfa25f494e90a0ed3c: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 08:06:33.232389 31580 raft_consensus.cc:348] T 9db08a04839748d6a6633e138e179667 P 929b168c73e648dfa25f494e90a0ed3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c472ff7214044afdb58b3e8c9c52a44f" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 43709 } } peers { permanent_uuid: "64adbd65b8404e7180a20b86ad63bca9" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 40745 } } peers { permanent_uuid: "929b168c73e648dfa25f494e90a0ed3c" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 35083 } }
I20260811 08:06:33.232481 31580 raft_consensus.cc:374] T 9db08a04839748d6a6633e138e179667 P 929b168c73e648dfa25f494e90a0ed3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:06:33.232524 31580 raft_consensus.cc:729] T 9db08a04839748d6a6633e138e179667 P 929b168c73e648dfa25f494e90a0ed3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 929b168c73e648dfa25f494e90a0ed3c, State: Initialized, Role: FOLLOWER
I20260811 08:06:33.232570 31580 consensus_queue.cc:260] T 9db08a04839748d6a6633e138e179667 P 929b168c73e648dfa25f494e90a0ed3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c472ff7214044afdb58b3e8c9c52a44f" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 43709 } } peers { permanent_uuid: "64adbd65b8404e7180a20b86ad63bca9" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 40745 } } peers { permanent_uuid: "929b168c73e648dfa25f494e90a0ed3c" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 35083 } }
I20260811 08:06:33.232643 31580 ts_tablet_manager.cc:1428] T 9db08a04839748d6a6633e138e179667 P 929b168c73e648dfa25f494e90a0ed3c: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 08:06:33.233091 32013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:33.229050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35744 (local address 127.15.36.194:40745)
0811 08:06:33.229256 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0811 08:06:33.229262 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 08:06:33.229273 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:06:33.229345 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:06:33.229347 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:06:33.229364 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:06:33.229453 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:06:33.229689 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:33.230587 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:33.232102 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:33.232707 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:33.232779 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:33.232838 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 08:06:33.232960 (+ 122us) server_negotiation.cc:299] Negotiation successful
0811 08:06:33.233006 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":97,"threads_started":1}
I20260811 08:06:33.233110 32012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:33.228840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.194:40745 (local address 127.0.0.1:35744)
0811 08:06:33.229038 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:33.229048 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:06:33.229102 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:06:33.229558 (+ 456us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:06:33.229559 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:06:33.229562 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:06:33.229609 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:33.229612 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:33.230690 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:33.230691 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:33.231959 (+ 1268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:33.231962 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:33.232780 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:33.232781 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:33.232854 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:33.232875 (+ 21us) client_negotiation.cc:769] Sending connection context
0811 08:06:33.232934 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 08:06:33.233019 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"mutex_wait_us":59,"thread_start_us":111,"threads_started":1}
I20260811 08:06:33.234143 31784 tablet_service.cc:1467] Processing CreateTablet for tablet 9db08a04839748d6a6633e138e179667 (DEFAULT_TABLE table=test-table [id=92a6c240ea154d0ab5e5cc2d109fd930]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:06:33.234483 31784 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9db08a04839748d6a6633e138e179667. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:06:33.234887 32014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:33.230947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38710 (local address 127.15.36.195:43709)
0811 08:06:33.231212 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0811 08:06:33.231217 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:06:33.231228 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:06:33.231268 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:06:33.231270 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:06:33.231287 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:06:33.231382 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:06:33.231518 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:33.232746 (+ 1228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:33.234005 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:33.234535 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:33.234625 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:33.234677 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 08:06:33.234797 (+ 120us) server_negotiation.cc:299] Negotiation successful
0811 08:06:33.234826 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":226,"thread_start_us":141,"threads_started":1}
I20260811 08:06:33.234925 31708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:33.228832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.195:43709 (local address 127.0.0.1:38710)
0811 08:06:33.228934 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:33.228946 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:06:33.228988 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:06:33.231392 (+ 2404us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:06:33.231393 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:06:33.231395 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:06:33.231440 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:33.231441 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:33.232882 (+ 1441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:33.232882 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:33.233918 (+ 1036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:33.233921 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:33.234626 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:33.234627 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:33.234700 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:33.234704 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:06:33.234786 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 08:06:33.234832 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":81}
I20260811 08:06:33.235654 31931 tablet_service.cc:1467] Processing CreateTablet for tablet 9db08a04839748d6a6633e138e179667 (DEFAULT_TABLE table=test-table [id=92a6c240ea154d0ab5e5cc2d109fd930]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:06:33.235980 31931 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9db08a04839748d6a6633e138e179667. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:06:33.238445 32017 tablet_bootstrap.cc:492] T 9db08a04839748d6a6633e138e179667 P 64adbd65b8404e7180a20b86ad63bca9: Bootstrap starting.
I20260811 08:06:33.239167 32017 tablet_bootstrap.cc:654] T 9db08a04839748d6a6633e138e179667 P 64adbd65b8404e7180a20b86ad63bca9: Neither blocks nor log segments found. Creating new log.
I20260811 08:06:33.239494 32018 tablet_bootstrap.cc:492] T 9db08a04839748d6a6633e138e179667 P c472ff7214044afdb58b3e8c9c52a44f: Bootstrap starting.
I20260811 08:06:33.239938 32017 log.cc:824] T 9db08a04839748d6a6633e138e179667 P 64adbd65b8404e7180a20b86ad63bca9: Log is configured to *not* fsync() on all Append() calls
I20260811 08:06:33.240321 32018 tablet_bootstrap.cc:654] T 9db08a04839748d6a6633e138e179667 P c472ff7214044afdb58b3e8c9c52a44f: Neither blocks nor log segments found. Creating new log.
I20260811 08:06:33.240947 32017 tablet_bootstrap.cc:492] T 9db08a04839748d6a6633e138e179667 P 64adbd65b8404e7180a20b86ad63bca9: No bootstrap required, opened a new log
I20260811 08:06:33.240990 32018 log.cc:824] T 9db08a04839748d6a6633e138e179667 P c472ff7214044afdb58b3e8c9c52a44f: Log is configured to *not* fsync() on all Append() calls
I20260811 08:06:33.241029 32017 ts_tablet_manager.cc:1397] T 9db08a04839748d6a6633e138e179667 P 64adbd65b8404e7180a20b86ad63bca9: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260811 08:06:33.241871 32018 tablet_bootstrap.cc:492] T 9db08a04839748d6a6633e138e179667 P c472ff7214044afdb58b3e8c9c52a44f: No bootstrap required, opened a new log
I20260811 08:06:33.241950 32018 ts_tablet_manager.cc:1397] T 9db08a04839748d6a6633e138e179667 P c472ff7214044afdb58b3e8c9c52a44f: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 08:06:33.243288 32017 raft_consensus.cc:348] T 9db08a04839748d6a6633e138e179667 P 64adbd65b8404e7180a20b86ad63bca9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c472ff7214044afdb58b3e8c9c52a44f" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 43709 } } peers { permanent_uuid: "64adbd65b8404e7180a20b86ad63bca9" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 40745 } } peers { permanent_uuid: "929b168c73e648dfa25f494e90a0ed3c" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 35083 } }
I20260811 08:06:33.243496 32017 raft_consensus.cc:374] T 9db08a04839748d6a6633e138e179667 P 64adbd65b8404e7180a20b86ad63bca9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:06:33.243537 32017 raft_consensus.cc:729] T 9db08a04839748d6a6633e138e179667 P 64adbd65b8404e7180a20b86ad63bca9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64adbd65b8404e7180a20b86ad63bca9, State: Initialized, Role: FOLLOWER
I20260811 08:06:33.243673 32017 consensus_queue.cc:260] T 9db08a04839748d6a6633e138e179667 P 64adbd65b8404e7180a20b86ad63bca9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c472ff7214044afdb58b3e8c9c52a44f" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 43709 } } peers { permanent_uuid: "64adbd65b8404e7180a20b86ad63bca9" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 40745 } } peers { permanent_uuid: "929b168c73e648dfa25f494e90a0ed3c" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 35083 } }
I20260811 08:06:33.243986 32017 ts_tablet_manager.cc:1428] T 9db08a04839748d6a6633e138e179667 P 64adbd65b8404e7180a20b86ad63bca9: Time spent starting tablet: real 0.003s user 0.003s sys 0.001s
I20260811 08:06:33.244004 31857 heartbeater.cc:503] Master 127.15.36.254:40173 was elected leader, sending a full tablet report...
I20260811 08:06:33.244171 32018 raft_consensus.cc:348] T 9db08a04839748d6a6633e138e179667 P c472ff7214044afdb58b3e8c9c52a44f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c472ff7214044afdb58b3e8c9c52a44f" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 43709 } } peers { permanent_uuid: "64adbd65b8404e7180a20b86ad63bca9" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 40745 } } peers { permanent_uuid: "929b168c73e648dfa25f494e90a0ed3c" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 35083 } }
I20260811 08:06:33.244338 32018 raft_consensus.cc:374] T 9db08a04839748d6a6633e138e179667 P c472ff7214044afdb58b3e8c9c52a44f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:06:33.244390 32018 raft_consensus.cc:729] T 9db08a04839748d6a6633e138e179667 P c472ff7214044afdb58b3e8c9c52a44f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c472ff7214044afdb58b3e8c9c52a44f, State: Initialized, Role: FOLLOWER
I20260811 08:06:33.244517 32018 consensus_queue.cc:260] T 9db08a04839748d6a6633e138e179667 P c472ff7214044afdb58b3e8c9c52a44f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c472ff7214044afdb58b3e8c9c52a44f" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 43709 } } peers { permanent_uuid: "64adbd65b8404e7180a20b86ad63bca9" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 40745 } } peers { permanent_uuid: "929b168c73e648dfa25f494e90a0ed3c" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 35083 } }
I20260811 08:06:33.244833 32018 ts_tablet_manager.cc:1428] T 9db08a04839748d6a6633e138e179667 P c472ff7214044afdb58b3e8c9c52a44f: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 08:06:33.244947 32005 heartbeater.cc:503] Master 127.15.36.254:40173 was elected leader, sending a full tablet report...
W20260811 08:06:33.322352 31858 tablet.cc:2369] T 9db08a04839748d6a6633e138e179667 P 64adbd65b8404e7180a20b86ad63bca9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:06:33.420322 32021 raft_consensus.cc:482] T 9db08a04839748d6a6633e138e179667 P 64adbd65b8404e7180a20b86ad63bca9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:06:33.420508 32021 raft_consensus.cc:504] T 9db08a04839748d6a6633e138e179667 P 64adbd65b8404e7180a20b86ad63bca9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c472ff7214044afdb58b3e8c9c52a44f" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 43709 } } peers { permanent_uuid: "64adbd65b8404e7180a20b86ad63bca9" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 40745 } } peers { permanent_uuid: "929b168c73e648dfa25f494e90a0ed3c" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 35083 } }
I20260811 08:06:33.420958 32021 leader_election.cc:288] T 9db08a04839748d6a6633e138e179667 P 64adbd65b8404e7180a20b86ad63bca9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c472ff7214044afdb58b3e8c9c52a44f (127.15.36.195:43709), 929b168c73e648dfa25f494e90a0ed3c (127.15.36.193:35083)
I20260811 08:06:33.424501 32014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:33.421321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:57105 (local address 127.15.36.195:43709)
0811 08:06:33.421383 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 08:06:33.421385 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:06:33.421398 (+ 13us) server_negotiation.cc:407] Connection header received
0811 08:06:33.421436 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:06:33.421436 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:06:33.421444 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:06:33.421506 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:06:33.421742 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:33.422484 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:33.423578 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:33.424127 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:33.424191 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:33.424199 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 08:06:33.424381 (+ 182us) server_negotiation.cc:299] Negotiation successful
0811 08:06:33.424418 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 08:06:33.424525 31859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:33.421207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.195:43709 (local address 127.15.36.194:57105)
0811 08:06:33.421286 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:33.421300 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 08:06:33.421351 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:06:33.421539 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:06:33.421540 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:06:33.421542 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:06:33.421627 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:33.421629 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:33.422587 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:33.422588 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:33.423481 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:33.423484 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:33.424208 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:33.424209 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:33.424294 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:33.424298 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:06:33.424360 (+ 62us) client_negotiation.cc:240] Negotiation successful
0811 08:06:33.424425 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56,"mutex_wait_us":1}
I20260811 08:06:33.424961 31709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:33.421351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:56759 (local address 127.15.36.193:35083)
0811 08:06:33.421418 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 08:06:33.421421 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:06:33.421669 (+ 248us) server_negotiation.cc:407] Connection header received
0811 08:06:33.421702 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:06:33.421703 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:06:33.421735 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:06:33.421804 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:06:33.422122 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:33.422695 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:33.423914 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:33.424446 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:33.424513 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:33.424603 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 08:06:33.424748 (+ 145us) server_negotiation.cc:299] Negotiation successful
0811 08:06:33.424871 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 08:06:33.424943 31951 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9db08a04839748d6a6633e138e179667" candidate_uuid: "64adbd65b8404e7180a20b86ad63bca9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c472ff7214044afdb58b3e8c9c52a44f" is_pre_election: true
I20260811 08:06:33.425140 31951 raft_consensus.cc:2454] T 9db08a04839748d6a6633e138e179667 P c472ff7214044afdb58b3e8c9c52a44f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 64adbd65b8404e7180a20b86ad63bca9 in term 0.
I20260811 08:06:33.425221 32023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:33.421208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.193:35083 (local address 127.15.36.194:56759)
0811 08:06:33.421599 (+ 391us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:33.421608 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 08:06:33.421657 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:06:33.421924 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:06:33.421925 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:06:33.421928 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:06:33.422021 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:33.422022 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:33.422795 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:33.422796 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:33.423762 (+ 966us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:33.423766 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:33.424534 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:33.424535 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:33.424624 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:33.424628 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:06:33.425084 (+ 456us) client_negotiation.cc:240] Negotiation successful
0811 08:06:33.425142 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":374,"mutex_wait_us":201,"thread_start_us":136,"threads_started":1}
W20260811 08:06:33.425357 31702 tablet.cc:2369] T 9db08a04839748d6a6633e138e179667 P 929b168c73e648dfa25f494e90a0ed3c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:06:33.425449 31731 leader_election.cc:302] T 9db08a04839748d6a6633e138e179667 P 64adbd65b8404e7180a20b86ad63bca9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64adbd65b8404e7180a20b86ad63bca9, c472ff7214044afdb58b3e8c9c52a44f; no voters:
I20260811 08:06:33.425529 31645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9db08a04839748d6a6633e138e179667" candidate_uuid: "64adbd65b8404e7180a20b86ad63bca9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "929b168c73e648dfa25f494e90a0ed3c" is_pre_election: true
I20260811 08:06:33.425590 32021 raft_consensus.cc:2781] T 9db08a04839748d6a6633e138e179667 P 64adbd65b8404e7180a20b86ad63bca9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:06:33.425655 32021 raft_consensus.cc:482] T 9db08a04839748d6a6633e138e179667 P 64adbd65b8404e7180a20b86ad63bca9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:06:33.425680 32021 raft_consensus.cc:3037] T 9db08a04839748d6a6633e138e179667 P 64adbd65b8404e7180a20b86ad63bca9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:06:33.425699 31645 raft_consensus.cc:2454] T 9db08a04839748d6a6633e138e179667 P 929b168c73e648dfa25f494e90a0ed3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 64adbd65b8404e7180a20b86ad63bca9 in term 0.
I20260811 08:06:33.426504 32021 raft_consensus.cc:504] T 9db08a04839748d6a6633e138e179667 P 64adbd65b8404e7180a20b86ad63bca9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c472ff7214044afdb58b3e8c9c52a44f" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 43709 } } peers { permanent_uuid: "64adbd65b8404e7180a20b86ad63bca9" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 40745 } } peers { permanent_uuid: "929b168c73e648dfa25f494e90a0ed3c" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 35083 } }
I20260811 08:06:33.426646 32021 leader_election.cc:288] T 9db08a04839748d6a6633e138e179667 P 64adbd65b8404e7180a20b86ad63bca9 [CANDIDATE]: Term 1 election: Requested vote from peers c472ff7214044afdb58b3e8c9c52a44f (127.15.36.195:43709), 929b168c73e648dfa25f494e90a0ed3c (127.15.36.193:35083)
I20260811 08:06:33.426815 31645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9db08a04839748d6a6633e138e179667" candidate_uuid: "64adbd65b8404e7180a20b86ad63bca9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "929b168c73e648dfa25f494e90a0ed3c"
I20260811 08:06:33.426864 31951 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9db08a04839748d6a6633e138e179667" candidate_uuid: "64adbd65b8404e7180a20b86ad63bca9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c472ff7214044afdb58b3e8c9c52a44f"
I20260811 08:06:33.426908 31645 raft_consensus.cc:3037] T 9db08a04839748d6a6633e138e179667 P 929b168c73e648dfa25f494e90a0ed3c [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:06:33.426937 31951 raft_consensus.cc:3037] T 9db08a04839748d6a6633e138e179667 P c472ff7214044afdb58b3e8c9c52a44f [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:06:33.427829 31645 raft_consensus.cc:2454] T 9db08a04839748d6a6633e138e179667 P 929b168c73e648dfa25f494e90a0ed3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 64adbd65b8404e7180a20b86ad63bca9 in term 1.
I20260811 08:06:33.427829 31951 raft_consensus.cc:2454] T 9db08a04839748d6a6633e138e179667 P c472ff7214044afdb58b3e8c9c52a44f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 64adbd65b8404e7180a20b86ad63bca9 in term 1.
I20260811 08:06:33.428094 31731 leader_election.cc:302] T 9db08a04839748d6a6633e138e179667 P 64adbd65b8404e7180a20b86ad63bca9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64adbd65b8404e7180a20b86ad63bca9, c472ff7214044afdb58b3e8c9c52a44f; no voters:
I20260811 08:06:33.428207 32021 raft_consensus.cc:2781] T 9db08a04839748d6a6633e138e179667 P 64adbd65b8404e7180a20b86ad63bca9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:06:33.428385 32021 raft_consensus.cc:686] T 9db08a04839748d6a6633e138e179667 P 64adbd65b8404e7180a20b86ad63bca9 [term 1 LEADER]: Becoming Leader. State: Replica: 64adbd65b8404e7180a20b86ad63bca9, State: Running, Role: LEADER
I20260811 08:06:33.428500 32021 consensus_queue.cc:237] T 9db08a04839748d6a6633e138e179667 P 64adbd65b8404e7180a20b86ad63bca9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c472ff7214044afdb58b3e8c9c52a44f" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 43709 } } peers { permanent_uuid: "64adbd65b8404e7180a20b86ad63bca9" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 40745 } } peers { permanent_uuid: "929b168c73e648dfa25f494e90a0ed3c" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 35083 } }
I20260811 08:06:33.429388 31490 catalog_manager.cc:5495] T 9db08a04839748d6a6633e138e179667 P 64adbd65b8404e7180a20b86ad63bca9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 64adbd65b8404e7180a20b86ad63bca9 (127.15.36.194). New cstate: current_term: 1 leader_uuid: "64adbd65b8404e7180a20b86ad63bca9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c472ff7214044afdb58b3e8c9c52a44f" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 43709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64adbd65b8404e7180a20b86ad63bca9" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 40745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "929b168c73e648dfa25f494e90a0ed3c" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 35083 } health_report { overall_health: UNKNOWN } } }
W20260811 08:06:33.455214 32006 tablet.cc:2369] T 9db08a04839748d6a6633e138e179667 P c472ff7214044afdb58b3e8c9c52a44f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:06:33.461618 32013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:33.459259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35758 (local address 127.15.36.194:40745)
0811 08:06:33.459337 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0811 08:06:33.459339 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:06:33.459348 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:06:33.459395 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:06:33.459396 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:06:33.459414 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:06:33.459489 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:06:33.459606 (+ 117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:33.460137 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:33.460919 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:33.461120 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:33.461187 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:33.461306 (+ 119us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:06:33.461412 (+ 106us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:06:33.461479 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 08:06:33.461513 (+ 34us) server_negotiation.cc:299] Negotiation successful
0811 08:06:33.461531 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 08:06:33.463502 31951 raft_consensus.cc:1261] T 9db08a04839748d6a6633e138e179667 P c472ff7214044afdb58b3e8c9c52a44f [term 1 FOLLOWER]: Refusing update from remote peer 64adbd65b8404e7180a20b86ad63bca9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:06:33.463518 31645 raft_consensus.cc:1261] T 9db08a04839748d6a6633e138e179667 P 929b168c73e648dfa25f494e90a0ed3c [term 1 FOLLOWER]: Refusing update from remote peer 64adbd65b8404e7180a20b86ad63bca9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:06:33.463909 32021 consensus_queue.cc:1035] T 9db08a04839748d6a6633e138e179667 P 64adbd65b8404e7180a20b86ad63bca9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "929b168c73e648dfa25f494e90a0ed3c" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 35083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:06:33.464133 32024 consensus_queue.cc:1035] T 9db08a04839748d6a6633e138e179667 P 64adbd65b8404e7180a20b86ad63bca9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c472ff7214044afdb58b3e8c9c52a44f" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 43709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:06:33.466421 32028 mvcc.cc:205] Tried to move back new op lower bound from 7317240190823579648 to 7317240190683852800. Current Snapshot: MvccSnapshot[applied={T|T < 7317240190823579648}]
I20260811 08:06:33.466735 32031 mvcc.cc:205] Tried to move back new op lower bound from 7317240190823579648 to 7317240190683852800. Current Snapshot: MvccSnapshot[applied={T|T < 7317240190823579648}]
I20260811 08:06:33.469061 31489 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:47460:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:06:33.469154 31489 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:47460:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:06:33.469991 31489 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1767bedafd404afdbb667219a20a6440: Sending DeleteTablet for 3 replicas of tablet 9db08a04839748d6a6633e138e179667
I20260811 08:06:33.470325 31931 tablet_service.cc:1514] Processing DeleteTablet for tablet 9db08a04839748d6a6633e138e179667 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:06:33 UTC) from {username='kudu', principal='kudu/127.15.36.254@KRBTEST.COM'} at 127.0.0.1:38710
I20260811 08:06:33.470369 31612 tablet_service.cc:1514] Processing DeleteTablet for tablet 9db08a04839748d6a6633e138e179667 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:06:33 UTC) from {username='kudu', principal='kudu/127.15.36.254@KRBTEST.COM'} at 127.0.0.1:46272
I20260811 08:06:33.470485 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 31535
I20260811 08:06:33.471659 31784 tablet_service.cc:1514] Processing DeleteTablet for tablet 9db08a04839748d6a6633e138e179667 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:06:33 UTC) from {username='kudu', principal='kudu/127.15.36.254@KRBTEST.COM'} at 127.0.0.1:35744
I20260811 08:06:33.473203 32039 tablet_replica.cc:330] T 9db08a04839748d6a6633e138e179667 P c472ff7214044afdb58b3e8c9c52a44f: stopping tablet replica
I20260811 08:06:33.473337 32039 raft_consensus.cc:2229] T 9db08a04839748d6a6633e138e179667 P c472ff7214044afdb58b3e8c9c52a44f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:06:33.473474 32039 raft_consensus.cc:2258] T 9db08a04839748d6a6633e138e179667 P c472ff7214044afdb58b3e8c9c52a44f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:06:33.474025 32039 ts_tablet_manager.cc:1905] T 9db08a04839748d6a6633e138e179667 P c472ff7214044afdb58b3e8c9c52a44f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:06:33.476327 32039 ts_tablet_manager.cc:1918] T 9db08a04839748d6a6633e138e179667 P c472ff7214044afdb58b3e8c9c52a44f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:06:33.476436 32039 log.cc:1196] T 9db08a04839748d6a6633e138e179667 P c472ff7214044afdb58b3e8c9c52a44f: Deleting WAL directory at /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-2/wal/wals/9db08a04839748d6a6633e138e179667
I20260811 08:06:33.476727 32039 ts_tablet_manager.cc:1939] T 9db08a04839748d6a6633e138e179667 P c472ff7214044afdb58b3e8c9c52a44f: Deleting consensus metadata
I20260811 08:06:33.477334 31475 catalog_manager.cc:4841] TS c472ff7214044afdb58b3e8c9c52a44f (127.15.36.195:43709): tablet 9db08a04839748d6a6633e138e179667 (table test-table [id=92a6c240ea154d0ab5e5cc2d109fd930]) successfully deleted
I20260811 08:06:33.479148 32041 tablet_replica.cc:330] T 9db08a04839748d6a6633e138e179667 P 64adbd65b8404e7180a20b86ad63bca9: stopping tablet replica
I20260811 08:06:33.479308 32041 raft_consensus.cc:2229] T 9db08a04839748d6a6633e138e179667 P 64adbd65b8404e7180a20b86ad63bca9 [term 1 LEADER]: Raft consensus shutting down.
I20260811 08:06:33.479501 32041 raft_consensus.cc:2258] T 9db08a04839748d6a6633e138e179667 P 64adbd65b8404e7180a20b86ad63bca9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:06:33.479967 32041 ts_tablet_manager.cc:1905] T 9db08a04839748d6a6633e138e179667 P 64adbd65b8404e7180a20b86ad63bca9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 08:06:33.480551 31473 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.36.193:35083 (error 108)
I20260811 08:06:33.480860 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 31706
I20260811 08:06:33.487267 31708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:33.487085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.193:35083 (local address 127.0.0.1:46280)
0811 08:06:33.487155 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:33.487219 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.193:35083: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260811 08:06:33.487462 31473 catalog_manager.cc:4584] TS 929b168c73e648dfa25f494e90a0ed3c (127.15.36.193:35083): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9db08a04839748d6a6633e138e179667: Network error: Client connection negotiation failed: client connection to 127.15.36.193:35083: connect: Connection refused (error 111)
I20260811 08:06:33.488543 31708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:33.488398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.194:40745 (local address 127.0.0.1:35772)
0811 08:06:33.488474 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:33.488505 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.194:40745: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260811 08:06:33.488653 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 31860
I20260811 08:06:33.499441 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 31454
I20260811 08:06:33.506670 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:40173
--webserver_interface=127.15.36.254
--webserver_port=38169
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=kudu/127.15.36.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:34085
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.36.254:40173
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:06:33.591632 32044 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:06:33.591876 32044 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:06:33.591900 32044 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:06:33.593003 32044 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:06:33.593043 32044 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:06:33.593057 32044 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:06:33.593070 32044 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:06:33.593081 32044 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:06:33.594532 32044 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:34085
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.36.254:40173
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=kudu/127.15.36.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:40173
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.36.254
--webserver_port=38169
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32044
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:06:33.594766 32044 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:06:33.594987 32044 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:06:33.600116 32049 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:06:33.600121 32052 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:06:33.600101 32050 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:06:33.600471 32044 server_base.cc:1034] running on GCE node
I20260811 08:06:33.600812 32044 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:06:33.601127 32044 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:06:33.602314 32044 hybrid_clock.cc:648] HybridClock initialized: now 1786435593602302 us; error 40 us; skew 500 ppm
Aug 11 08:06:33 dist-test-slave-2w3w krb5kdc[30834](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435593, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:06:33.605073 32044 init.cc:377] Logged in from keytab as kudu/127.15.36.254@KRBTEST.COM (short username kudu)
I20260811 08:06:33.605553 32044 webserver.cc:460] Webserver started at http://127.15.36.254:38169/ using document root <none> and password file <none>
I20260811 08:06:33.605822 32044 fs_manager.cc:359] Metadata directory not provided
I20260811 08:06:33.605897 32044 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:06:33.607386 32044 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 08:06:33.608176 32061 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:06:33.608392 32044 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:06:33.608489 32044 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/master-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/master-0/wal
uuid: "1767bedafd404afdbb667219a20a6440"
format_stamp: "Formatted at 2026-08-11 08:06:31 on dist-test-slave-2w3w"
server_key: "118e4a9af2741bb7983ef8ccf5aaaf62"
server_key_iv: "12d4557d27ec4c7b902376f4aec51911"
server_key_version: "encryptionkey@0"
I20260811 08:06:33.608829 32044 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:06:33.627676 32044 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:06:33.629803 32044 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:06:33.629923 32044 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:06:33.634027 32044 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.254:40173
I20260811 08:06:33.634068 32118 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.254:40173 every 8 connection(s)
I20260811 08:06:33.634490 32044 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
I20260811 08:06:33.636225 32120 sys_catalog.cc:263] Verifying existing consensus state
I20260811 08:06:33.636936 32120 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1767bedafd404afdbb667219a20a6440: Bootstrap starting.
I20260811 08:06:33.642657 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 32044
I20260811 08:06:33.643013 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.193:35083
--local_ip_for_outbound_sockets=127.15.36.193
--tserver_master_addrs=127.15.36.254:40173
--webserver_port=36107
--webserver_interface=127.15.36.193
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab
--principal=kudu/127.15.36.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:34085
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 08:06:33.645902 32120 log.cc:824] T 00000000000000000000000000000000 P 1767bedafd404afdbb667219a20a6440: Log is configured to *not* fsync() on all Append() calls
I20260811 08:06:33.648329 32120 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1767bedafd404afdbb667219a20a6440: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 08:06:33.648663 32120 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1767bedafd404afdbb667219a20a6440: Bootstrap complete.
I20260811 08:06:33.651089 32120 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1767bedafd404afdbb667219a20a6440 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1767bedafd404afdbb667219a20a6440" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 40173 } }
I20260811 08:06:33.651366 32120 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1767bedafd404afdbb667219a20a6440 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1767bedafd404afdbb667219a20a6440, State: Initialized, Role: FOLLOWER
I20260811 08:06:33.651587 32120 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1767bedafd404afdbb667219a20a6440 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1767bedafd404afdbb667219a20a6440" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 40173 } }
I20260811 08:06:33.651687 32120 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1767bedafd404afdbb667219a20a6440 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:06:33.651742 32120 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1767bedafd404afdbb667219a20a6440 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:06:33.651793 32120 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1767bedafd404afdbb667219a20a6440 [term 2 FOLLOWER]: Advancing to term 3
I20260811 08:06:33.652881 32120 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1767bedafd404afdbb667219a20a6440 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1767bedafd404afdbb667219a20a6440" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 40173 } }
I20260811 08:06:33.653012 32120 leader_election.cc:302] T 00000000000000000000000000000000 P 1767bedafd404afdbb667219a20a6440 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1767bedafd404afdbb667219a20a6440; no voters:
I20260811 08:06:33.653241 32120 leader_election.cc:288] T 00000000000000000000000000000000 P 1767bedafd404afdbb667219a20a6440 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260811 08:06:33.653282 32124 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1767bedafd404afdbb667219a20a6440 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 08:06:33.653414 32124 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1767bedafd404afdbb667219a20a6440 [term 3 LEADER]: Becoming Leader. State: Replica: 1767bedafd404afdbb667219a20a6440, State: Running, Role: LEADER
I20260811 08:06:33.653513 32124 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1767bedafd404afdbb667219a20a6440 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1767bedafd404afdbb667219a20a6440" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 40173 } }
I20260811 08:06:33.653545 32120 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1767bedafd404afdbb667219a20a6440 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:06:33.653981 32124 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1767bedafd404afdbb667219a20a6440 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1767bedafd404afdbb667219a20a6440. Latest consensus state: current_term: 3 leader_uuid: "1767bedafd404afdbb667219a20a6440" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1767bedafd404afdbb667219a20a6440" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 40173 } } }
I20260811 08:06:33.654068 32124 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1767bedafd404afdbb667219a20a6440 [sys.catalog]: This master's current role is: LEADER
I20260811 08:06:33.653986 32125 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1767bedafd404afdbb667219a20a6440 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "1767bedafd404afdbb667219a20a6440" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1767bedafd404afdbb667219a20a6440" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 40173 } } }
I20260811 08:06:33.654253 32125 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1767bedafd404afdbb667219a20a6440 [sys.catalog]: This master's current role is: LEADER
I20260811 08:06:33.654265 32129 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:06:33.655472 32129 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:06:33.655602 32129 catalog_manager.cc:1259] Loaded cluster ID: 4c7befe33c884de1ab74448e8864744c
I20260811 08:06:33.655846 32129 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260811 08:06:33.656214 32129 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f5c2dd619ad google::LogMessage::Fail() at ??:0
@ 0x7f5c2dd6488a google::LogMessage::SendToLog() at ??:0
@ 0x7f5c2dd614de google::LogMessage::Flush() at ??:0
@ 0x7f5c2dd62a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f5c35c860f1 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f5c35c8f8b9 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f5c2fc2f0d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f5c2fc24954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f5c30a886db start_thread at ??:0
@ 0x7f5c2c85f61f clone at ??:0
W20260811 08:06:33.746377 32122 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:06:33.746688 32122 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:06:33.746731 32122 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:06:33.747988 32122 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:06:33.748062 32122 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:06:33.748109 32122 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.193
I20260811 08:06:33.749706 32122 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:34085
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab
--principal=kudu/127.15.36.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.193:35083
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.36.193
--webserver_port=36107
--tserver_master_addrs=127.15.36.254:40173
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32122
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.193
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:06:33.749989 32122 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:06:33.750238 32122 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:06:33.755440 32162 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:06:33.755441 32165 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:06:33.755525 32163 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:06:33.755911 32122 server_base.cc:1034] running on GCE node
I20260811 08:06:33.756115 32122 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:06:33.756382 32122 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:06:33.757598 32122 hybrid_clock.cc:648] HybridClock initialized: now 1786435593757578 us; error 35 us; skew 500 ppm
Aug 11 08:06:33 dist-test-slave-2w3w krb5kdc[30834](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435593, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:06:33.760784 32122 init.cc:377] Logged in from keytab as kudu/127.15.36.193@KRBTEST.COM (short username kudu)
I20260811 08:06:33.761303 32122 webserver.cc:460] Webserver started at http://127.15.36.193:36107/ using document root <none> and password file <none>
I20260811 08:06:33.761567 32122 fs_manager.cc:359] Metadata directory not provided
I20260811 08:06:33.761639 32122 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:06:33.763198 32122 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 08:06:33.764099 32172 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:06:33.764340 32122 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:06:33.764449 32122 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-0/wal
uuid: "929b168c73e648dfa25f494e90a0ed3c"
format_stamp: "Formatted at 2026-08-11 08:06:31 on dist-test-slave-2w3w"
server_key: "2b0fd6bc146982af62e1c0f877165719"
server_key_iv: "0c0f914d5c03f13c6d67ca14dba29b15"
server_key_version: "encryptionkey@0"
I20260811 08:06:33.764853 32122 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:06:33.780809 32122 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:06:33.783581 32122 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:06:33.783776 32122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:06:33.784060 32122 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:06:33.784556 32181 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 08:06:33.786559 32122 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 08:06:33.786733 32122 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260811 08:06:33.786832 32122 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 08:06:33.787703 32122 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 08:06:33.787773 32122 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260811 08:06:33.787849 32181 tablet_bootstrap.cc:492] T 9db08a04839748d6a6633e138e179667 P 929b168c73e648dfa25f494e90a0ed3c: Bootstrap starting.
I20260811 08:06:33.796046 32122 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.193:35083
I20260811 08:06:33.796103 32301 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.193:35083 every 8 connection(s)
I20260811 08:06:33.796523 32122 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
I20260811 08:06:33.799220 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 32122
I20260811 08:06:33.799542 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.194:40745
--local_ip_for_outbound_sockets=127.15.36.194
--tserver_master_addrs=127.15.36.254:40173
--webserver_port=35375
--webserver_interface=127.15.36.194
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab
--principal=kudu/127.15.36.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:34085
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 08:06:33.800323 32181 log.cc:824] T 9db08a04839748d6a6633e138e179667 P 929b168c73e648dfa25f494e90a0ed3c: Log is configured to *not* fsync() on all Append() calls
I20260811 08:06:33.803786 32181 tablet_bootstrap.cc:492] T 9db08a04839748d6a6633e138e179667 P 929b168c73e648dfa25f494e90a0ed3c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 08:06:33.804159 32181 tablet_bootstrap.cc:492] T 9db08a04839748d6a6633e138e179667 P 929b168c73e648dfa25f494e90a0ed3c: Bootstrap complete.
I20260811 08:06:33.805619 32181 ts_tablet_manager.cc:1397] T 9db08a04839748d6a6633e138e179667 P 929b168c73e648dfa25f494e90a0ed3c: Time spent bootstrapping tablet: real 0.018s user 0.005s sys 0.010s
I20260811 08:06:33.807209 32181 raft_consensus.cc:348] T 9db08a04839748d6a6633e138e179667 P 929b168c73e648dfa25f494e90a0ed3c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c472ff7214044afdb58b3e8c9c52a44f" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 43709 } } peers { permanent_uuid: "64adbd65b8404e7180a20b86ad63bca9" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 40745 } } peers { permanent_uuid: "929b168c73e648dfa25f494e90a0ed3c" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 35083 } }
I20260811 08:06:33.807585 32181 raft_consensus.cc:729] T 9db08a04839748d6a6633e138e179667 P 929b168c73e648dfa25f494e90a0ed3c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 929b168c73e648dfa25f494e90a0ed3c, State: Initialized, Role: FOLLOWER
I20260811 08:06:33.807749 32181 consensus_queue.cc:260] T 9db08a04839748d6a6633e138e179667 P 929b168c73e648dfa25f494e90a0ed3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c472ff7214044afdb58b3e8c9c52a44f" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 43709 } } peers { permanent_uuid: "64adbd65b8404e7180a20b86ad63bca9" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 40745 } } peers { permanent_uuid: "929b168c73e648dfa25f494e90a0ed3c" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 35083 } }
I20260811 08:06:33.808073 32181 ts_tablet_manager.cc:1428] T 9db08a04839748d6a6633e138e179667 P 929b168c73e648dfa25f494e90a0ed3c: Time spent starting tablet: real 0.002s user 0.002s sys 0.003s
W20260811 08:06:33.861929 32304 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:06:33.797313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:40173 (local address 127.15.36.193:33721)
0811 08:06:33.797503 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:33.797549 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 08:06:33.798033 (+ 484us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:06:33.861671 (+ 63638us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:40173: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":103,"threads_started":1}
W20260811 08:06:33.862198 32302 heartbeater.cc:644] Failed to heartbeat to 127.15.36.254:40173 (0 consecutive failures): Network error: Failed to ping master at 127.15.36.254:40173: Client connection negotiation failed: client connection to 127.15.36.254:40173: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 08:06:33.862618 32304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:33.862472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:40173 (local address 127.15.36.193:58919)
0811 08:06:33.862532 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:33.862597 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:40173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260811 08:06:33.863070 32304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:33.862921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:40173 (local address 127.15.36.193:59037)
0811 08:06:33.863013 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:33.863042 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:40173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
W20260811 08:06:33.863217 32302 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 08:06:33.890266 32306 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:06:33.890545 32306 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:06:33.890592 32306 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:06:33.892409 32306 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:06:33.892491 32306 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:06:33.892540 32306 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.194
I20260811 08:06:33.894089 32306 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:34085
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab
--principal=kudu/127.15.36.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.194:40745
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.36.194
--webserver_port=35375
--tserver_master_addrs=127.15.36.254:40173
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32306
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.194
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:06:33.894384 32306 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:06:33.894634 32306 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:06:33.899895 32312 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:06:33.899999 32315 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:06:33.900012 32313 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:06:33.900220 32306 server_base.cc:1034] running on GCE node
I20260811 08:06:33.900504 32306 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:06:33.900779 32306 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:06:33.901959 32306 hybrid_clock.cc:648] HybridClock initialized: now 1786435593901933 us; error 39 us; skew 500 ppm
Aug 11 08:06:33 dist-test-slave-2w3w krb5kdc[30834](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435593, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:06:33.904863 32306 init.cc:377] Logged in from keytab as kudu/127.15.36.194@KRBTEST.COM (short username kudu)
I20260811 08:06:33.905445 32306 webserver.cc:460] Webserver started at http://127.15.36.194:35375/ using document root <none> and password file <none>
I20260811 08:06:33.905694 32306 fs_manager.cc:359] Metadata directory not provided
I20260811 08:06:33.905766 32306 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:06:33.907310 32306 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 08:06:33.908237 32323 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:06:33.908439 32306 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:06:33.908548 32306 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-1/wal
uuid: "64adbd65b8404e7180a20b86ad63bca9"
format_stamp: "Formatted at 2026-08-11 08:06:31 on dist-test-slave-2w3w"
server_key: "1fc5d2c099ed50f6eefa074e18b40eca"
server_key_iv: "db1d2b5dba17dceecea686704526c775"
server_key_version: "encryptionkey@0"
I20260811 08:06:33.908982 32306 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:06:33.924710 32306 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:06:33.927301 32306 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:06:33.927495 32306 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:06:33.927763 32306 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:06:33.928232 32332 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 08:06:33.929738 32306 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 08:06:33.929817 32306 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260811 08:06:33.929877 32306 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 08:06:33.930557 32306 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 08:06:33.930615 32306 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260811 08:06:33.930699 32332 tablet_bootstrap.cc:492] T 9db08a04839748d6a6633e138e179667 P 64adbd65b8404e7180a20b86ad63bca9: Bootstrap starting.
I20260811 08:06:33.932374 32332 log.cc:824] T 9db08a04839748d6a6633e138e179667 P 64adbd65b8404e7180a20b86ad63bca9: Log is configured to *not* fsync() on all Append() calls
I20260811 08:06:33.935209 32332 tablet_bootstrap.cc:492] T 9db08a04839748d6a6633e138e179667 P 64adbd65b8404e7180a20b86ad63bca9: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 08:06:33.935568 32332 tablet_bootstrap.cc:492] T 9db08a04839748d6a6633e138e179667 P 64adbd65b8404e7180a20b86ad63bca9: Bootstrap complete.
I20260811 08:06:33.935774 32332 ts_tablet_manager.cc:1397] T 9db08a04839748d6a6633e138e179667 P 64adbd65b8404e7180a20b86ad63bca9: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260811 08:06:33.937143 32332 raft_consensus.cc:348] T 9db08a04839748d6a6633e138e179667 P 64adbd65b8404e7180a20b86ad63bca9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c472ff7214044afdb58b3e8c9c52a44f" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 43709 } } peers { permanent_uuid: "64adbd65b8404e7180a20b86ad63bca9" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 40745 } } peers { permanent_uuid: "929b168c73e648dfa25f494e90a0ed3c" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 35083 } }
I20260811 08:06:33.937408 32332 raft_consensus.cc:729] T 9db08a04839748d6a6633e138e179667 P 64adbd65b8404e7180a20b86ad63bca9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64adbd65b8404e7180a20b86ad63bca9, State: Initialized, Role: FOLLOWER
I20260811 08:06:33.937631 32332 consensus_queue.cc:260] T 9db08a04839748d6a6633e138e179667 P 64adbd65b8404e7180a20b86ad63bca9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c472ff7214044afdb58b3e8c9c52a44f" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 43709 } } peers { permanent_uuid: "64adbd65b8404e7180a20b86ad63bca9" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 40745 } } peers { permanent_uuid: "929b168c73e648dfa25f494e90a0ed3c" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 35083 } }
I20260811 08:06:33.937951 32332 ts_tablet_manager.cc:1428] T 9db08a04839748d6a6633e138e179667 P 64adbd65b8404e7180a20b86ad63bca9: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 08:06:33.938519 32306 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.194:40745
I20260811 08:06:33.938623 32452 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.194:40745 every 8 connection(s)
I20260811 08:06:33.938915 32306 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
I20260811 08:06:33.939970 32455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:33.939618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:40173 (local address 127.15.36.194:59777)
0811 08:06:33.939761 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:33.939832 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:40173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":64,"threads_started":1}
W20260811 08:06:33.940266 32453 heartbeater.cc:644] Failed to heartbeat to 127.15.36.254:40173 (0 consecutive failures): Network error: Failed to ping master at 127.15.36.254:40173: Client connection negotiation failed: client connection to 127.15.36.254:40173: connect: Connection refused (error 111)
I20260811 08:06:33.940541 32455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:33.940467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:40173 (local address 127.15.36.194:46631)
0811 08:06:33.940500 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:33.940525 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:40173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
I20260811 08:06:33.940766 32455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:33.940719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:40173 (local address 127.15.36.194:59001)
0811 08:06:33.940738 (+ 19us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:33.940755 (+ 17us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:40173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":11}
W20260811 08:06:33.940867 32453 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 08:06:33.946269 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 32306
I20260811 08:06:33.946605 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.195:43709
--local_ip_for_outbound_sockets=127.15.36.195
--tserver_master_addrs=127.15.36.254:40173
--webserver_port=43185
--webserver_interface=127.15.36.195
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab
--principal=kudu/127.15.36.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:34085
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:06:34.032932 32456 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:06:34.033169 32456 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:06:34.033195 32456 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:06:34.034379 32456 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:06:34.034426 32456 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:06:34.034453 32456 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.195
I20260811 08:06:34.036005 32456 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:34085
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab
--principal=kudu/127.15.36.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.195:43709
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.36.195
--webserver_port=43185
--tserver_master_addrs=127.15.36.254:40173
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32456
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.195
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:06:34.036291 32456 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:06:34.036543 32456 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:06:34.041934 32462 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:06:34.041934 32463 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:06:34.041992 32465 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:06:34.042274 32456 server_base.cc:1034] running on GCE node
I20260811 08:06:34.042474 32456 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:06:34.042695 32456 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:06:34.043838 32456 hybrid_clock.cc:648] HybridClock initialized: now 1786435594043825 us; error 32 us; skew 500 ppm
Aug 11 08:06:34 dist-test-slave-2w3w krb5kdc[30834](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435594, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:06:34.046535 32456 init.cc:377] Logged in from keytab as kudu/127.15.36.195@KRBTEST.COM (short username kudu)
I20260811 08:06:34.046947 32456 webserver.cc:460] Webserver started at http://127.15.36.195:43185/ using document root <none> and password file <none>
I20260811 08:06:34.047219 32456 fs_manager.cc:359] Metadata directory not provided
I20260811 08:06:34.047289 32456 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:06:34.048679 32456 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:06:34.049335 32472 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:06:34.049607 32456 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:06:34.049713 32456 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-2/wal
uuid: "c472ff7214044afdb58b3e8c9c52a44f"
format_stamp: "Formatted at 2026-08-11 08:06:32 on dist-test-slave-2w3w"
server_key: "77ddd1edaeda8bde221ab1e564df28c6"
server_key_iv: "81f5503f09b2a707635afabbd0b3d13c"
server_key_version: "encryptionkey@0"
I20260811 08:06:34.050083 32456 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:06:34.072744 32456 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:06:34.074741 32456 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:06:34.074915 32456 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:06:34.075196 32456 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:06:34.075517 32456 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:06:34.075572 32456 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:06:34.075613 32456 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:06:34.075656 32456 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:06:34.081812 32456 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.195:43709
I20260811 08:06:34.081858 32606 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.195:43709 every 8 connection(s)
I20260811 08:06:34.082222 32456 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
I20260811 08:06:34.083133 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 32456
I20260811 08:06:34.083508 32609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:34.083045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:40173 (local address 127.15.36.195:42083)
0811 08:06:34.083247 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:34.083351 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:40173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":89,"threads_started":1}
W20260811 08:06:34.083918 32607 heartbeater.cc:644] Failed to heartbeat to 127.15.36.254:40173 (0 consecutive failures): Network error: Failed to ping master at 127.15.36.254:40173: Client connection negotiation failed: client connection to 127.15.36.254:40173: connect: Connection refused (error 111)
I20260811 08:06:34.084219 32609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:34.084118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:40173 (local address 127.15.36.195:54799)
0811 08:06:34.084170 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:34.084199 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:40173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260811 08:06:34.084519 32609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:34.084424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:40173 (local address 127.15.36.195:51495)
0811 08:06:34.084474 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:34.084497 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:40173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260811 08:06:34.084619 32607 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 08:06:34.863960 32611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:34.863635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:40173 (local address 127.15.36.193:42481)
0811 08:06:34.863808 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:34.863857 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:40173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":69,"threads_started":1}
I20260811 08:06:34.941433 32612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:34.941208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:40173 (local address 127.15.36.194:35213)
0811 08:06:34.941347 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:34.941386 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:40173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":60,"threads_started":1}
I20260811 08:06:35.085323 32613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:35.085025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:40173 (local address 127.15.36.195:37907)
0811 08:06:35.085194 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:35.085242 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:40173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":71,"threads_started":1}
I20260811 08:06:35.477512 32614 raft_consensus.cc:482] T 9db08a04839748d6a6633e138e179667 P 929b168c73e648dfa25f494e90a0ed3c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:06:35.477684 32614 raft_consensus.cc:504] T 9db08a04839748d6a6633e138e179667 P 929b168c73e648dfa25f494e90a0ed3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c472ff7214044afdb58b3e8c9c52a44f" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 43709 } } peers { permanent_uuid: "64adbd65b8404e7180a20b86ad63bca9" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 40745 } } peers { permanent_uuid: "929b168c73e648dfa25f494e90a0ed3c" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 35083 } }
I20260811 08:06:35.478130 32614 leader_election.cc:288] T 9db08a04839748d6a6633e138e179667 P 929b168c73e648dfa25f494e90a0ed3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c472ff7214044afdb58b3e8c9c52a44f (127.15.36.195:43709), 64adbd65b8404e7180a20b86ad63bca9 (127.15.36.194:40745)
Aug 11 08:06:35 dist-test-slave-2w3w krb5kdc[30834](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435593, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.193@KRBTEST.COM for kudu/127.15.36.195@KRBTEST.COM
Aug 11 08:06:35 dist-test-slave-2w3w krb5kdc[30834](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435593, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.193@KRBTEST.COM for kudu/127.15.36.194@KRBTEST.COM
I20260811 08:06:35.485041 32620 raft_consensus.cc:482] T 9db08a04839748d6a6633e138e179667 P 64adbd65b8404e7180a20b86ad63bca9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:06:35.485157 32620 raft_consensus.cc:504] T 9db08a04839748d6a6633e138e179667 P 64adbd65b8404e7180a20b86ad63bca9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c472ff7214044afdb58b3e8c9c52a44f" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 43709 } } peers { permanent_uuid: "64adbd65b8404e7180a20b86ad63bca9" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 40745 } } peers { permanent_uuid: "929b168c73e648dfa25f494e90a0ed3c" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 35083 } }
I20260811 08:06:35.485752 32620 leader_election.cc:288] T 9db08a04839748d6a6633e138e179667 P 64adbd65b8404e7180a20b86ad63bca9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c472ff7214044afdb58b3e8c9c52a44f (127.15.36.195:43709), 929b168c73e648dfa25f494e90a0ed3c (127.15.36.193:35083)
I20260811 08:06:35.490213 32616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:35.478302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.194:40745 (local address 127.15.36.193:53093)
0811 08:06:35.478525 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:35.478539 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 08:06:35.478628 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:06:35.479130 (+ 502us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:06:35.479133 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:06:35.479579 (+ 446us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:06:35.479805 (+ 226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:35.479812 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:35.480947 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:35.480948 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:35.481761 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:35.481764 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:35.482396 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:35.482397 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:35.482533 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:35.483223 (+ 690us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:06:35.483234 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:06:35.485595 (+ 2361us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:06:35.488374 (+ 2779us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:06:35.488380 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:06:35.488382 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:06:35.488701 (+ 319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:06:35.489026 (+ 325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:06:35.489027 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:06:35.489027 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:06:35.489154 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:06:35.489671 (+ 517us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:06:35.489676 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:06:35.489818 (+ 142us) client_negotiation.cc:769] Sending connection context
0811 08:06:35.489923 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 08:06:35.490099 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":203,"mutex_wait_us":36,"thread_start_us":83,"threads_started":1}
I20260811 08:06:35.490509 32615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:35.478399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.195:43709 (local address 127.15.36.193:52437)
0811 08:06:35.478540 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:35.478552 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:06:35.478617 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:06:35.479566 (+ 949us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:06:35.479567 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:06:35.479730 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:06:35.479811 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:35.479813 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:35.480935 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:35.480936 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:35.481796 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:35.481819 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:35.482402 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:35.482403 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:35.482530 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:35.483276 (+ 746us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:06:35.483280 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:06:35.484898 (+ 1618us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:06:35.489139 (+ 4241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:06:35.489140 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:06:35.489141 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:06:35.489384 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:06:35.489660 (+ 276us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:06:35.489661 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:06:35.489661 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:06:35.489728 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:06:35.490198 (+ 470us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:06:35.490199 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:06:35.490242 (+ 43us) client_negotiation.cc:769] Sending connection context
0811 08:06:35.490316 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 08:06:35.490424 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"mutex_wait_us":44,"thread_start_us":76,"threads_started":1}
I20260811 08:06:35.490590 32617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:35.478463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:53093 (local address 127.15.36.194:40745)
0811 08:06:35.478705 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0811 08:06:35.478715 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 08:06:35.478744 (+ 29us) server_negotiation.cc:407] Connection header received
0811 08:06:35.478848 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:06:35.478851 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:06:35.478892 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:06:35.479069 (+ 177us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:06:35.479928 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:35.480820 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:35.481857 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:35.482292 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:35.482406 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:35.485722 (+ 3316us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:06:35.485726 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:06:35.485726 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:06:35.485741 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:06:35.488270 (+ 2529us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:35.488810 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:35.488813 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:35.488814 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:35.488949 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:35.489234 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:35.489235 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:35.489236 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:35.489559 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:06:35.489641 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 08:06:35.490319 (+ 678us) server_negotiation.cc:299] Negotiation successful
0811 08:06:35.490468 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":60,"threads_started":1}
I20260811 08:06:35.491101 32401 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9db08a04839748d6a6633e138e179667" candidate_uuid: "929b168c73e648dfa25f494e90a0ed3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "64adbd65b8404e7180a20b86ad63bca9" is_pre_election: true
I20260811 08:06:35.491240 32401 raft_consensus.cc:2454] T 9db08a04839748d6a6633e138e179667 P 64adbd65b8404e7180a20b86ad63bca9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 929b168c73e648dfa25f494e90a0ed3c in term 1.
I20260811 08:06:35.491554 32176 leader_election.cc:302] T 9db08a04839748d6a6633e138e179667 P 929b168c73e648dfa25f494e90a0ed3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64adbd65b8404e7180a20b86ad63bca9, 929b168c73e648dfa25f494e90a0ed3c; no voters:
I20260811 08:06:35.491726 32614 raft_consensus.cc:2781] T 9db08a04839748d6a6633e138e179667 P 929b168c73e648dfa25f494e90a0ed3c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 08:06:35.491798 32614 raft_consensus.cc:482] T 9db08a04839748d6a6633e138e179667 P 929b168c73e648dfa25f494e90a0ed3c [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:06:35.491828 32614 raft_consensus.cc:3037] T 9db08a04839748d6a6633e138e179667 P 929b168c73e648dfa25f494e90a0ed3c [term 1 FOLLOWER]: Advancing to term 2
I20260811 08:06:35.491830 32619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:35.478477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:52437 (local address 127.15.36.195:43709)
0811 08:06:35.478663 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0811 08:06:35.478677 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 08:06:35.478717 (+ 40us) server_negotiation.cc:407] Connection header received
0811 08:06:35.479357 (+ 640us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:06:35.479361 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:06:35.479424 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:06:35.479564 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:06:35.479962 (+ 398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:35.480818 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:35.481915 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:35.482296 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:35.482445 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:35.485086 (+ 2641us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:06:35.485090 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:06:35.485091 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:06:35.485104 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:06:35.489039 (+ 3935us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:35.489469 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:35.489472 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:35.489473 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:35.489586 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:35.489800 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:35.489801 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:35.489801 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:35.490104 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:06:35.490191 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 08:06:35.491514 (+ 1323us) server_negotiation.cc:299] Negotiation successful
0811 08:06:35.491709 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":67,"threads_started":1}
Aug 11 08:06:35 dist-test-slave-2w3w krb5kdc[30834](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435593, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.194@KRBTEST.COM for kudu/127.15.36.195@KRBTEST.COM
W20260811 08:06:35.492527 32177 leader_election.cc:341] T 9db08a04839748d6a6633e138e179667 P 929b168c73e648dfa25f494e90a0ed3c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c472ff7214044afdb58b3e8c9c52a44f (127.15.36.195:43709): Not found: Tablet not found: 9db08a04839748d6a6633e138e179667
Aug 11 08:06:35 dist-test-slave-2w3w krb5kdc[30834](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435593, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.194@KRBTEST.COM for kudu/127.15.36.193@KRBTEST.COM
I20260811 08:06:35.493458 32614 raft_consensus.cc:504] T 9db08a04839748d6a6633e138e179667 P 929b168c73e648dfa25f494e90a0ed3c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c472ff7214044afdb58b3e8c9c52a44f" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 43709 } } peers { permanent_uuid: "64adbd65b8404e7180a20b86ad63bca9" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 40745 } } peers { permanent_uuid: "929b168c73e648dfa25f494e90a0ed3c" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 35083 } }
I20260811 08:06:35.493626 32614 leader_election.cc:288] T 9db08a04839748d6a6633e138e179667 P 929b168c73e648dfa25f494e90a0ed3c [CANDIDATE]: Term 2 election: Requested vote from peers c472ff7214044afdb58b3e8c9c52a44f (127.15.36.195:43709), 64adbd65b8404e7180a20b86ad63bca9 (127.15.36.194:40745)
I20260811 08:06:35.493896 32401 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9db08a04839748d6a6633e138e179667" candidate_uuid: "929b168c73e648dfa25f494e90a0ed3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "64adbd65b8404e7180a20b86ad63bca9"
I20260811 08:06:35.494022 32401 raft_consensus.cc:3037] T 9db08a04839748d6a6633e138e179667 P 64adbd65b8404e7180a20b86ad63bca9 [term 1 FOLLOWER]: Advancing to term 2
W20260811 08:06:35.494449 32177 leader_election.cc:341] T 9db08a04839748d6a6633e138e179667 P 929b168c73e648dfa25f494e90a0ed3c [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer c472ff7214044afdb58b3e8c9c52a44f (127.15.36.195:43709): Not found: Tablet not found: 9db08a04839748d6a6633e138e179667
I20260811 08:06:35.495625 32401 raft_consensus.cc:2454] T 9db08a04839748d6a6633e138e179667 P 64adbd65b8404e7180a20b86ad63bca9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 929b168c73e648dfa25f494e90a0ed3c in term 2.
I20260811 08:06:35.495795 32176 leader_election.cc:302] T 9db08a04839748d6a6633e138e179667 P 929b168c73e648dfa25f494e90a0ed3c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 64adbd65b8404e7180a20b86ad63bca9, 929b168c73e648dfa25f494e90a0ed3c; no voters: c472ff7214044afdb58b3e8c9c52a44f
I20260811 08:06:35.495940 32614 raft_consensus.cc:2781] T 9db08a04839748d6a6633e138e179667 P 929b168c73e648dfa25f494e90a0ed3c [term 2 FOLLOWER]: Leader election won for term 2
I20260811 08:06:35.496133 32614 raft_consensus.cc:686] T 9db08a04839748d6a6633e138e179667 P 929b168c73e648dfa25f494e90a0ed3c [term 2 LEADER]: Becoming Leader. State: Replica: 929b168c73e648dfa25f494e90a0ed3c, State: Running, Role: LEADER
I20260811 08:06:35.496234 32614 consensus_queue.cc:237] T 9db08a04839748d6a6633e138e179667 P 929b168c73e648dfa25f494e90a0ed3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c472ff7214044afdb58b3e8c9c52a44f" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 43709 } } peers { permanent_uuid: "64adbd65b8404e7180a20b86ad63bca9" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 40745 } } peers { permanent_uuid: "929b168c73e648dfa25f494e90a0ed3c" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 35083 } }
I20260811 08:06:35.496443 32615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:35.496342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:40173 (local address 127.15.36.193:58929)
0811 08:06:35.496386 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:35.496411 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:40173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260811 08:06:35.496769 32621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:35.485656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.195:43709 (local address 127.15.36.194:51643)
0811 08:06:35.486109 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:35.486123 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 08:06:35.486222 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:06:35.486439 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:06:35.486447 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:06:35.486939 (+ 492us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:06:35.487052 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:35.487055 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:35.488084 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:35.488085 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:35.489117 (+ 1032us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:35.489120 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:35.489705 (+ 585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:35.489706 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:35.489818 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:35.490484 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:06:35.490489 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:06:35.492820 (+ 2331us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:06:35.494987 (+ 2167us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:06:35.494995 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:06:35.494997 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:06:35.495303 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:06:35.495824 (+ 521us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:06:35.495825 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:06:35.495826 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:06:35.495909 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:06:35.496382 (+ 473us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:06:35.496383 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:06:35.496431 (+ 48us) client_negotiation.cc:769] Sending connection context
0811 08:06:35.496501 (+ 70us) client_negotiation.cc:240] Negotiation successful
0811 08:06:35.496633 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":441,"thread_start_us":52,"threads_started":1}
I20260811 08:06:35.496788 32624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:35.485881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:39329 (local address 127.15.36.193:35083)
0811 08:06:35.485994 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0811 08:06:35.485999 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:06:35.486550 (+ 551us) server_negotiation.cc:407] Connection header received
0811 08:06:35.486615 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:06:35.486618 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:06:35.486632 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:06:35.486740 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:06:35.487342 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:35.488274 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:35.489286 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:35.489718 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:35.489756 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:35.493264 (+ 3508us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:06:35.493272 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:06:35.493272 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:06:35.493279 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:06:35.495206 (+ 1927us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:35.495747 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:35.495750 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:35.495751 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:35.495818 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:35.496056 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:35.496057 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:35.496057 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:35.496247 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:06:35.496309 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 08:06:35.496634 (+ 325us) server_negotiation.cc:299] Negotiation successful
0811 08:06:35.496722 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89,"thread_start_us":48,"threads_started":1}
I20260811 08:06:35.497073 32622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:35.485657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.193:35083 (local address 127.15.36.194:39329)
0811 08:06:35.486461 (+ 804us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:35.486477 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 08:06:35.486554 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:06:35.486807 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:06:35.486808 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:06:35.487124 (+ 316us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:06:35.487244 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:35.487246 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:35.488381 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:35.488382 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:35.489196 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:35.489199 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:35.489841 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:35.489842 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:35.489929 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:35.490637 (+ 708us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:06:35.490644 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:06:35.493146 (+ 2502us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:06:35.495289 (+ 2143us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:06:35.495290 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:06:35.495291 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:06:35.495549 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:06:35.495898 (+ 349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:06:35.495898 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:06:35.495899 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:06:35.495971 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:06:35.496365 (+ 394us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:06:35.496372 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:06:35.496430 (+ 58us) client_negotiation.cc:769] Sending connection context
0811 08:06:35.496883 (+ 453us) client_negotiation.cc:240] Negotiation successful
0811 08:06:35.497003 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":792,"mutex_wait_us":10,"thread_start_us":59,"threads_started":1}
I20260811 08:06:35.497339 32623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:35.485837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:51643 (local address 127.15.36.195:43709)
0811 08:06:35.486065 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0811 08:06:35.486067 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:06:35.486209 (+ 142us) server_negotiation.cc:407] Connection header received
0811 08:06:35.486277 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:06:35.486278 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:06:35.486295 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:06:35.486380 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:06:35.487148 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:35.487973 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:35.489221 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:35.489565 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:35.489610 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:35.492968 (+ 3358us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:06:35.492970 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:06:35.492971 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:06:35.492980 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:06:35.494866 (+ 1886us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:35.495621 (+ 755us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:35.495622 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:35.495623 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:35.495691 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:35.496029 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:35.496030 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:35.496030 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:35.496245 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:06:35.497057 (+ 812us) server_negotiation.cc:1035] Waiting for connection context
0811 08:06:35.497103 (+ 46us) server_negotiation.cc:299] Negotiation successful
0811 08:06:35.497195 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":205,"thread_start_us":85,"threads_started":1}
I20260811 08:06:35.497511 32251 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9db08a04839748d6a6633e138e179667" candidate_uuid: "64adbd65b8404e7180a20b86ad63bca9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "929b168c73e648dfa25f494e90a0ed3c" is_pre_election: true
W20260811 08:06:35.497790 32326 leader_election.cc:341] T 9db08a04839748d6a6633e138e179667 P 64adbd65b8404e7180a20b86ad63bca9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c472ff7214044afdb58b3e8c9c52a44f (127.15.36.195:43709): Not found: Tablet not found: 9db08a04839748d6a6633e138e179667
I20260811 08:06:35.497939 32324 leader_election.cc:302] T 9db08a04839748d6a6633e138e179667 P 64adbd65b8404e7180a20b86ad63bca9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 64adbd65b8404e7180a20b86ad63bca9; no voters: 929b168c73e648dfa25f494e90a0ed3c, c472ff7214044afdb58b3e8c9c52a44f
I20260811 08:06:35.498128 32620 raft_consensus.cc:2726] T 9db08a04839748d6a6633e138e179667 P 64adbd65b8404e7180a20b86ad63bca9 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 08:06:35.872619 32401 raft_consensus.cc:1261] T 9db08a04839748d6a6633e138e179667 P 64adbd65b8404e7180a20b86ad63bca9 [term 2 FOLLOWER]: Refusing update from remote peer 929b168c73e648dfa25f494e90a0ed3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260811 08:06:35.873050 32625 consensus_queue.cc:1035] T 9db08a04839748d6a6633e138e179667 P 929b168c73e648dfa25f494e90a0ed3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "64adbd65b8404e7180a20b86ad63bca9" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 40745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 08:06:35.873896 32622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:35.873777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:40173 (local address 127.15.36.194:43931)
0811 08:06:35.873827 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:35.873865 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:40173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260811 08:06:35.875042 32615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:35.874861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:40173 (local address 127.15.36.193:41935)
0811 08:06:35.874907 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:35.874950 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:40173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260811 08:06:35.875200 32177 consensus_peers.cc:487] T 9db08a04839748d6a6633e138e179667 P 929b168c73e648dfa25f494e90a0ed3c -> Peer c472ff7214044afdb58b3e8c9c52a44f (127.15.36.195:43709): Couldn't send request to peer c472ff7214044afdb58b3e8c9c52a44f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9db08a04839748d6a6633e138e179667. This is attempt 1: this message will repeat every 5th retry.
I20260811 08:06:35.875234 32622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:35.875141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:40173 (local address 127.15.36.194:44419)
0811 08:06:35.875177 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:35.875206 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:40173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
I20260811 08:06:36.086063 32630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:36.085782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:40173 (local address 127.15.36.195:58137)
0811 08:06:36.085971 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:36.086017 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:40173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":95,"threads_started":1}
I20260811 08:06:36.322520 32631 ts_tablet_manager.cc:927] T 9db08a04839748d6a6633e138e179667 P c472ff7214044afdb58b3e8c9c52a44f: Initiating tablet copy from peer 929b168c73e648dfa25f494e90a0ed3c (127.15.36.193:35083)
I20260811 08:06:36.322786 32631 tablet_copy_client.cc:316] T 9db08a04839748d6a6633e138e179667 P c472ff7214044afdb58b3e8c9c52a44f: tablet copy: Beginning tablet copy session from remote peer at address 127.15.36.193:35083
Aug 11 08:06:36 dist-test-slave-2w3w krb5kdc[30834](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435594, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.195@KRBTEST.COM for kudu/127.15.36.193@KRBTEST.COM
I20260811 08:06:36.330816 32630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:36.323099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.193:35083 (local address 127.15.36.195:42585)
0811 08:06:36.323163 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:36.323185 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 08:06:36.323257 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:06:36.323474 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:06:36.323481 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:06:36.323804 (+ 323us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:06:36.323884 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:36.323887 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:36.324577 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:36.324579 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:36.325198 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:36.325200 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:36.325600 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:36.325601 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:36.325692 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:36.326240 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:06:36.326244 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:06:36.328055 (+ 1811us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:06:36.329796 (+ 1741us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:06:36.329804 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:06:36.329806 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:06:36.330028 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:06:36.330231 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:06:36.330232 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:06:36.330232 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:06:36.330289 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:06:36.330522 (+ 233us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:06:36.330528 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:06:36.330578 (+ 50us) client_negotiation.cc:769] Sending connection context
0811 08:06:36.330645 (+ 67us) client_negotiation.cc:240] Negotiation successful
0811 08:06:36.330741 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260811 08:06:36.330852 32633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:36.323212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:42585 (local address 127.15.36.193:35083)
0811 08:06:36.323346 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0811 08:06:36.323347 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:06:36.323354 (+ 7us) server_negotiation.cc:407] Connection header received
0811 08:06:36.323377 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:06:36.323377 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:06:36.323387 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:06:36.323469 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:06:36.323991 (+ 522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:36.324490 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:36.325312 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:36.325520 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:36.325601 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:36.328155 (+ 2554us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:06:36.328156 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:06:36.328157 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:06:36.328169 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:06:36.329699 (+ 1530us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:36.330105 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:36.330105 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:36.330105 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:36.330166 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:36.330347 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:36.330348 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:36.330348 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:36.330465 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:06:36.330519 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 08:06:36.330678 (+ 159us) server_negotiation.cc:299] Negotiation successful
0811 08:06:36.330755 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":54,"threads_started":1}
I20260811 08:06:36.331204 32272 tablet_copy_service.cc:140] P 929b168c73e648dfa25f494e90a0ed3c: Received BeginTabletCopySession request for tablet 9db08a04839748d6a6633e138e179667 from peer c472ff7214044afdb58b3e8c9c52a44f ({username='kudu', principal='kudu/127.15.36.195@KRBTEST.COM'} at 127.15.36.195:42585)
I20260811 08:06:36.331287 32272 tablet_copy_service.cc:161] P 929b168c73e648dfa25f494e90a0ed3c: Beginning new tablet copy session on tablet 9db08a04839748d6a6633e138e179667 from peer c472ff7214044afdb58b3e8c9c52a44f at {username='kudu', principal='kudu/127.15.36.195@KRBTEST.COM'} at 127.15.36.195:42585: session id = c472ff7214044afdb58b3e8c9c52a44f-9db08a04839748d6a6633e138e179667
I20260811 08:06:36.331789 32272 tablet_copy_source_session.cc:205] T 9db08a04839748d6a6633e138e179667 P 929b168c73e648dfa25f494e90a0ed3c: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 08:06:36.332871 32631 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9db08a04839748d6a6633e138e179667. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:06:36.335572 32631 tablet_copy_client.cc:791] T 9db08a04839748d6a6633e138e179667 P c472ff7214044afdb58b3e8c9c52a44f: tablet copy: Starting download of 0 data blocks...
I20260811 08:06:36.335744 32631 tablet_copy_client.cc:655] T 9db08a04839748d6a6633e138e179667 P c472ff7214044afdb58b3e8c9c52a44f: tablet copy: Starting download of 1 WAL segments...
I20260811 08:06:36.336681 32631 tablet_copy_client.cc:531] T 9db08a04839748d6a6633e138e179667 P c472ff7214044afdb58b3e8c9c52a44f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 08:06:36.337710 32631 tablet_bootstrap.cc:492] T 9db08a04839748d6a6633e138e179667 P c472ff7214044afdb58b3e8c9c52a44f: Bootstrap starting.
I20260811 08:06:36.339303 32631 log.cc:824] T 9db08a04839748d6a6633e138e179667 P c472ff7214044afdb58b3e8c9c52a44f: Log is configured to *not* fsync() on all Append() calls
I20260811 08:06:36.341737 32631 tablet_bootstrap.cc:492] T 9db08a04839748d6a6633e138e179667 P c472ff7214044afdb58b3e8c9c52a44f: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 08:06:36.341995 32631 tablet_bootstrap.cc:492] T 9db08a04839748d6a6633e138e179667 P c472ff7214044afdb58b3e8c9c52a44f: Bootstrap complete.
I20260811 08:06:36.342170 32631 ts_tablet_manager.cc:1397] T 9db08a04839748d6a6633e138e179667 P c472ff7214044afdb58b3e8c9c52a44f: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260811 08:06:36.343281 32631 raft_consensus.cc:348] T 9db08a04839748d6a6633e138e179667 P c472ff7214044afdb58b3e8c9c52a44f [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c472ff7214044afdb58b3e8c9c52a44f" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 43709 } } peers { permanent_uuid: "64adbd65b8404e7180a20b86ad63bca9" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 40745 } } peers { permanent_uuid: "929b168c73e648dfa25f494e90a0ed3c" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 35083 } }
I20260811 08:06:36.343442 32631 raft_consensus.cc:729] T 9db08a04839748d6a6633e138e179667 P c472ff7214044afdb58b3e8c9c52a44f [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: c472ff7214044afdb58b3e8c9c52a44f, State: Initialized, Role: FOLLOWER
I20260811 08:06:36.343575 32631 consensus_queue.cc:260] T 9db08a04839748d6a6633e138e179667 P c472ff7214044afdb58b3e8c9c52a44f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c472ff7214044afdb58b3e8c9c52a44f" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 43709 } } peers { permanent_uuid: "64adbd65b8404e7180a20b86ad63bca9" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 40745 } } peers { permanent_uuid: "929b168c73e648dfa25f494e90a0ed3c" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 35083 } }
I20260811 08:06:36.343854 32631 ts_tablet_manager.cc:1428] T 9db08a04839748d6a6633e138e179667 P c472ff7214044afdb58b3e8c9c52a44f: Time spent starting tablet: real 0.002s user 0.004s sys 0.000s
I20260811 08:06:36.344337 32630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:36.344206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:40173 (local address 127.15.36.195:39703)
0811 08:06:36.344265 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:36.344300 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:40173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260811 08:06:36.344331 32272 tablet_copy_service.cc:342] P 929b168c73e648dfa25f494e90a0ed3c: Request end of tablet copy session c472ff7214044afdb58b3e8c9c52a44f-9db08a04839748d6a6633e138e179667 received from {username='kudu', principal='kudu/127.15.36.195@KRBTEST.COM'} at 127.15.36.195:42585
I20260811 08:06:36.344390 32272 tablet_copy_service.cc:433] P 929b168c73e648dfa25f494e90a0ed3c: ending tablet copy session c472ff7214044afdb58b3e8c9c52a44f-9db08a04839748d6a6633e138e179667 on tablet 9db08a04839748d6a6633e138e179667 with peer c472ff7214044afdb58b3e8c9c52a44f
I20260811 08:06:36.344709 32630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:36.344586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:40173 (local address 127.15.36.195:45799)
0811 08:06:36.344637 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:36.344671 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:40173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260811 08:06:36.859119 32551 raft_consensus.cc:1203] T 9db08a04839748d6a6633e138e179667 P c472ff7214044afdb58b3e8c9c52a44f [term 2 FOLLOWER]: Deduplicated request from leader. Original: 1.2->[2.3-2.3] Dedup: 2.3->[]
I20260811 08:06:36.859346 32638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:36.859073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:40173 (local address 127.15.36.193:42299)
0811 08:06:36.859246 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:36.859291 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:40173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":60,"threads_started":1}
I20260811 08:06:36.859850 32640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:36.859624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:40173 (local address 127.15.36.195:38251)
0811 08:06:36.859776 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:36.859813 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:40173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":103,"threads_started":1}
I20260811 08:06:36.875969 32641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:36.875656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:40173 (local address 127.15.36.194:41177)
0811 08:06:36.875863 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:36.875913 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:40173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":65,"threads_started":1}
I20260811 08:06:37.860176 32644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:37.859882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:40173 (local address 127.15.36.193:60101)
0811 08:06:37.860076 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:37.860124 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:40173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":75,"threads_started":1}
I20260811 08:06:37.860697 32645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:37.860461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:40173 (local address 127.15.36.195:41267)
0811 08:06:37.860617 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:37.860657 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:40173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":68,"threads_started":1}
I20260811 08:06:37.876891 32647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:37.876638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:40173 (local address 127.15.36.194:51757)
0811 08:06:37.876791 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:37.876840 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:40173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":74,"threads_started":1}
I20260811 08:06:38.861315 32649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:38.860946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:40173 (local address 127.15.36.193:38991)
0811 08:06:38.861194 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:38.861250 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:40173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":74,"threads_started":1}
I20260811 08:06:38.861760 32650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:38.861525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:40173 (local address 127.15.36.195:46793)
0811 08:06:38.861666 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:38.861709 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:40173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":72,"threads_started":1}
I20260811 08:06:38.861908 32649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:38.861728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:40173 (local address 127.15.36.193:41755)
0811 08:06:38.861807 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:38.861873 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:40173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260811 08:06:38.877802 32651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:38.877511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:40173 (local address 127.15.36.194:41785)
0811 08:06:38.877682 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:38.877734 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:40173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":72,"threads_started":1}
I20260811 08:06:39.862738 32653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:39.862490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:40173 (local address 127.15.36.193:46759)
0811 08:06:39.862651 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:39.862696 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:40173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":111,"threads_started":1}
I20260811 08:06:39.862701 32652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:39.862458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:40173 (local address 127.15.36.195:39609)
0811 08:06:39.862613 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:39.862652 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:40173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":88,"threads_started":1}
I20260811 08:06:39.878746 32654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:39.878521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:40173 (local address 127.15.36.194:56577)
0811 08:06:39.878658 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:39.878690 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:40173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":72,"threads_started":1}
I20260811 08:06:40.863616 32655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:40.863361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:40173 (local address 127.15.36.195:48757)
0811 08:06:40.863515 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:40.863570 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:40173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":68,"threads_started":1}
I20260811 08:06:40.863616 32656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:40.863345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:40173 (local address 127.15.36.193:53703)
0811 08:06:40.863523 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:40.863566 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:40173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":110,"threads_started":1}
I20260811 08:06:40.879545 32658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:40.879310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:40173 (local address 127.15.36.194:52385)
0811 08:06:40.879465 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:40.879498 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:40173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":86,"threads_started":1}
I20260811 08:06:41.864418 32659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:41.864142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:40173 (local address 127.15.36.193:52485)
0811 08:06:41.864318 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:41.864370 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:40173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":63,"threads_started":1}
I20260811 08:06:41.864447 32660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:41.864183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:40173 (local address 127.15.36.195:47945)
0811 08:06:41.864358 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:41.864405 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:40173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":108,"threads_started":1}
I20260811 08:06:41.880367 32661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:41.880072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:40173 (local address 127.15.36.194:60817)
0811 08:06:41.880263 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:41.880313 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:40173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":92,"threads_started":1}
I20260811 08:06:42.865219 32663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:42.864957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:40173 (local address 127.15.36.195:58273)
0811 08:06:42.865148 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:42.865176 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:40173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":114,"threads_started":1}
I20260811 08:06:42.865221 32662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:42.864959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:40173 (local address 127.15.36.193:53207)
0811 08:06:42.865124 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:42.865171 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:40173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":111,"threads_started":1}
I20260811 08:06:42.881244 32664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:42.880964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:40173 (local address 127.15.36.194:33289)
0811 08:06:42.881134 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:42.881187 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:40173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":83,"threads_started":1}
I20260811 08:06:43.866134 32665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:43.865862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:40173 (local address 127.15.36.193:36229)
0811 08:06:43.866050 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:43.866086 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:40173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":82,"threads_started":1}
I20260811 08:06:43.866194 32666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:43.865879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:40173 (local address 127.15.36.195:48345)
0811 08:06:43.866108 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:43.866149 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:40173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":69,"threads_started":1}
I20260811 08:06:43.882192 32667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:43.881907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:40173 (local address 127.15.36.194:39161)
0811 08:06:43.882093 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:43.882142 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:40173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":116,"threads_started":1}
I20260811 08:06:44.867167 32668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:44.866837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:40173 (local address 127.15.36.193:55471)
0811 08:06:44.867024 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:44.867079 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:40173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":71,"threads_started":1}
I20260811 08:06:44.867304 32669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:44.866943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:40173 (local address 127.15.36.195:54583)
0811 08:06:44.867168 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:44.867215 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:40173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":124,"threads_started":1}
I20260811 08:06:44.883322 32670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:44.882919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:40173 (local address 127.15.36.194:56873)
0811 08:06:44.883214 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:44.883267 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:40173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":223,"threads_started":1}
I20260811 08:06:45.868170 32672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:45.867891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:40173 (local address 127.15.36.193:41489)
0811 08:06:45.868072 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:45.868121 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:40173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":95,"threads_started":1}
I20260811 08:06:45.868203 32673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:45.867967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:40173 (local address 127.15.36.195:39789)
0811 08:06:45.868125 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:45.868160 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:40173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":81,"threads_started":1}
I20260811 08:06:45.884198 32674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:45.883874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:40173 (local address 127.15.36.194:35659)
0811 08:06:45.884103 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:45.884149 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:40173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":73,"threads_started":1}
I20260811 08:06:46.869024 32675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:46.868708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:40173 (local address 127.15.36.193:33805)
0811 08:06:46.868935 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:46.868975 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:40173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":138,"threads_started":1}
I20260811 08:06:46.869068 32676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:46.868774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:40173 (local address 127.15.36.195:50769)
0811 08:06:46.868942 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:46.869012 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:40173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":102,"threads_started":1}
I20260811 08:06:46.885063 32677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:46.884821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:40173 (local address 127.15.36.194:60201)
0811 08:06:46.884965 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:46.885006 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:40173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":63,"threads_started":1}
I20260811 08:06:47.869948 32678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:47.869677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:40173 (local address 127.15.36.193:58741)
0811 08:06:47.869859 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:47.869897 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:40173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":85,"threads_started":1}
I20260811 08:06:47.869951 32679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:47.869677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:40173 (local address 127.15.36.195:34965)
0811 08:06:47.869842 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:47.869903 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:40173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":81,"threads_started":1}
I20260811 08:06:47.885885 32680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:47.885630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:40173 (local address 127.15.36.194:40471)
0811 08:06:47.885796 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:47.885838 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:40173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":73,"threads_started":1}
I20260811 08:06:48.870764 32682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:48.870526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:40173 (local address 127.15.36.195:43967)
0811 08:06:48.870676 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:48.870714 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:40173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":86,"threads_started":1}
I20260811 08:06:48.870782 32683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:48.870550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:40173 (local address 127.15.36.193:55681)
0811 08:06:48.870698 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:48.870742 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:40173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":96,"threads_started":1}
I20260811 08:06:48.886704 32685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:48.886464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:40173 (local address 127.15.36.194:46863)
0811 08:06:48.886613 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:48.886657 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:40173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":72,"threads_started":1}
I20260811 08:06:49.086771 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 32122
I20260811 08:06:49.096798 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 32306
I20260811 08:06:49.103500 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 32456
2026-08-11T08:06:49Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (18914 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:06:49 dist-test-slave-2w3w krb5kdc[32689](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:06:49 dist-test-slave-2w3w krb5kdc[32689](info): set up 2 sockets
Aug 11 08:06:49 dist-test-slave-2w3w krb5kdc[32689](info): commencing operation
krb5kdc: starting...
W20260811 08:06:50.220229 15507 mini_kdc.cc:121] Time spent starting KDC: real 1.093s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Aug 11 08:06:50 dist-test-slave-2w3w krb5kdc[32689](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435610, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:06:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:06:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.36.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab.
Entry for principal kudu/127.15.36.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab.
I20260811 08:06:50.363153 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:32993
--webserver_interface=127.15.36.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=kudu/127.15.36.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:46213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.36.254:32993
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:06:50.450582 32705 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:06:50.450834 32705 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:06:50.450860 32705 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:06:50.452139 32705 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 08:06:50.452194 32705 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 08:06:50.452208 32705 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 08:06:50.452220 32705 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:06:50.452234 32705 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:06:50.452248 32705 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:06:50.452260 32705 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:06:50.452272 32705 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:06:50.453828 32705 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:46213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.15.36.254:32993
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=kudu/127.15.36.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:32993
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.36.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32705
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:06:50.454052 32705 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:06:50.454239 32705 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:06:50.459834 32711 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:06:50.459854 32714 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:06:50.459997 32705 server_base.cc:1034] running on GCE node
W20260811 08:06:50.459853 32710 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:06:50.460469 32705 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:06:50.460846 32705 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:06:50.462062 32705 hybrid_clock.cc:648] HybridClock initialized: now 1786435610462042 us; error 48 us; skew 500 ppm
Aug 11 08:06:50 dist-test-slave-2w3w krb5kdc[32689](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435610, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:06:50.464892 32705 init.cc:377] Logged in from keytab as kudu/127.15.36.254@KRBTEST.COM (short username kudu)
I20260811 08:06:50.465456 32705 webserver.cc:460] Webserver started at http://127.15.36.254:37861/ using document root <none> and password file <none>
I20260811 08:06:50.465698 32705 fs_manager.cc:359] Metadata directory not provided
I20260811 08:06:50.465770 32705 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:06:50.465925 32705 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:06:50.467129 32705 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/master-0/data/instance:
uuid: "59497f3eef3b44289d9cb975538fd725"
format_stamp: "Formatted at 2026-08-11 08:06:50 on dist-test-slave-2w3w"
server_key: "8cdcd2e73eace78475125e5bd94e0082"
server_key_iv: "48aee35c36bf873ec1dd367e3b738377"
server_key_version: "encryptionkey@0"
I20260811 08:06:50.467521 32705 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/master-0/wal/instance:
uuid: "59497f3eef3b44289d9cb975538fd725"
format_stamp: "Formatted at 2026-08-11 08:06:50 on dist-test-slave-2w3w"
server_key: "8cdcd2e73eace78475125e5bd94e0082"
server_key_iv: "48aee35c36bf873ec1dd367e3b738377"
server_key_version: "encryptionkey@0"
I20260811 08:06:50.468983 32705 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 08:06:50.469825 32722 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:06:50.470084 32705 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:06:50.470204 32705 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/master-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/master-0/wal
uuid: "59497f3eef3b44289d9cb975538fd725"
format_stamp: "Formatted at 2026-08-11 08:06:50 on dist-test-slave-2w3w"
server_key: "8cdcd2e73eace78475125e5bd94e0082"
server_key_iv: "48aee35c36bf873ec1dd367e3b738377"
server_key_version: "encryptionkey@0"
I20260811 08:06:50.470284 32705 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:06:50.479053 32705 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:06:50.481571 32705 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:06:50.481763 32705 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:06:50.486250 32705 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.254:32993
I20260811 08:06:50.486287 312 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.254:32993 every 8 connection(s)
I20260811 08:06:50.486706 32705 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
I20260811 08:06:50.487756 313 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:06:50.489101 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 32705
I20260811 08:06:50.489257 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/master-0/wal/instance
I20260811 08:06:50.489455 15507 external_mini_cluster.cc:1428] Setting key a6f6f8cd1486cdae5f387471f3642aa8
I20260811 08:06:50.490455 313 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 59497f3eef3b44289d9cb975538fd725: Bootstrap starting.
I20260811 08:06:50.491219 313 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 59497f3eef3b44289d9cb975538fd725: Neither blocks nor log segments found. Creating new log.
I20260811 08:06:50.491580 313 log.cc:824] T 00000000000000000000000000000000 P 59497f3eef3b44289d9cb975538fd725: Log is configured to *not* fsync() on all Append() calls
I20260811 08:06:50.492451 313 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 59497f3eef3b44289d9cb975538fd725: No bootstrap required, opened a new log
I20260811 08:06:50.494815 313 raft_consensus.cc:348] T 00000000000000000000000000000000 P 59497f3eef3b44289d9cb975538fd725 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59497f3eef3b44289d9cb975538fd725" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 32993 } }
I20260811 08:06:50.495059 313 raft_consensus.cc:374] T 00000000000000000000000000000000 P 59497f3eef3b44289d9cb975538fd725 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:06:50.495106 313 raft_consensus.cc:729] T 00000000000000000000000000000000 P 59497f3eef3b44289d9cb975538fd725 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59497f3eef3b44289d9cb975538fd725, State: Initialized, Role: FOLLOWER
I20260811 08:06:50.495285 313 consensus_queue.cc:260] T 00000000000000000000000000000000 P 59497f3eef3b44289d9cb975538fd725 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59497f3eef3b44289d9cb975538fd725" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 32993 } }
I20260811 08:06:50.495378 313 raft_consensus.cc:388] T 00000000000000000000000000000000 P 59497f3eef3b44289d9cb975538fd725 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:06:50.495414 313 raft_consensus.cc:482] T 00000000000000000000000000000000 P 59497f3eef3b44289d9cb975538fd725 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:06:50.495471 313 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 59497f3eef3b44289d9cb975538fd725 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:06:50.496369 313 raft_consensus.cc:504] T 00000000000000000000000000000000 P 59497f3eef3b44289d9cb975538fd725 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59497f3eef3b44289d9cb975538fd725" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 32993 } }
I20260811 08:06:50.496500 313 leader_election.cc:302] T 00000000000000000000000000000000 P 59497f3eef3b44289d9cb975538fd725 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 59497f3eef3b44289d9cb975538fd725; no voters:
I20260811 08:06:50.496723 313 leader_election.cc:288] T 00000000000000000000000000000000 P 59497f3eef3b44289d9cb975538fd725 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:06:50.496797 318 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 59497f3eef3b44289d9cb975538fd725 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:06:50.497006 318 raft_consensus.cc:686] T 00000000000000000000000000000000 P 59497f3eef3b44289d9cb975538fd725 [term 1 LEADER]: Becoming Leader. State: Replica: 59497f3eef3b44289d9cb975538fd725, State: Running, Role: LEADER
I20260811 08:06:50.497059 313 sys_catalog.cc:564] T 00000000000000000000000000000000 P 59497f3eef3b44289d9cb975538fd725 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:06:50.497131 318 consensus_queue.cc:237] T 00000000000000000000000000000000 P 59497f3eef3b44289d9cb975538fd725 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59497f3eef3b44289d9cb975538fd725" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 32993 } }
Aug 11 08:06:50 dist-test-slave-2w3w krb5kdc[32689](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435610, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:06:50.497546 318 sys_catalog.cc:455] T 00000000000000000000000000000000 P 59497f3eef3b44289d9cb975538fd725 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "59497f3eef3b44289d9cb975538fd725" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59497f3eef3b44289d9cb975538fd725" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 32993 } } }
I20260811 08:06:50.497630 318 sys_catalog.cc:458] T 00000000000000000000000000000000 P 59497f3eef3b44289d9cb975538fd725 [sys.catalog]: This master's current role is: LEADER
I20260811 08:06:50.497776 318 sys_catalog.cc:455] T 00000000000000000000000000000000 P 59497f3eef3b44289d9cb975538fd725 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 59497f3eef3b44289d9cb975538fd725. Latest consensus state: current_term: 1 leader_uuid: "59497f3eef3b44289d9cb975538fd725" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59497f3eef3b44289d9cb975538fd725" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 32993 } } }
I20260811 08:06:50.497840 318 sys_catalog.cc:458] T 00000000000000000000000000000000 P 59497f3eef3b44289d9cb975538fd725 [sys.catalog]: This master's current role is: LEADER
I20260811 08:06:50.498293 327 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:06:50.498862 327 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:06:50.502007 327 catalog_manager.cc:1347] Generated new cluster ID: 921fa01da16f4ebea41371c62cf5c12a
I20260811 08:06:50.502084 327 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:06:50.503710 316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:50.490083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44878 (local address 127.15.36.254:32993)
0811 08:06:50.490269 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0811 08:06:50.490278 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 08:06:50.490306 (+ 28us) server_negotiation.cc:407] Connection header received
0811 08:06:50.490776 (+ 470us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:06:50.490783 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:06:50.490833 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:06:50.491014 (+ 181us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:06:50.491918 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:50.493108 (+ 1190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:50.494229 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:50.494689 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:50.494799 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:50.498469 (+ 3670us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:06:50.498473 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:06:50.498474 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:06:50.498488 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:06:50.501734 (+ 3246us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:50.502312 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:50.502316 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:50.502316 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:50.502402 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:50.502651 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:50.502652 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:50.502652 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:50.502945 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:06:50.503145 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0811 08:06:50.503319 (+ 174us) server_negotiation.cc:299] Negotiation successful
0811 08:06:50.503474 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":85,"threads_started":1}
I20260811 08:06:50.519500 327 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:06:50.520224 327 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:06:50.524096 327 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 59497f3eef3b44289d9cb975538fd725: Generated new TSK 0
I20260811 08:06:50.524323 327 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.36.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab.
Entry for principal kudu/127.15.36.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab.
I20260811 08:06:50.563309 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.193:0
--local_ip_for_outbound_sockets=127.15.36.193
--webserver_interface=127.15.36.193
--webserver_port=0
--tserver_master_addrs=127.15.36.254:32993
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab
--principal=kudu/127.15.36.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:46213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:06:50.649760 343 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:06:50.649995 343 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:06:50.650022 343 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:06:50.651250 343 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:06:50.651300 343 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:06:50.651329 343 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.193
I20260811 08:06:50.652838 343 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:46213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab
--principal=kudu/127.15.36.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.36.193
--webserver_port=0
--tserver_master_addrs=127.15.36.254:32993
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.343
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.193
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:06:50.653059 343 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:06:50.653254 343 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:06:50.658892 353 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:06:50.659152 343 server_base.cc:1034] running on GCE node
W20260811 08:06:50.658952 351 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:06:50.658924 350 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:06:50.659519 343 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:06:50.659797 343 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:06:50.660980 343 hybrid_clock.cc:648] HybridClock initialized: now 1786435610660918 us; error 75 us; skew 500 ppm
Aug 11 08:06:50 dist-test-slave-2w3w krb5kdc[32689](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435610, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:06:50.663916 343 init.cc:377] Logged in from keytab as kudu/127.15.36.193@KRBTEST.COM (short username kudu)
I20260811 08:06:50.664407 343 webserver.cc:460] Webserver started at http://127.15.36.193:42621/ using document root <none> and password file <none>
I20260811 08:06:50.664680 343 fs_manager.cc:359] Metadata directory not provided
I20260811 08:06:50.664729 343 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:06:50.664906 343 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:06:50.666011 343 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-0/data/instance:
uuid: "4ad5179f7e1c41db9ba15fedad5fe751"
format_stamp: "Formatted at 2026-08-11 08:06:50 on dist-test-slave-2w3w"
server_key: "8e1b2d781d07ae713de3f7d64fc22e4c"
server_key_iv: "7fd4fa3ee73e6959ad25572f8c9a8635"
server_key_version: "encryptionkey@0"
I20260811 08:06:50.666396 343 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-0/wal/instance:
uuid: "4ad5179f7e1c41db9ba15fedad5fe751"
format_stamp: "Formatted at 2026-08-11 08:06:50 on dist-test-slave-2w3w"
server_key: "8e1b2d781d07ae713de3f7d64fc22e4c"
server_key_iv: "7fd4fa3ee73e6959ad25572f8c9a8635"
server_key_version: "encryptionkey@0"
I20260811 08:06:50.667902 343 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 08:06:50.668814 362 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:06:50.669126 343 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:06:50.669235 343 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-0/wal
uuid: "4ad5179f7e1c41db9ba15fedad5fe751"
format_stamp: "Formatted at 2026-08-11 08:06:50 on dist-test-slave-2w3w"
server_key: "8e1b2d781d07ae713de3f7d64fc22e4c"
server_key_iv: "7fd4fa3ee73e6959ad25572f8c9a8635"
server_key_version: "encryptionkey@0"
I20260811 08:06:50.669328 343 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:06:50.681321 343 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:06:50.683952 343 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:06:50.684149 343 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:06:50.684417 343 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:06:50.684767 343 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:06:50.684825 343 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:06:50.684870 343 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:06:50.684894 343 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:06:50.691241 343 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.193:46047
I20260811 08:06:50.691298 493 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.193:46047 every 8 connection(s)
I20260811 08:06:50.691648 343 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
Aug 11 08:06:50 dist-test-slave-2w3w krb5kdc[32689](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435610, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.193@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:06:50.699689 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 343
I20260811 08:06:50.699827 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-0/wal/instance
I20260811 08:06:50.700052 15507 external_mini_cluster.cc:1428] Setting key a4310752372d845b17c9ddfc65e80466
I20260811 08:06:50.701903 316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:50.692507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:44375 (local address 127.15.36.254:32993)
0811 08:06:50.692587 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0811 08:06:50.692589 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:06:50.692746 (+ 157us) server_negotiation.cc:407] Connection header received
0811 08:06:50.693223 (+ 477us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:06:50.693224 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:06:50.693237 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:06:50.693294 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:06:50.694279 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:50.694925 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:50.695987 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:50.696219 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:50.696282 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:50.698714 (+ 2432us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:06:50.698715 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:06:50.698715 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:06:50.698724 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:06:50.700324 (+ 1600us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:50.700807 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:50.700809 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:50.700809 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:50.700875 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:50.701156 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:50.701157 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:50.701158 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:50.701283 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:06:50.701380 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0811 08:06:50.701698 (+ 318us) server_negotiation.cc:299] Negotiation successful
0811 08:06:50.701806 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 08:06:50.702145 497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:50.692445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32993 (local address 127.15.36.193:44375)
0811 08:06:50.692611 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:50.692653 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 08:06:50.693129 (+ 476us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:06:50.693349 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:06:50.693353 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:06:50.693951 (+ 598us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:06:50.694160 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:50.694165 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:50.695090 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:50.695095 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:50.695897 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:50.695899 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:50.696311 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:50.696312 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:50.696458 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:50.697067 (+ 609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:06:50.697076 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:06:50.698619 (+ 1543us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:06:50.700428 (+ 1809us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:06:50.700439 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:06:50.700442 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:06:50.700703 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:06:50.700955 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:06:50.700956 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:06:50.700956 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:06:50.701085 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:06:50.701373 (+ 288us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:06:50.701381 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:06:50.701544 (+ 163us) client_negotiation.cc:769] Sending connection context
0811 08:06:50.701666 (+ 122us) client_negotiation.cc:240] Negotiation successful
0811 08:06:50.701862 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":100,"threads_started":1}
I20260811 08:06:50.702698 494 heartbeater.cc:347] Connected to a master server at 127.15.36.254:32993
I20260811 08:06:50.702841 494 heartbeater.cc:464] Registering TS with master...
I20260811 08:06:50.703083 494 heartbeater.cc:511] Master 127.15.36.254:32993 requested a full tablet report, sending...
I20260811 08:06:50.703717 32742 ts_manager.cc:194] Registered new tserver with Master: 4ad5179f7e1c41db9ba15fedad5fe751 (127.15.36.193:46047)
I20260811 08:06:50.704425 32742 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.36.193@KRBTEST.COM'} at 127.15.36.193:44375
WARNING: no policy specified for kudu/127.15.36.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab.
Entry for principal kudu/127.15.36.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab.
I20260811 08:06:50.734501 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.194:0
--local_ip_for_outbound_sockets=127.15.36.194
--webserver_interface=127.15.36.194
--webserver_port=0
--tserver_master_addrs=127.15.36.254:32993
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab
--principal=kudu/127.15.36.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:46213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:06:50.825945 500 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:06:50.826186 500 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:06:50.826215 500 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:06:50.827492 500 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:06:50.827543 500 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:06:50.827572 500 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.194
I20260811 08:06:50.829103 500 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:46213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab
--principal=kudu/127.15.36.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.36.194
--webserver_port=0
--tserver_master_addrs=127.15.36.254:32993
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.500
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.194
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:06:50.829321 500 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:06:50.829523 500 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:06:50.835489 507 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:06:50.835493 509 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:06:50.835582 500 server_base.cc:1034] running on GCE node
W20260811 08:06:50.835489 506 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:06:50.835994 500 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:06:50.836289 500 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:06:50.837466 500 hybrid_clock.cc:648] HybridClock initialized: now 1786435610837453 us; error 69 us; skew 500 ppm
Aug 11 08:06:50 dist-test-slave-2w3w krb5kdc[32689](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435610, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:06:50.840411 500 init.cc:377] Logged in from keytab as kudu/127.15.36.194@KRBTEST.COM (short username kudu)
I20260811 08:06:50.840991 500 webserver.cc:460] Webserver started at http://127.15.36.194:45485/ using document root <none> and password file <none>
I20260811 08:06:50.841248 500 fs_manager.cc:359] Metadata directory not provided
I20260811 08:06:50.841318 500 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:06:50.841480 500 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:06:50.842640 500 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-1/data/instance:
uuid: "de35f40802f14e4db0b11cf6d0ddb42c"
format_stamp: "Formatted at 2026-08-11 08:06:50 on dist-test-slave-2w3w"
server_key: "3a2414ce379f80403270a1eb8f02f41a"
server_key_iv: "98f3ae556d7c9b8e6601fb9d88ccd9d8"
server_key_version: "encryptionkey@0"
I20260811 08:06:50.843103 500 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-1/wal/instance:
uuid: "de35f40802f14e4db0b11cf6d0ddb42c"
format_stamp: "Formatted at 2026-08-11 08:06:50 on dist-test-slave-2w3w"
server_key: "3a2414ce379f80403270a1eb8f02f41a"
server_key_iv: "98f3ae556d7c9b8e6601fb9d88ccd9d8"
server_key_version: "encryptionkey@0"
I20260811 08:06:50.844578 500 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:06:50.845588 517 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:06:50.845860 500 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:06:50.845978 500 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-1/wal
uuid: "de35f40802f14e4db0b11cf6d0ddb42c"
format_stamp: "Formatted at 2026-08-11 08:06:50 on dist-test-slave-2w3w"
server_key: "3a2414ce379f80403270a1eb8f02f41a"
server_key_iv: "98f3ae556d7c9b8e6601fb9d88ccd9d8"
server_key_version: "encryptionkey@0"
I20260811 08:06:50.846076 500 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:06:50.857550 500 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:06:50.860054 500 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:06:50.860241 500 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:06:50.860519 500 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:06:50.860873 500 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:06:50.860932 500 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:06:50.861006 500 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:06:50.861037 500 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:06:50.867802 500 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.194:41375
I20260811 08:06:50.867851 646 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.194:41375 every 8 connection(s)
I20260811 08:06:50.868216 500 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
I20260811 08:06:50.871094 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 500
I20260811 08:06:50.871217 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-1/wal/instance
I20260811 08:06:50.871461 15507 external_mini_cluster.cc:1428] Setting key 100e3ee41db5aa6a185a8bc1a528de30
Aug 11 08:06:50 dist-test-slave-2w3w krb5kdc[32689](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435610, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.194@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:06:50.879869 316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:50.869029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:57609 (local address 127.15.36.254:32993)
0811 08:06:50.869112 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0811 08:06:50.869114 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:06:50.869239 (+ 125us) server_negotiation.cc:407] Connection header received
0811 08:06:50.869721 (+ 482us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:06:50.869722 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:06:50.869733 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:06:50.869792 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:06:50.870864 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:50.871669 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:50.873165 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:50.873485 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:50.873549 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:50.876264 (+ 2715us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:06:50.876266 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:06:50.876267 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:06:50.876277 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:06:50.878187 (+ 1910us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:50.878663 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:50.878664 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:50.878665 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:50.878739 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:50.879059 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:50.879061 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:50.879061 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:50.879240 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:06:50.879320 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 08:06:50.879639 (+ 319us) server_negotiation.cc:299] Negotiation successful
0811 08:06:50.879744 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 08:06:50.880008 651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:50.868954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32993 (local address 127.15.36.194:57609)
0811 08:06:50.869115 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:50.869154 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 08:06:50.869633 (+ 479us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:06:50.869846 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:06:50.869849 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:06:50.870461 (+ 612us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:06:50.870675 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:50.870680 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:50.871807 (+ 1127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:50.871808 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:50.873028 (+ 1220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:50.873032 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:50.873585 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:50.873586 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:50.873743 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:50.874491 (+ 748us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:06:50.874500 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:06:50.876139 (+ 1639us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:06:50.878310 (+ 2171us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:06:50.878319 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:06:50.878321 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:06:50.878574 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:06:50.878818 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:06:50.878818 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:06:50.878818 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:06:50.878929 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:06:50.879334 (+ 405us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:06:50.879343 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:06:50.879488 (+ 145us) client_negotiation.cc:769] Sending connection context
0811 08:06:50.879589 (+ 101us) client_negotiation.cc:240] Negotiation successful
0811 08:06:50.879735 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":101,"threads_started":1}
I20260811 08:06:50.880640 647 heartbeater.cc:347] Connected to a master server at 127.15.36.254:32993
I20260811 08:06:50.880772 647 heartbeater.cc:464] Registering TS with master...
I20260811 08:06:50.881017 647 heartbeater.cc:511] Master 127.15.36.254:32993 requested a full tablet report, sending...
I20260811 08:06:50.881482 32742 ts_manager.cc:194] Registered new tserver with Master: de35f40802f14e4db0b11cf6d0ddb42c (127.15.36.194:41375)
WARNING: no policy specified for kudu/127.15.36.195@KRBTEST.COM; defaulting to no policy
I20260811 08:06:50.882031 32742 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.36.194@KRBTEST.COM'} at 127.15.36.194:57609
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab.
Entry for principal kudu/127.15.36.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab.
I20260811 08:06:50.903457 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.195:0
--local_ip_for_outbound_sockets=127.15.36.195
--webserver_interface=127.15.36.195
--webserver_port=0
--tserver_master_addrs=127.15.36.254:32993
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab
--principal=kudu/127.15.36.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:46213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:06:50.990195 656 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:06:50.990443 656 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:06:50.990470 656 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:06:50.991775 656 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:06:50.991827 656 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:06:50.991856 656 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.195
I20260811 08:06:50.993373 656 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:46213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab
--principal=kudu/127.15.36.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.36.195
--webserver_port=0
--tserver_master_addrs=127.15.36.254:32993
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.656
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.195
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:06:50.993592 656 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:06:50.993805 656 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:06:50.999300 662 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:06:50.999316 665 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:06:50.999306 661 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:06:50.999693 656 server_base.cc:1034] running on GCE node
I20260811 08:06:50.999943 656 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:06:51.000222 656 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:06:51.001420 656 hybrid_clock.cc:648] HybridClock initialized: now 1786435611001413 us; error 38 us; skew 500 ppm
Aug 11 08:06:51 dist-test-slave-2w3w krb5kdc[32689](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435611, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:06:51.004496 656 init.cc:377] Logged in from keytab as kudu/127.15.36.195@KRBTEST.COM (short username kudu)
I20260811 08:06:51.005191 656 webserver.cc:460] Webserver started at http://127.15.36.195:38945/ using document root <none> and password file <none>
I20260811 08:06:51.005466 656 fs_manager.cc:359] Metadata directory not provided
I20260811 08:06:51.005545 656 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:06:51.005705 656 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:06:51.006889 656 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-2/data/instance:
uuid: "528d113641084072814e1638bbcc07bb"
format_stamp: "Formatted at 2026-08-11 08:06:51 on dist-test-slave-2w3w"
server_key: "48efad997a8bc24d4401c870d6d3bdcd"
server_key_iv: "611d2d98decc2dddda41bcbd68d52a7c"
server_key_version: "encryptionkey@0"
I20260811 08:06:51.007530 656 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-2/wal/instance:
uuid: "528d113641084072814e1638bbcc07bb"
format_stamp: "Formatted at 2026-08-11 08:06:51 on dist-test-slave-2w3w"
server_key: "48efad997a8bc24d4401c870d6d3bdcd"
server_key_iv: "611d2d98decc2dddda41bcbd68d52a7c"
server_key_version: "encryptionkey@0"
I20260811 08:06:51.009065 656 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 08:06:51.009948 672 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:06:51.010232 656 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:06:51.010360 656 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-2/wal
uuid: "528d113641084072814e1638bbcc07bb"
format_stamp: "Formatted at 2026-08-11 08:06:51 on dist-test-slave-2w3w"
server_key: "48efad997a8bc24d4401c870d6d3bdcd"
server_key_iv: "611d2d98decc2dddda41bcbd68d52a7c"
server_key_version: "encryptionkey@0"
I20260811 08:06:51.010470 656 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:06:51.021986 656 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:06:51.024742 656 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:06:51.024931 656 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:06:51.025249 656 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:06:51.025621 656 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:06:51.025682 656 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:06:51.025728 656 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:06:51.025760 656 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:06:51.032305 656 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.195:40471
I20260811 08:06:51.032404 805 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.195:40471 every 8 connection(s)
I20260811 08:06:51.032755 656 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
I20260811 08:06:51.039597 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 656
I20260811 08:06:51.039721 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-2/wal/instance
I20260811 08:06:51.039950 15507 external_mini_cluster.cc:1428] Setting key 62c587b350a1e8676e2be25afcf997e7
Aug 11 08:06:51 dist-test-slave-2w3w krb5kdc[32689](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435611, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.195@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:06:51.045235 316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:51.033608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:60057 (local address 127.15.36.254:32993)
0811 08:06:51.033679 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 08:06:51.033681 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:06:51.033992 (+ 311us) server_negotiation.cc:407] Connection header received
0811 08:06:51.034561 (+ 569us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:06:51.034562 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:06:51.034595 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:06:51.034680 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:06:51.036200 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:51.036813 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:51.038697 (+ 1884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:51.038947 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:51.039109 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:51.041820 (+ 2711us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:06:51.041821 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:06:51.041821 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:06:51.041829 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:06:51.043460 (+ 1631us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:51.043984 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:51.043985 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:51.043985 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:51.044039 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:51.044313 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:51.044313 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:51.044314 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:51.044484 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:06:51.044540 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 08:06:51.044986 (+ 446us) server_negotiation.cc:299] Negotiation successful
0811 08:06:51.045101 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 08:06:51.045430 808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:51.033573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32993 (local address 127.15.36.195:60057)
0811 08:06:51.033773 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:51.033818 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 08:06:51.034413 (+ 595us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:06:51.034774 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:06:51.034780 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:06:51.035729 (+ 949us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:06:51.036088 (+ 359us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:51.036094 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:51.037153 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:51.037154 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:51.038548 (+ 1394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:51.038551 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:51.039132 (+ 581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:51.039133 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:51.039258 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:51.039990 (+ 732us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:06:51.040003 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:06:51.041722 (+ 1719us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:06:51.043551 (+ 1829us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:06:51.043560 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:06:51.043561 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:06:51.043874 (+ 313us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:06:51.044118 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:06:51.044119 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:06:51.044120 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:06:51.044242 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:06:51.044558 (+ 316us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:06:51.044567 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:06:51.044769 (+ 202us) client_negotiation.cc:769] Sending connection context
0811 08:06:51.044914 (+ 145us) client_negotiation.cc:240] Negotiation successful
0811 08:06:51.045127 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":120,"threads_started":1}
I20260811 08:06:51.047492 806 heartbeater.cc:347] Connected to a master server at 127.15.36.254:32993
I20260811 08:06:51.047647 806 heartbeater.cc:464] Registering TS with master...
I20260811 08:06:51.047909 806 heartbeater.cc:511] Master 127.15.36.254:32993 requested a full tablet report, sending...
I20260811 08:06:51.048426 32742 ts_manager.cc:194] Registered new tserver with Master: 528d113641084072814e1638bbcc07bb (127.15.36.195:40471)
I20260811 08:06:51.048978 32742 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.36.195@KRBTEST.COM'} at 127.15.36.195:60057
I20260811 08:06:51.051999 15507 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 08:06:51.059664 316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:51.053423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44890 (local address 127.15.36.254:32993)
0811 08:06:51.053470 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 08:06:51.053473 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:06:51.053555 (+ 82us) server_negotiation.cc:407] Connection header received
0811 08:06:51.053623 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:06:51.053623 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:06:51.053632 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:06:51.053672 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:06:51.054209 (+ 537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:51.054748 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:51.055627 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:51.055815 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:51.055879 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:51.057185 (+ 1306us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:06:51.057187 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:06:51.057187 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:06:51.057194 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:06:51.058419 (+ 1225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:51.058803 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:51.058805 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:51.058805 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:51.058880 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:06:51.059126 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:06:51.059127 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:06:51.059127 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:06:51.059302 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:06:51.059386 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 08:06:51.059487 (+ 101us) server_negotiation.cc:299] Negotiation successful
0811 08:06:51.059562 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 08:06:51.061426 32742 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44890:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:06:51.063808 32742 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:06:51.070686 821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:51.066455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51016 (local address 127.15.36.193:46047)
0811 08:06:51.066776 (+ 321us) server_negotiation.cc:206] Beginning negotiation
0811 08:06:51.066782 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 08:06:51.066793 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:06:51.066841 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:06:51.066843 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:06:51.066860 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:06:51.066981 (+ 121us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:06:51.067199 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:51.068171 (+ 972us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:51.069526 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:51.070262 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:51.070351 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:51.070415 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 08:06:51.070547 (+ 132us) server_negotiation.cc:299] Negotiation successful
0811 08:06:51.070588 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":285,"thread_start_us":93,"threads_started":1}
I20260811 08:06:51.070669 819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:51.066327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.193:46047 (local address 127.0.0.1:51016)
0811 08:06:51.066585 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:51.066645 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0811 08:06:51.066717 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:06:51.067024 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:06:51.067028 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:06:51.067030 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:06:51.067125 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:51.067127 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:51.068275 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:51.068276 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:51.069434 (+ 1158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:51.069437 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:51.070350 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:51.070350 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:51.070435 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:51.070448 (+ 13us) client_negotiation.cc:769] Sending connection context
0811 08:06:51.070524 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 08:06:51.070584 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":217,"mutex_wait_us":11,"thread_start_us":75,"threads_started":1}
I20260811 08:06:51.071085 822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:51.066560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.194:41375 (local address 127.0.0.1:37912)
0811 08:06:51.066776 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:51.066786 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:06:51.066826 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:06:51.067299 (+ 473us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:06:51.067300 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:06:51.067302 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:06:51.067349 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:51.067351 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:51.068742 (+ 1391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:51.068743 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:51.069748 (+ 1005us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:51.069750 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:51.070811 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:51.070812 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:51.070886 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:51.070890 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:06:51.070942 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 08:06:51.071019 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":73,"threads_started":1}
I20260811 08:06:51.071333 824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:51.066751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37912 (local address 127.15.36.194:41375)
0811 08:06:51.067115 (+ 364us) server_negotiation.cc:206] Beginning negotiation
0811 08:06:51.067119 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:06:51.067129 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:06:51.067191 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:06:51.067192 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:06:51.067207 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:06:51.067278 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:06:51.067437 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:51.068626 (+ 1189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:51.069837 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:51.070459 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:51.070536 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:51.070584 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 08:06:51.071191 (+ 607us) server_negotiation.cc:299] Negotiation successful
0811 08:06:51.071248 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":332,"thread_start_us":96,"threads_started":1}
I20260811 08:06:51.071621 416 tablet_service.cc:1467] Processing CreateTablet for tablet a119422256094016859080e3801ef273 (DEFAULT_TABLE table=test-table [id=e21e8887a35b4b3789233d59c618b15e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:06:51.072057 416 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a119422256094016859080e3801ef273. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:06:51.072068 570 tablet_service.cc:1467] Processing CreateTablet for tablet a119422256094016859080e3801ef273 (DEFAULT_TABLE table=test-table [id=e21e8887a35b4b3789233d59c618b15e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:06:51.072386 570 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a119422256094016859080e3801ef273. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:06:51.075117 818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:51.066400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.195:40471 (local address 127.0.0.1:58334)
0811 08:06:51.066912 (+ 512us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:51.066924 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:06:51.066995 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:06:51.067600 (+ 605us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:06:51.067601 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:06:51.067603 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:06:51.067641 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:51.067643 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:51.068868 (+ 1225us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:51.068869 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:51.070028 (+ 1159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:51.070031 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:51.070956 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:51.070957 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:51.071046 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:51.071050 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:06:51.071079 (+ 29us) client_negotiation.cc:240] Negotiation successful
0811 08:06:51.075061 (+ 3982us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":108,"threads_started":1}
I20260811 08:06:51.075596 823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:51.066582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58334 (local address 127.15.36.195:40471)
0811 08:06:51.067429 (+ 847us) server_negotiation.cc:206] Beginning negotiation
0811 08:06:51.067433 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:06:51.067443 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:06:51.067481 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:06:51.067484 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:06:51.067499 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:06:51.067608 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:06:51.067702 (+ 94us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:51.068749 (+ 1047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:51.070121 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:51.070844 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:51.075337 (+ 4493us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:51.075437 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 08:06:51.075463 (+ 26us) server_negotiation.cc:299] Negotiation successful
0811 08:06:51.075504 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":804,"thread_start_us":101,"threads_started":1}
I20260811 08:06:51.075945 825 tablet_bootstrap.cc:492] T a119422256094016859080e3801ef273 P de35f40802f14e4db0b11cf6d0ddb42c: Bootstrap starting.
I20260811 08:06:51.076115 826 tablet_bootstrap.cc:492] T a119422256094016859080e3801ef273 P 4ad5179f7e1c41db9ba15fedad5fe751: Bootstrap starting.
I20260811 08:06:51.076387 730 tablet_service.cc:1467] Processing CreateTablet for tablet a119422256094016859080e3801ef273 (DEFAULT_TABLE table=test-table [id=e21e8887a35b4b3789233d59c618b15e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:06:51.076714 730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a119422256094016859080e3801ef273. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:06:51.076826 826 tablet_bootstrap.cc:654] T a119422256094016859080e3801ef273 P 4ad5179f7e1c41db9ba15fedad5fe751: Neither blocks nor log segments found. Creating new log.
I20260811 08:06:51.077342 826 log.cc:824] T a119422256094016859080e3801ef273 P 4ad5179f7e1c41db9ba15fedad5fe751: Log is configured to *not* fsync() on all Append() calls
I20260811 08:06:51.078186 826 tablet_bootstrap.cc:492] T a119422256094016859080e3801ef273 P 4ad5179f7e1c41db9ba15fedad5fe751: No bootstrap required, opened a new log
I20260811 08:06:51.078202 825 tablet_bootstrap.cc:654] T a119422256094016859080e3801ef273 P de35f40802f14e4db0b11cf6d0ddb42c: Neither blocks nor log segments found. Creating new log.
I20260811 08:06:51.078264 826 ts_tablet_manager.cc:1397] T a119422256094016859080e3801ef273 P 4ad5179f7e1c41db9ba15fedad5fe751: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 08:06:51.078686 825 log.cc:824] T a119422256094016859080e3801ef273 P de35f40802f14e4db0b11cf6d0ddb42c: Log is configured to *not* fsync() on all Append() calls
I20260811 08:06:51.079470 825 tablet_bootstrap.cc:492] T a119422256094016859080e3801ef273 P de35f40802f14e4db0b11cf6d0ddb42c: No bootstrap required, opened a new log
I20260811 08:06:51.079557 825 ts_tablet_manager.cc:1397] T a119422256094016859080e3801ef273 P de35f40802f14e4db0b11cf6d0ddb42c: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260811 08:06:51.080149 829 tablet_bootstrap.cc:492] T a119422256094016859080e3801ef273 P 528d113641084072814e1638bbcc07bb: Bootstrap starting.
I20260811 08:06:51.080472 826 raft_consensus.cc:348] T a119422256094016859080e3801ef273 P 4ad5179f7e1c41db9ba15fedad5fe751 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ad5179f7e1c41db9ba15fedad5fe751" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 46047 } } peers { permanent_uuid: "528d113641084072814e1638bbcc07bb" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 40471 } } peers { permanent_uuid: "de35f40802f14e4db0b11cf6d0ddb42c" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 41375 } }
I20260811 08:06:51.080618 826 raft_consensus.cc:374] T a119422256094016859080e3801ef273 P 4ad5179f7e1c41db9ba15fedad5fe751 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:06:51.080641 826 raft_consensus.cc:729] T a119422256094016859080e3801ef273 P 4ad5179f7e1c41db9ba15fedad5fe751 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ad5179f7e1c41db9ba15fedad5fe751, State: Initialized, Role: FOLLOWER
I20260811 08:06:51.080823 826 consensus_queue.cc:260] T a119422256094016859080e3801ef273 P 4ad5179f7e1c41db9ba15fedad5fe751 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ad5179f7e1c41db9ba15fedad5fe751" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 46047 } } peers { permanent_uuid: "528d113641084072814e1638bbcc07bb" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 40471 } } peers { permanent_uuid: "de35f40802f14e4db0b11cf6d0ddb42c" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 41375 } }
I20260811 08:06:51.081001 829 tablet_bootstrap.cc:654] T a119422256094016859080e3801ef273 P 528d113641084072814e1638bbcc07bb: Neither blocks nor log segments found. Creating new log.
I20260811 08:06:51.081113 826 ts_tablet_manager.cc:1428] T a119422256094016859080e3801ef273 P 4ad5179f7e1c41db9ba15fedad5fe751: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 08:06:51.081276 494 heartbeater.cc:503] Master 127.15.36.254:32993 was elected leader, sending a full tablet report...
I20260811 08:06:51.081673 829 log.cc:824] T a119422256094016859080e3801ef273 P 528d113641084072814e1638bbcc07bb: Log is configured to *not* fsync() on all Append() calls
I20260811 08:06:51.082140 825 raft_consensus.cc:348] T a119422256094016859080e3801ef273 P de35f40802f14e4db0b11cf6d0ddb42c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ad5179f7e1c41db9ba15fedad5fe751" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 46047 } } peers { permanent_uuid: "528d113641084072814e1638bbcc07bb" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 40471 } } peers { permanent_uuid: "de35f40802f14e4db0b11cf6d0ddb42c" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 41375 } }
I20260811 08:06:51.082336 825 raft_consensus.cc:374] T a119422256094016859080e3801ef273 P de35f40802f14e4db0b11cf6d0ddb42c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:06:51.082404 825 raft_consensus.cc:729] T a119422256094016859080e3801ef273 P de35f40802f14e4db0b11cf6d0ddb42c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de35f40802f14e4db0b11cf6d0ddb42c, State: Initialized, Role: FOLLOWER
I20260811 08:06:51.082543 825 consensus_queue.cc:260] T a119422256094016859080e3801ef273 P de35f40802f14e4db0b11cf6d0ddb42c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ad5179f7e1c41db9ba15fedad5fe751" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 46047 } } peers { permanent_uuid: "528d113641084072814e1638bbcc07bb" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 40471 } } peers { permanent_uuid: "de35f40802f14e4db0b11cf6d0ddb42c" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 41375 } }
I20260811 08:06:51.082652 829 tablet_bootstrap.cc:492] T a119422256094016859080e3801ef273 P 528d113641084072814e1638bbcc07bb: No bootstrap required, opened a new log
I20260811 08:06:51.082729 829 ts_tablet_manager.cc:1397] T a119422256094016859080e3801ef273 P 528d113641084072814e1638bbcc07bb: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 08:06:51.082850 825 ts_tablet_manager.cc:1428] T a119422256094016859080e3801ef273 P de35f40802f14e4db0b11cf6d0ddb42c: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 08:06:51.083051 647 heartbeater.cc:503] Master 127.15.36.254:32993 was elected leader, sending a full tablet report...
I20260811 08:06:51.084609 829 raft_consensus.cc:348] T a119422256094016859080e3801ef273 P 528d113641084072814e1638bbcc07bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ad5179f7e1c41db9ba15fedad5fe751" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 46047 } } peers { permanent_uuid: "528d113641084072814e1638bbcc07bb" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 40471 } } peers { permanent_uuid: "de35f40802f14e4db0b11cf6d0ddb42c" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 41375 } }
I20260811 08:06:51.084771 829 raft_consensus.cc:374] T a119422256094016859080e3801ef273 P 528d113641084072814e1638bbcc07bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:06:51.084815 829 raft_consensus.cc:729] T a119422256094016859080e3801ef273 P 528d113641084072814e1638bbcc07bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 528d113641084072814e1638bbcc07bb, State: Initialized, Role: FOLLOWER
I20260811 08:06:51.084928 829 consensus_queue.cc:260] T a119422256094016859080e3801ef273 P 528d113641084072814e1638bbcc07bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ad5179f7e1c41db9ba15fedad5fe751" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 46047 } } peers { permanent_uuid: "528d113641084072814e1638bbcc07bb" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 40471 } } peers { permanent_uuid: "de35f40802f14e4db0b11cf6d0ddb42c" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 41375 } }
I20260811 08:06:51.085204 829 ts_tablet_manager.cc:1428] T a119422256094016859080e3801ef273 P 528d113641084072814e1638bbcc07bb: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260811 08:06:51.085283 806 heartbeater.cc:503] Master 127.15.36.254:32993 was elected leader, sending a full tablet report...
W20260811 08:06:51.118875 648 tablet.cc:2369] T a119422256094016859080e3801ef273 P de35f40802f14e4db0b11cf6d0ddb42c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 08:06:51.192591 495 tablet.cc:2369] T a119422256094016859080e3801ef273 P 4ad5179f7e1c41db9ba15fedad5fe751: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 08:06:51.283366 807 tablet.cc:2369] T a119422256094016859080e3801ef273 P 528d113641084072814e1638bbcc07bb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:06:51.307489 832 raft_consensus.cc:482] T a119422256094016859080e3801ef273 P de35f40802f14e4db0b11cf6d0ddb42c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:06:51.307632 832 raft_consensus.cc:504] T a119422256094016859080e3801ef273 P de35f40802f14e4db0b11cf6d0ddb42c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ad5179f7e1c41db9ba15fedad5fe751" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 46047 } } peers { permanent_uuid: "528d113641084072814e1638bbcc07bb" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 40471 } } peers { permanent_uuid: "de35f40802f14e4db0b11cf6d0ddb42c" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 41375 } }
I20260811 08:06:51.308002 832 leader_election.cc:288] T a119422256094016859080e3801ef273 P de35f40802f14e4db0b11cf6d0ddb42c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ad5179f7e1c41db9ba15fedad5fe751 (127.15.36.193:46047), 528d113641084072814e1638bbcc07bb (127.15.36.195:40471)
I20260811 08:06:51.312476 821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:51.308363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:59299 (local address 127.15.36.193:46047)
0811 08:06:51.308412 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 08:06:51.308415 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:06:51.308426 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:06:51.308460 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:06:51.308461 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:06:51.308474 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:06:51.308564 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:06:51.308766 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:51.309557 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:51.311258 (+ 1701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:51.311935 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:51.312006 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:51.312014 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 08:06:51.312347 (+ 333us) server_negotiation.cc:299] Negotiation successful
0811 08:06:51.312397 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 08:06:51.312476 823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:51.308402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:60095 (local address 127.15.36.195:40471)
0811 08:06:51.308490 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0811 08:06:51.308492 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:06:51.308609 (+ 117us) server_negotiation.cc:407] Connection header received
0811 08:06:51.308638 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:06:51.308639 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:06:51.308654 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:06:51.308700 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:06:51.308872 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:51.309564 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:51.311290 (+ 1726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:51.311900 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:51.312001 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:51.312012 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 08:06:51.312353 (+ 341us) server_negotiation.cc:299] Negotiation successful
0811 08:06:51.312397 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 08:06:51.312511 651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:51.308269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.193:46047 (local address 127.15.36.194:59299)
0811 08:06:51.308337 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:51.308349 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:06:51.308398 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:06:51.308571 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:06:51.308573 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:06:51.308574 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:06:51.308660 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:51.308662 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:51.309683 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:51.309684 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:51.311125 (+ 1441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:51.311129 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:51.312136 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:51.312137 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:51.312251 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:51.312253 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 08:06:51.312321 (+ 68us) client_negotiation.cc:240] Negotiation successful
0811 08:06:51.312387 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46,"mutex_wait_us":77}
I20260811 08:06:51.312518 834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:51.308270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.195:40471 (local address 127.15.36.194:60095)
0811 08:06:51.308526 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:51.308535 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 08:06:51.308588 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:06:51.308731 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:06:51.308731 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:06:51.308733 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:06:51.308796 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:51.308797 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:51.309683 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:51.309684 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:51.311125 (+ 1441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:06:51.311129 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:06:51.312136 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:06:51.312137 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:06:51.312240 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:51.312245 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 08:06:51.312321 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 08:06:51.312387 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":211,"mutex_wait_us":72,"thread_start_us":157,"threads_started":1}
I20260811 08:06:51.313004 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a119422256094016859080e3801ef273" candidate_uuid: "de35f40802f14e4db0b11cf6d0ddb42c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "528d113641084072814e1638bbcc07bb" is_pre_election: true
I20260811 08:06:51.313103 440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a119422256094016859080e3801ef273" candidate_uuid: "de35f40802f14e4db0b11cf6d0ddb42c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ad5179f7e1c41db9ba15fedad5fe751" is_pre_election: true
I20260811 08:06:51.313202 751 raft_consensus.cc:2454] T a119422256094016859080e3801ef273 P 528d113641084072814e1638bbcc07bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de35f40802f14e4db0b11cf6d0ddb42c in term 0.
I20260811 08:06:51.313283 440 raft_consensus.cc:2454] T a119422256094016859080e3801ef273 P 4ad5179f7e1c41db9ba15fedad5fe751 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de35f40802f14e4db0b11cf6d0ddb42c in term 0.
I20260811 08:06:51.313469 520 leader_election.cc:302] T a119422256094016859080e3801ef273 P de35f40802f14e4db0b11cf6d0ddb42c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 528d113641084072814e1638bbcc07bb, de35f40802f14e4db0b11cf6d0ddb42c; no voters:
I20260811 08:06:51.313666 832 raft_consensus.cc:2781] T a119422256094016859080e3801ef273 P de35f40802f14e4db0b11cf6d0ddb42c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:06:51.313707 832 raft_consensus.cc:482] T a119422256094016859080e3801ef273 P de35f40802f14e4db0b11cf6d0ddb42c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:06:51.313723 832 raft_consensus.cc:3037] T a119422256094016859080e3801ef273 P de35f40802f14e4db0b11cf6d0ddb42c [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:06:51.314710 832 raft_consensus.cc:504] T a119422256094016859080e3801ef273 P de35f40802f14e4db0b11cf6d0ddb42c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ad5179f7e1c41db9ba15fedad5fe751" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 46047 } } peers { permanent_uuid: "528d113641084072814e1638bbcc07bb" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 40471 } } peers { permanent_uuid: "de35f40802f14e4db0b11cf6d0ddb42c" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 41375 } }
I20260811 08:06:51.314909 832 leader_election.cc:288] T a119422256094016859080e3801ef273 P de35f40802f14e4db0b11cf6d0ddb42c [CANDIDATE]: Term 1 election: Requested vote from peers 4ad5179f7e1c41db9ba15fedad5fe751 (127.15.36.193:46047), 528d113641084072814e1638bbcc07bb (127.15.36.195:40471)
I20260811 08:06:51.315147 751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a119422256094016859080e3801ef273" candidate_uuid: "de35f40802f14e4db0b11cf6d0ddb42c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "528d113641084072814e1638bbcc07bb"
I20260811 08:06:51.315164 440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a119422256094016859080e3801ef273" candidate_uuid: "de35f40802f14e4db0b11cf6d0ddb42c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ad5179f7e1c41db9ba15fedad5fe751"
I20260811 08:06:51.315263 440 raft_consensus.cc:3037] T a119422256094016859080e3801ef273 P 4ad5179f7e1c41db9ba15fedad5fe751 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:06:51.315263 751 raft_consensus.cc:3037] T a119422256094016859080e3801ef273 P 528d113641084072814e1638bbcc07bb [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:06:51.316237 440 raft_consensus.cc:2454] T a119422256094016859080e3801ef273 P 4ad5179f7e1c41db9ba15fedad5fe751 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de35f40802f14e4db0b11cf6d0ddb42c in term 1.
I20260811 08:06:51.316275 751 raft_consensus.cc:2454] T a119422256094016859080e3801ef273 P 528d113641084072814e1638bbcc07bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de35f40802f14e4db0b11cf6d0ddb42c in term 1.
I20260811 08:06:51.316435 520 leader_election.cc:302] T a119422256094016859080e3801ef273 P de35f40802f14e4db0b11cf6d0ddb42c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 528d113641084072814e1638bbcc07bb, de35f40802f14e4db0b11cf6d0ddb42c; no voters:
I20260811 08:06:51.316612 832 raft_consensus.cc:2781] T a119422256094016859080e3801ef273 P de35f40802f14e4db0b11cf6d0ddb42c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:06:51.316782 832 raft_consensus.cc:686] T a119422256094016859080e3801ef273 P de35f40802f14e4db0b11cf6d0ddb42c [term 1 LEADER]: Becoming Leader. State: Replica: de35f40802f14e4db0b11cf6d0ddb42c, State: Running, Role: LEADER
I20260811 08:06:51.316972 832 consensus_queue.cc:237] T a119422256094016859080e3801ef273 P de35f40802f14e4db0b11cf6d0ddb42c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ad5179f7e1c41db9ba15fedad5fe751" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 46047 } } peers { permanent_uuid: "528d113641084072814e1638bbcc07bb" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 40471 } } peers { permanent_uuid: "de35f40802f14e4db0b11cf6d0ddb42c" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 41375 } }
I20260811 08:06:51.317984 32742 catalog_manager.cc:5495] T a119422256094016859080e3801ef273 P de35f40802f14e4db0b11cf6d0ddb42c reported cstate change: term changed from 0 to 1, leader changed from <none> to de35f40802f14e4db0b11cf6d0ddb42c (127.15.36.194). New cstate: current_term: 1 leader_uuid: "de35f40802f14e4db0b11cf6d0ddb42c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ad5179f7e1c41db9ba15fedad5fe751" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 46047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "528d113641084072814e1638bbcc07bb" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 40471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de35f40802f14e4db0b11cf6d0ddb42c" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 41375 } health_report { overall_health: HEALTHY } } }
I20260811 08:06:51.355351 824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:51.352708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37928 (local address 127.15.36.194:41375)
0811 08:06:51.352788 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0811 08:06:51.352790 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:06:51.352799 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:06:51.352837 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:06:51.352838 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:06:51.352862 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:06:51.352931 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:06:51.353066 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:51.353591 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:51.354406 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:06:51.354602 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:06:51.354662 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:06:51.354856 (+ 194us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:06:51.355030 (+ 174us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:06:51.355110 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 08:06:51.355195 (+ 85us) server_negotiation.cc:299] Negotiation successful
0811 08:06:51.355216 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 08:06:51.357280 440 raft_consensus.cc:1261] T a119422256094016859080e3801ef273 P 4ad5179f7e1c41db9ba15fedad5fe751 [term 1 FOLLOWER]: Refusing update from remote peer de35f40802f14e4db0b11cf6d0ddb42c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:06:51.357367 751 raft_consensus.cc:1261] T a119422256094016859080e3801ef273 P 528d113641084072814e1638bbcc07bb [term 1 FOLLOWER]: Refusing update from remote peer de35f40802f14e4db0b11cf6d0ddb42c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:06:51.357672 835 consensus_queue.cc:1035] T a119422256094016859080e3801ef273 P de35f40802f14e4db0b11cf6d0ddb42c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ad5179f7e1c41db9ba15fedad5fe751" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 46047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:06:51.357833 832 consensus_queue.cc:1035] T a119422256094016859080e3801ef273 P de35f40802f14e4db0b11cf6d0ddb42c [LEADER]: Connected to new peer: Peer: permanent_uuid: "528d113641084072814e1638bbcc07bb" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 40471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:06:51.360592 842 mvcc.cc:205] Tried to move back new op lower bound from 7317240264116281344 to 7317240263955066880. Current Snapshot: MvccSnapshot[applied={T|T < 7317240264116281344}]
I20260811 08:06:51.361059 840 mvcc.cc:205] Tried to move back new op lower bound from 7317240264116281344 to 7317240263955066880. Current Snapshot: MvccSnapshot[applied={T|T < 7317240264116281344}]
I20260811 08:06:51.363024 32741 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44890:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:06:51.363155 32741 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44890:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:06:51.364081 32741 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 59497f3eef3b44289d9cb975538fd725: Sending DeleteTablet for 3 replicas of tablet a119422256094016859080e3801ef273
I20260811 08:06:51.364470 570 tablet_service.cc:1514] Processing DeleteTablet for tablet a119422256094016859080e3801ef273 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:06:51 UTC) from {username='kudu', principal='kudu/127.15.36.254@KRBTEST.COM'} at 127.0.0.1:37912
I20260811 08:06:51.364470 416 tablet_service.cc:1514] Processing DeleteTablet for tablet a119422256094016859080e3801ef273 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:06:51 UTC) from {username='kudu', principal='kudu/127.15.36.254@KRBTEST.COM'} at 127.0.0.1:51016
I20260811 08:06:51.364560 730 tablet_service.cc:1514] Processing DeleteTablet for tablet a119422256094016859080e3801ef273 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:06:51 UTC) from {username='kudu', principal='kudu/127.15.36.254@KRBTEST.COM'} at 127.0.0.1:58334
I20260811 08:06:51.364758 850 tablet_replica.cc:330] T a119422256094016859080e3801ef273 P de35f40802f14e4db0b11cf6d0ddb42c: stopping tablet replica
I20260811 08:06:51.364799 852 tablet_replica.cc:330] T a119422256094016859080e3801ef273 P 528d113641084072814e1638bbcc07bb: stopping tablet replica
I20260811 08:06:51.364868 850 raft_consensus.cc:2229] T a119422256094016859080e3801ef273 P de35f40802f14e4db0b11cf6d0ddb42c [term 1 LEADER]: Raft consensus shutting down.
I20260811 08:06:51.364863 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 343
I20260811 08:06:51.364996 850 raft_consensus.cc:2258] T a119422256094016859080e3801ef273 P de35f40802f14e4db0b11cf6d0ddb42c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:06:51.365028 852 raft_consensus.cc:2229] T a119422256094016859080e3801ef273 P 528d113641084072814e1638bbcc07bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:06:51.365504 850 ts_tablet_manager.cc:1905] T a119422256094016859080e3801ef273 P de35f40802f14e4db0b11cf6d0ddb42c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:06:51.366588 852 raft_consensus.cc:2258] T a119422256094016859080e3801ef273 P 528d113641084072814e1638bbcc07bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:06:51.367538 852 ts_tablet_manager.cc:1905] T a119422256094016859080e3801ef273 P 528d113641084072814e1638bbcc07bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:06:51.367937 850 ts_tablet_manager.cc:1918] T a119422256094016859080e3801ef273 P de35f40802f14e4db0b11cf6d0ddb42c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:06:51.368040 850 log.cc:1196] T a119422256094016859080e3801ef273 P de35f40802f14e4db0b11cf6d0ddb42c: Deleting WAL directory at /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-1/wal/wals/a119422256094016859080e3801ef273
I20260811 08:06:51.368465 850 ts_tablet_manager.cc:1939] T a119422256094016859080e3801ef273 P de35f40802f14e4db0b11cf6d0ddb42c: Deleting consensus metadata
I20260811 08:06:51.369580 852 ts_tablet_manager.cc:1918] T a119422256094016859080e3801ef273 P 528d113641084072814e1638bbcc07bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:06:51.369731 852 log.cc:1196] T a119422256094016859080e3801ef273 P 528d113641084072814e1638bbcc07bb: Deleting WAL directory at /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-2/wal/wals/a119422256094016859080e3801ef273
I20260811 08:06:51.370116 852 ts_tablet_manager.cc:1939] T a119422256094016859080e3801ef273 P 528d113641084072814e1638bbcc07bb: Deleting consensus metadata
I20260811 08:06:51.370689 32725 catalog_manager.cc:4841] TS 528d113641084072814e1638bbcc07bb (127.15.36.195:40471): tablet a119422256094016859080e3801ef273 (table test-table [id=e21e8887a35b4b3789233d59c618b15e]) successfully deleted
I20260811 08:06:51.374372 32726 catalog_manager.cc:4841] TS de35f40802f14e4db0b11cf6d0ddb42c (127.15.36.194:41375): tablet a119422256094016859080e3801ef273 (table test-table [id=e21e8887a35b4b3789233d59c618b15e]) successfully deleted
W20260811 08:06:51.378355 32726 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.36.193:46047 (error 108)
I20260811 08:06:51.378567 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 500
I20260811 08:06:51.380229 818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:06:51.380069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.193:46047 (local address 127.0.0.1:51030)
0811 08:06:51.380129 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0811 08:06:51.380178 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.193:46047: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260811 08:06:51.380581 32726 catalog_manager.cc:4584] TS 4ad5179f7e1c41db9ba15fedad5fe751 (127.15.36.193:46047): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a119422256094016859080e3801ef273: Network error: Client connection negotiation failed: client connection to 127.15.36.193:46047: connect: Connection refused (error 111)
I20260811 08:06:51.385635 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 656
I20260811 08:06:51.393267 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 32705
I20260811 08:07:11.401389 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:32993
--webserver_interface=127.15.36.254
--webserver_port=37861
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=kudu/127.15.36.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:46213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.36.254:32993
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:07:11.488703 854 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:07:11.489107 854 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:07:11.489265 854 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:07:11.490772 854 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 08:07:11.490846 854 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 08:07:11.490870 854 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 08:07:11.490890 854 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:07:11.490923 854 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:07:11.490988 854 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:07:11.491039 854 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:07:11.491062 854 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:07:11.492795 854 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:46213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.15.36.254:32993
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=kudu/127.15.36.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:32993
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.36.254
--webserver_port=37861
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.854
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:07:11.493116 854 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:07:11.493393 854 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:07:11.504288 863 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:07:11.504426 854 server_base.cc:1034] running on GCE node
W20260811 08:07:11.504310 861 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:07:11.504253 860 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:07:11.504894 854 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:07:11.505263 854 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:07:11.506469 854 hybrid_clock.cc:648] HybridClock initialized: now 1786435631506451 us; error 50 us; skew 500 ppm
Aug 11 08:07:11 dist-test-slave-2w3w krb5kdc[32689](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435631, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:07:11.516350 854 init.cc:377] Logged in from keytab as kudu/127.15.36.254@KRBTEST.COM (short username kudu)
I20260811 08:07:11.516896 854 webserver.cc:460] Webserver started at http://127.15.36.254:37861/ using document root <none> and password file <none>
I20260811 08:07:11.517174 854 fs_manager.cc:359] Metadata directory not provided
I20260811 08:07:11.517277 854 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:07:11.518869 854 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:07:11.519737 870 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:11.520013 854 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:07:11.520154 854 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/master-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/master-0/wal
uuid: "59497f3eef3b44289d9cb975538fd725"
format_stamp: "Formatted at 2026-08-11 08:06:50 on dist-test-slave-2w3w"
server_key: "8cdcd2e73eace78475125e5bd94e0082"
server_key_iv: "48aee35c36bf873ec1dd367e3b738377"
server_key_version: "encryptionkey@0"
I20260811 08:07:11.520635 854 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:07:11.532389 854 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:07:11.534929 854 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:07:11.535194 854 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:07:11.539718 854 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.254:32993
I20260811 08:07:11.539848 930 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.254:32993 every 8 connection(s)
I20260811 08:07:11.540233 854 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
I20260811 08:07:11.542008 931 sys_catalog.cc:263] Verifying existing consensus state
I20260811 08:07:11.542769 931 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 59497f3eef3b44289d9cb975538fd725: Bootstrap starting.
I20260811 08:07:11.548136 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 854
I20260811 08:07:11.548501 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.193:46047
--local_ip_for_outbound_sockets=127.15.36.193
--tserver_master_addrs=127.15.36.254:32993
--webserver_port=42621
--webserver_interface=127.15.36.193
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab
--principal=kudu/127.15.36.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:46213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 08:07:11.552103 931 log.cc:824] T 00000000000000000000000000000000 P 59497f3eef3b44289d9cb975538fd725: Log is configured to *not* fsync() on all Append() calls
I20260811 08:07:11.554307 931 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 59497f3eef3b44289d9cb975538fd725: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 08:07:11.554685 931 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 59497f3eef3b44289d9cb975538fd725: Bootstrap complete.
I20260811 08:07:11.557322 931 raft_consensus.cc:348] T 00000000000000000000000000000000 P 59497f3eef3b44289d9cb975538fd725 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59497f3eef3b44289d9cb975538fd725" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 32993 } }
I20260811 08:07:11.557613 931 raft_consensus.cc:729] T 00000000000000000000000000000000 P 59497f3eef3b44289d9cb975538fd725 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59497f3eef3b44289d9cb975538fd725, State: Initialized, Role: FOLLOWER
I20260811 08:07:11.557826 931 consensus_queue.cc:260] T 00000000000000000000000000000000 P 59497f3eef3b44289d9cb975538fd725 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59497f3eef3b44289d9cb975538fd725" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 32993 } }
I20260811 08:07:11.557931 931 raft_consensus.cc:388] T 00000000000000000000000000000000 P 59497f3eef3b44289d9cb975538fd725 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:07:11.557994 931 raft_consensus.cc:482] T 00000000000000000000000000000000 P 59497f3eef3b44289d9cb975538fd725 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:07:11.558043 931 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 59497f3eef3b44289d9cb975538fd725 [term 1 FOLLOWER]: Advancing to term 2
I20260811 08:07:11.559312 931 raft_consensus.cc:504] T 00000000000000000000000000000000 P 59497f3eef3b44289d9cb975538fd725 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59497f3eef3b44289d9cb975538fd725" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 32993 } }
I20260811 08:07:11.559442 931 leader_election.cc:302] T 00000000000000000000000000000000 P 59497f3eef3b44289d9cb975538fd725 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 59497f3eef3b44289d9cb975538fd725; no voters:
I20260811 08:07:11.559640 931 leader_election.cc:288] T 00000000000000000000000000000000 P 59497f3eef3b44289d9cb975538fd725 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 08:07:11.559724 935 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 59497f3eef3b44289d9cb975538fd725 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 08:07:11.559944 931 sys_catalog.cc:564] T 00000000000000000000000000000000 P 59497f3eef3b44289d9cb975538fd725 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:07:11.559965 935 raft_consensus.cc:686] T 00000000000000000000000000000000 P 59497f3eef3b44289d9cb975538fd725 [term 2 LEADER]: Becoming Leader. State: Replica: 59497f3eef3b44289d9cb975538fd725, State: Running, Role: LEADER
I20260811 08:07:11.560298 935 consensus_queue.cc:237] T 00000000000000000000000000000000 P 59497f3eef3b44289d9cb975538fd725 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59497f3eef3b44289d9cb975538fd725" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 32993 } }
I20260811 08:07:11.560652 936 sys_catalog.cc:455] T 00000000000000000000000000000000 P 59497f3eef3b44289d9cb975538fd725 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "59497f3eef3b44289d9cb975538fd725" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59497f3eef3b44289d9cb975538fd725" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 32993 } } }
I20260811 08:07:11.560737 936 sys_catalog.cc:458] T 00000000000000000000000000000000 P 59497f3eef3b44289d9cb975538fd725 [sys.catalog]: This master's current role is: LEADER
I20260811 08:07:11.561112 937 sys_catalog.cc:455] T 00000000000000000000000000000000 P 59497f3eef3b44289d9cb975538fd725 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 59497f3eef3b44289d9cb975538fd725. Latest consensus state: current_term: 2 leader_uuid: "59497f3eef3b44289d9cb975538fd725" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59497f3eef3b44289d9cb975538fd725" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 32993 } } }
I20260811 08:07:11.561187 937 sys_catalog.cc:458] T 00000000000000000000000000000000 P 59497f3eef3b44289d9cb975538fd725 [sys.catalog]: This master's current role is: LEADER
I20260811 08:07:11.561332 943 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:07:11.562116 943 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:07:11.562372 943 catalog_manager.cc:1259] Loaded cluster ID: 921fa01da16f4ebea41371c62cf5c12a
I20260811 08:07:11.562526 943 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:07:11.563793 943 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:07:11.564024 943 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 59497f3eef3b44289d9cb975538fd725: Loaded TSK: 0
I20260811 08:07:11.582662 943 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 59497f3eef3b44289d9cb975538fd725: Generated new TSK 1
I20260811 08:07:11.582801 943 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 08:07:11.639295 933 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:07:11.639561 933 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:07:11.639608 933 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:07:11.640919 933 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:07:11.641010 933 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:07:11.641062 933 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.193
I20260811 08:07:11.642706 933 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:46213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab
--principal=kudu/127.15.36.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.193:46047
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.36.193
--webserver_port=42621
--tserver_master_addrs=127.15.36.254:32993
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.933
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.193
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:07:11.643080 933 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:07:11.643359 933 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:07:11.649256 968 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:07:11.649641 933 server_base.cc:1034] running on GCE node
W20260811 08:07:11.649399 965 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:07:11.649263 964 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:07:11.649981 933 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:07:11.650271 933 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:07:11.651513 933 hybrid_clock.cc:648] HybridClock initialized: now 1786435631651495 us; error 34 us; skew 500 ppm
Aug 11 08:07:11 dist-test-slave-2w3w krb5kdc[32689](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435631, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:07:11.654678 933 init.cc:377] Logged in from keytab as kudu/127.15.36.193@KRBTEST.COM (short username kudu)
I20260811 08:07:11.655328 933 webserver.cc:460] Webserver started at http://127.15.36.193:42621/ using document root <none> and password file <none>
I20260811 08:07:11.655594 933 fs_manager.cc:359] Metadata directory not provided
I20260811 08:07:11.655658 933 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:07:11.657171 933 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 08:07:11.657951 976 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:11.658151 933 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:07:11.658252 933 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-0/wal
uuid: "4ad5179f7e1c41db9ba15fedad5fe751"
format_stamp: "Formatted at 2026-08-11 08:06:50 on dist-test-slave-2w3w"
server_key: "8e1b2d781d07ae713de3f7d64fc22e4c"
server_key_iv: "7fd4fa3ee73e6959ad25572f8c9a8635"
server_key_version: "encryptionkey@0"
I20260811 08:07:11.658627 933 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:07:11.673835 933 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:07:11.676667 933 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:07:11.676829 933 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:07:11.677183 933 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:07:11.677721 985 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 08:07:11.679306 933 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 08:07:11.679366 933 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260811 08:07:11.679395 933 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 08:07:11.680122 933 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 08:07:11.680171 933 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260811 08:07:11.680217 985 tablet_bootstrap.cc:492] T a119422256094016859080e3801ef273 P 4ad5179f7e1c41db9ba15fedad5fe751: Bootstrap starting.
I20260811 08:07:11.688814 933 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.193:46047
I20260811 08:07:11.689432 933 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
I20260811 08:07:11.691182 1113 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.193:46047 every 8 connection(s)
I20260811 08:07:11.692822 985 log.cc:824] T a119422256094016859080e3801ef273 P 4ad5179f7e1c41db9ba15fedad5fe751: Log is configured to *not* fsync() on all Append() calls
I20260811 08:07:11.695250 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 933
I20260811 08:07:11.695530 985 tablet_bootstrap.cc:492] T a119422256094016859080e3801ef273 P 4ad5179f7e1c41db9ba15fedad5fe751: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 08:07:11.695601 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.194:41375
--local_ip_for_outbound_sockets=127.15.36.194
--tserver_master_addrs=127.15.36.254:32993
--webserver_port=45485
--webserver_interface=127.15.36.194
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab
--principal=kudu/127.15.36.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:46213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 08:07:11.695871 985 tablet_bootstrap.cc:492] T a119422256094016859080e3801ef273 P 4ad5179f7e1c41db9ba15fedad5fe751: Bootstrap complete.
I20260811 08:07:11.697085 985 ts_tablet_manager.cc:1397] T a119422256094016859080e3801ef273 P 4ad5179f7e1c41db9ba15fedad5fe751: Time spent bootstrapping tablet: real 0.017s user 0.006s sys 0.009s
I20260811 08:07:11.698531 985 raft_consensus.cc:348] T a119422256094016859080e3801ef273 P 4ad5179f7e1c41db9ba15fedad5fe751 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ad5179f7e1c41db9ba15fedad5fe751" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 46047 } } peers { permanent_uuid: "528d113641084072814e1638bbcc07bb" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 40471 } } peers { permanent_uuid: "de35f40802f14e4db0b11cf6d0ddb42c" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 41375 } }
I20260811 08:07:11.698819 985 raft_consensus.cc:729] T a119422256094016859080e3801ef273 P 4ad5179f7e1c41db9ba15fedad5fe751 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ad5179f7e1c41db9ba15fedad5fe751, State: Initialized, Role: FOLLOWER
I20260811 08:07:11.699030 985 consensus_queue.cc:260] T a119422256094016859080e3801ef273 P 4ad5179f7e1c41db9ba15fedad5fe751 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ad5179f7e1c41db9ba15fedad5fe751" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 46047 } } peers { permanent_uuid: "528d113641084072814e1638bbcc07bb" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 40471 } } peers { permanent_uuid: "de35f40802f14e4db0b11cf6d0ddb42c" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 41375 } }
I20260811 08:07:11.699391 985 ts_tablet_manager.cc:1428] T a119422256094016859080e3801ef273 P 4ad5179f7e1c41db9ba15fedad5fe751: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
Aug 11 08:07:11 dist-test-slave-2w3w krb5kdc[32689](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435631, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.193@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:07:11.705163 1121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:11.690390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:54759 (local address 127.15.36.254:32993)
0811 08:07:11.690596 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:11.690606 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:11.691733 (+ 1127us) server_negotiation.cc:407] Connection header received
0811 08:07:11.692687 (+ 954us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:11.692695 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:11.692760 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:11.692912 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:07:11.693705 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:11.695198 (+ 1493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:11.696788 (+ 1590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:11.697478 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:11.697560 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:11.700746 (+ 3186us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:07:11.700752 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:07:11.700752 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:07:11.700769 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:07:11.702874 (+ 2105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:07:11.703528 (+ 654us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:07:11.703532 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:07:11.703532 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:07:11.703660 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:07:11.704010 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:07:11.704010 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:07:11.704011 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:07:11.704315 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:07:11.704393 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:11.704806 (+ 413us) server_negotiation.cc:299] Negotiation successful
0811 08:07:11.704953 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":96,"threads_started":1}
I20260811 08:07:11.705232 1120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:11.690232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32993 (local address 127.15.36.193:54759)
0811 08:07:11.691517 (+ 1285us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:11.691570 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 08:07:11.692422 (+ 852us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:07:11.692975 (+ 553us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:07:11.692981 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:07:11.693322 (+ 341us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:07:11.693557 (+ 235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:11.693565 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:11.695373 (+ 1808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:11.695375 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:11.696665 (+ 1290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:11.696669 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:11.697713 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:11.697714 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:11.697870 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:11.698556 (+ 686us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:07:11.698566 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:07:11.700603 (+ 2037us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:07:11.703019 (+ 2416us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:07:11.703031 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:07:11.703034 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:07:11.703420 (+ 386us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:07:11.703744 (+ 324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:07:11.703745 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:07:11.703746 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:07:11.703923 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:07:11.704395 (+ 472us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:07:11.704404 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:07:11.704598 (+ 194us) client_negotiation.cc:769] Sending connection context
0811 08:07:11.704726 (+ 128us) client_negotiation.cc:240] Negotiation successful
0811 08:07:11.704962 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1231,"thread_start_us":91,"threads_started":1}
I20260811 08:07:11.706408 1114 heartbeater.cc:347] Connected to a master server at 127.15.36.254:32993
I20260811 08:07:11.706508 1114 heartbeater.cc:464] Registering TS with master...
I20260811 08:07:11.706687 1114 heartbeater.cc:511] Master 127.15.36.254:32993 requested a full tablet report, sending...
I20260811 08:07:11.707510 888 ts_manager.cc:194] Registered new tserver with Master: 4ad5179f7e1c41db9ba15fedad5fe751 (127.15.36.193:46047)
I20260811 08:07:11.708623 888 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.36.193@KRBTEST.COM'} at 127.15.36.193:54759
I20260811 08:07:11.710009 1114 heartbeater.cc:503] Master 127.15.36.254:32993 was elected leader, sending a full tablet report...
I20260811 08:07:11.715596 1126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:11.709081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.193:46047 (local address 127.0.0.1:54464)
0811 08:07:11.711101 (+ 2020us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:11.711154 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 08:07:11.711229 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:07:11.711594 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:07:11.711597 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:07:11.711600 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:07:11.711674 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:11.711676 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:11.713340 (+ 1664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:11.713341 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:11.714218 (+ 877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:11.714222 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:11.715291 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:11.715292 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:11.715383 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:11.715395 (+ 12us) client_negotiation.cc:769] Sending connection context
0811 08:07:11.715469 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 08:07:11.715523 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1978,"thread_start_us":92,"threads_started":1}
I20260811 08:07:11.715633 1127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:11.709182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54464 (local address 127.15.36.193:46047)
0811 08:07:11.711374 (+ 2192us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:11.711379 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:11.711389 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:07:11.711424 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:11.711426 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:11.711442 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:11.711520 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:07:11.711759 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:11.713194 (+ 1435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:11.714342 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:11.715176 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:11.715259 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:11.715325 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:11.715497 (+ 172us) server_negotiation.cc:299] Negotiation successful
0811 08:07:11.715546 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2156,"thread_start_us":103,"threads_started":1}
I20260811 08:07:11.716161 1031 tablet_service.cc:1514] Processing DeleteTablet for tablet a119422256094016859080e3801ef273 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:06:51 UTC) from {username='kudu', principal='kudu/127.15.36.254@KRBTEST.COM'} at 127.0.0.1:54464
I20260811 08:07:11.716792 1129 tablet_replica.cc:330] stopping tablet replica
I20260811 08:07:11.716969 1129 raft_consensus.cc:2229] T a119422256094016859080e3801ef273 P 4ad5179f7e1c41db9ba15fedad5fe751 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:07:11.717056 1129 raft_consensus.cc:2258] T a119422256094016859080e3801ef273 P 4ad5179f7e1c41db9ba15fedad5fe751 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:07:11.717404 1129 ts_tablet_manager.cc:1905] T a119422256094016859080e3801ef273 P 4ad5179f7e1c41db9ba15fedad5fe751: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:07:11.719800 1129 ts_tablet_manager.cc:1918] T a119422256094016859080e3801ef273 P 4ad5179f7e1c41db9ba15fedad5fe751: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:07:11.719980 1129 log.cc:1196] T a119422256094016859080e3801ef273 P 4ad5179f7e1c41db9ba15fedad5fe751: Deleting WAL directory at /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-0/wal/wals/a119422256094016859080e3801ef273
I20260811 08:07:11.720237 1129 ts_tablet_manager.cc:1939] T a119422256094016859080e3801ef273 P 4ad5179f7e1c41db9ba15fedad5fe751: Deleting consensus metadata
I20260811 08:07:11.721603 875 catalog_manager.cc:4841] TS 4ad5179f7e1c41db9ba15fedad5fe751 (127.15.36.193:46047): tablet a119422256094016859080e3801ef273 (table test-table [id=e21e8887a35b4b3789233d59c618b15e]) successfully deleted
W20260811 08:07:11.788594 1124 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:07:11.788865 1124 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:07:11.788918 1124 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:07:11.790170 1124 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:07:11.790251 1124 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:07:11.790300 1124 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.194
I20260811 08:07:11.791936 1124 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:46213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab
--principal=kudu/127.15.36.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.194:41375
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.36.194
--webserver_port=45485
--tserver_master_addrs=127.15.36.254:32993
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1124
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.194
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:07:11.792240 1124 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:07:11.792507 1124 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:07:11.798035 1140 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:07:11.798035 1136 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:07:11.798137 1137 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:07:11.798547 1124 server_base.cc:1034] running on GCE node
I20260811 08:07:11.798827 1124 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:07:11.799149 1124 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:07:11.800303 1124 hybrid_clock.cc:648] HybridClock initialized: now 1786435631800282 us; error 40 us; skew 500 ppm
Aug 11 08:07:11 dist-test-slave-2w3w krb5kdc[32689](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435631, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:07:11.803185 1124 init.cc:377] Logged in from keytab as kudu/127.15.36.194@KRBTEST.COM (short username kudu)
I20260811 08:07:11.803755 1124 webserver.cc:460] Webserver started at http://127.15.36.194:45485/ using document root <none> and password file <none>
I20260811 08:07:11.804020 1124 fs_manager.cc:359] Metadata directory not provided
I20260811 08:07:11.804118 1124 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:07:11.805663 1124 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:07:11.806479 1147 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:11.806674 1124 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:07:11.806787 1124 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-1/wal
uuid: "de35f40802f14e4db0b11cf6d0ddb42c"
format_stamp: "Formatted at 2026-08-11 08:06:50 on dist-test-slave-2w3w"
server_key: "3a2414ce379f80403270a1eb8f02f41a"
server_key_iv: "98f3ae556d7c9b8e6601fb9d88ccd9d8"
server_key_version: "encryptionkey@0"
I20260811 08:07:11.807264 1124 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:07:11.831449 1124 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:07:11.834143 1124 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:07:11.834338 1124 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:07:11.834612 1124 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:07:11.835072 1124 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:07:11.835129 1124 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:11.835175 1124 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:07:11.835202 1124 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:11.841952 1124 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.194:41375
I20260811 08:07:11.842018 1270 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.194:41375 every 8 connection(s)
I20260811 08:07:11.842468 1124 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
I20260811 08:07:11.845269 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 1124
I20260811 08:07:11.845685 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.195:40471
--local_ip_for_outbound_sockets=127.15.36.195
--tserver_master_addrs=127.15.36.254:32993
--webserver_port=38945
--webserver_interface=127.15.36.195
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab
--principal=kudu/127.15.36.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:46213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 08:07:11 dist-test-slave-2w3w krb5kdc[32689](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435631, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.194@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:07:11.854739 1121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:11.843504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:49847 (local address 127.15.36.254:32993)
0811 08:07:11.843579 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:11.843581 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:11.843782 (+ 201us) server_negotiation.cc:407] Connection header received
0811 08:07:11.844299 (+ 517us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:11.844301 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:11.844315 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:11.844397 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:07:11.845602 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:11.846508 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:11.847775 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:11.847996 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:11.848076 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:11.851110 (+ 3034us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:07:11.851112 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:07:11.851112 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:07:11.851121 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:07:11.852812 (+ 1691us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:07:11.853453 (+ 641us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:07:11.853454 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:07:11.853454 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:07:11.853523 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:07:11.853903 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:07:11.853904 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:07:11.853905 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:07:11.854053 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:07:11.854124 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:11.854548 (+ 424us) server_negotiation.cc:299] Negotiation successful
0811 08:07:11.854657 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 08:07:11.855095 1273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:11.843424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32993 (local address 127.15.36.194:49847)
0811 08:07:11.843613 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:11.843659 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 08:07:11.844197 (+ 538us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:07:11.844480 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:07:11.844483 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:07:11.845187 (+ 704us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:07:11.845400 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:11.845405 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:11.846638 (+ 1233us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:11.846639 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:11.847649 (+ 1010us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:11.847652 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:11.848101 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:11.848102 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:11.848239 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:11.848914 (+ 675us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:07:11.848923 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:07:11.850898 (+ 1975us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:07:11.852907 (+ 2009us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:07:11.852927 (+ 20us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:07:11.852931 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:07:11.853338 (+ 407us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:07:11.853608 (+ 270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:07:11.853609 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:07:11.853610 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:07:11.853789 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:07:11.854135 (+ 346us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:07:11.854143 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:07:11.854369 (+ 226us) client_negotiation.cc:769] Sending connection context
0811 08:07:11.854511 (+ 142us) client_negotiation.cc:240] Negotiation successful
0811 08:07:11.854760 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":105,"threads_started":1}
I20260811 08:07:11.855682 1271 heartbeater.cc:347] Connected to a master server at 127.15.36.254:32993
I20260811 08:07:11.855911 1271 heartbeater.cc:464] Registering TS with master...
I20260811 08:07:11.856138 1271 heartbeater.cc:511] Master 127.15.36.254:32993 requested a full tablet report, sending...
I20260811 08:07:11.856634 888 ts_manager.cc:194] Registered new tserver with Master: de35f40802f14e4db0b11cf6d0ddb42c (127.15.36.194:41375)
I20260811 08:07:11.857040 888 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.36.194@KRBTEST.COM'} at 127.15.36.194:49847
W20260811 08:07:11.935979 1274 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:07:11.936215 1274 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:07:11.936244 1274 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:07:11.937533 1274 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:07:11.937597 1274 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:07:11.937628 1274 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.195
I20260811 08:07:11.939327 1274 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:46213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab
--principal=kudu/127.15.36.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.195:40471
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.36.195
--webserver_port=38945
--tserver_master_addrs=127.15.36.254:32993
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1274
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.195
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:07:11.939628 1274 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:07:11.939891 1274 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:07:11.945585 1282 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:07:11.945608 1283 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:07:11.945585 1285 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:07:11.945909 1274 server_base.cc:1034] running on GCE node
I20260811 08:07:11.946126 1274 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:07:11.946368 1274 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:07:11.947546 1274 hybrid_clock.cc:648] HybridClock initialized: now 1786435631947527 us; error 32 us; skew 500 ppm
Aug 11 08:07:11 dist-test-slave-2w3w krb5kdc[32689](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435631, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:07:11.950475 1274 init.cc:377] Logged in from keytab as kudu/127.15.36.195@KRBTEST.COM (short username kudu)
I20260811 08:07:11.951081 1274 webserver.cc:460] Webserver started at http://127.15.36.195:38945/ using document root <none> and password file <none>
I20260811 08:07:11.951373 1274 fs_manager.cc:359] Metadata directory not provided
I20260811 08:07:11.951473 1274 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:07:11.953406 1274 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 08:07:11.954133 1294 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:11.954380 1274 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:07:11.954497 1274 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-2/wal
uuid: "528d113641084072814e1638bbcc07bb"
format_stamp: "Formatted at 2026-08-11 08:06:51 on dist-test-slave-2w3w"
server_key: "48efad997a8bc24d4401c870d6d3bdcd"
server_key_iv: "611d2d98decc2dddda41bcbd68d52a7c"
server_key_version: "encryptionkey@0"
I20260811 08:07:11.954913 1274 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:07:11.975715 1274 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:07:11.978372 1274 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:07:11.978561 1274 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:07:11.978830 1274 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:07:11.979220 1274 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:07:11.979277 1274 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:11.979321 1274 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:07:11.979365 1274 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:11.985337 1274 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.195:40471
I20260811 08:07:11.985430 1425 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.195:40471 every 8 connection(s)
I20260811 08:07:11.985810 1274 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
Aug 11 08:07:11 dist-test-slave-2w3w krb5kdc[32689](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435631, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.195@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:07:11.992903 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 1274
I20260811 08:07:11.996865 1121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:11.986631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:56955 (local address 127.15.36.254:32993)
0811 08:07:11.986682 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:11.986684 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:11.986937 (+ 253us) server_negotiation.cc:407] Connection header received
0811 08:07:11.987518 (+ 581us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:11.987519 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:11.987531 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:11.987587 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:07:11.988593 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:11.989119 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:11.990204 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:11.990431 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:11.990497 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:11.993147 (+ 2650us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:07:11.993149 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:07:11.993149 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:07:11.993164 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:07:11.995077 (+ 1913us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:07:11.995726 (+ 649us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:07:11.995727 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:07:11.995728 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:07:11.995821 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:07:11.996130 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:07:11.996131 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:07:11.996132 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:07:11.996274 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:07:11.996385 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:11.996653 (+ 268us) server_negotiation.cc:299] Negotiation successful
0811 08:07:11.996751 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 08:07:11.997094 1429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:11.986618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32993 (local address 127.15.36.195:56955)
0811 08:07:11.986820 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:11.986860 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 08:07:11.987397 (+ 537us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:07:11.987650 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:07:11.987653 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:07:11.988269 (+ 616us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:07:11.988479 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:11.988484 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:11.989228 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:11.989229 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:11.990110 (+ 881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:11.990112 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:11.990522 (+ 410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:11.990523 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:11.990637 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:11.991356 (+ 719us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:07:11.991365 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:07:11.993035 (+ 1670us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:07:11.995169 (+ 2134us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:07:11.995180 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:07:11.995217 (+ 37us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:07:11.995632 (+ 415us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:07:11.995915 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:07:11.995916 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:07:11.995916 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:07:11.996051 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:07:11.996380 (+ 329us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:07:11.996386 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:07:11.996516 (+ 130us) client_negotiation.cc:769] Sending connection context
0811 08:07:11.996605 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 08:07:11.996836 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":91,"threads_started":1}
I20260811 08:07:11.997646 1426 heartbeater.cc:347] Connected to a master server at 127.15.36.254:32993
I20260811 08:07:11.997771 1426 heartbeater.cc:464] Registering TS with master...
I20260811 08:07:11.998003 1426 heartbeater.cc:511] Master 127.15.36.254:32993 requested a full tablet report, sending...
I20260811 08:07:11.998497 888 ts_manager.cc:194] Registered new tserver with Master: 528d113641084072814e1638bbcc07bb (127.15.36.195:40471)
I20260811 08:07:11.998886 888 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.36.195@KRBTEST.COM'} at 127.15.36.195:56955
I20260811 08:07:12.002305 1432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:11.993369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50648 (local address 127.15.36.254:32993)
0811 08:07:11.993531 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:11.993533 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:11.993843 (+ 310us) server_negotiation.cc:407] Connection header received
0811 08:07:11.993872 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:11.993873 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:11.993886 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:11.993948 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:07:11.994839 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:11.995719 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:11.996843 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:11.997143 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:11.997216 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:11.998823 (+ 1607us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:07:11.998825 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:07:11.998825 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:07:11.998833 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:07:12.001040 (+ 2207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:07:12.001459 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:07:12.001461 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:07:12.001461 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:07:12.001530 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:07:12.001759 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:07:12.001760 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:07:12.001760 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:07:12.001877 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:07:12.002069 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:12.002106 (+ 37us) server_negotiation.cc:299] Negotiation successful
0811 08:07:12.002196 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":105,"threads_started":1}
I20260811 08:07:12.003248 15507 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 08:07:12.006342 1432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:12.003653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50662 (local address 127.15.36.254:32993)
0811 08:07:12.003721 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:12.003723 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:12.003777 (+ 54us) server_negotiation.cc:407] Connection header received
0811 08:07:12.003854 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:12.003855 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:12.003887 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:12.003945 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:07:12.004075 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:12.004557 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:12.005417 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:12.005625 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:12.005691 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:12.006072 (+ 381us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:07:12.006123 (+ 51us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0811 08:07:12.006284 (+ 161us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:50662: token expired
Metrics: {"server-negotiator.queue_time_us":44}
W20260811 08:07:12.006462 1432 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:50662: token expired
W20260811 08:07:12.006678 809 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.15.36.254:32993)
I20260811 08:07:12.014302 1432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:12.006949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50666 (local address 127.15.36.254:32993)
0811 08:07:12.007025 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:12.007028 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:12.007037 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:07:12.007103 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:12.007104 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:12.007114 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:12.007162 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:07:12.007689 (+ 527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:12.008169 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:12.008915 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:12.009111 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:12.009187 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:12.010929 (+ 1742us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:07:12.010931 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:07:12.010931 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:07:12.010941 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:07:12.012840 (+ 1899us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:07:12.013292 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:07:12.013294 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:07:12.013294 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:07:12.013369 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:07:12.013604 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:07:12.013605 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:07:12.013606 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:07:12.013785 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:07:12.013921 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:12.014058 (+ 137us) server_negotiation.cc:299] Negotiation successful
0811 08:07:12.014167 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 08:07:12.015858 888 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50666:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:07:12.017676 888 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:07:12.020263 1031 tablet_service.cc:1467] Processing CreateTablet for tablet 8ad9a8d86684444396762767f2e2256e (DEFAULT_TABLE table=test-table [id=1cc05aeeb608474ca7f4bf752e9adb1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:07:12.020521 1031 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ad9a8d86684444396762767f2e2256e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:07:12.022315 985 tablet_bootstrap.cc:492] T 8ad9a8d86684444396762767f2e2256e P 4ad5179f7e1c41db9ba15fedad5fe751: Bootstrap starting.
I20260811 08:07:12.022681 985 tablet_bootstrap.cc:654] T 8ad9a8d86684444396762767f2e2256e P 4ad5179f7e1c41db9ba15fedad5fe751: Neither blocks nor log segments found. Creating new log.
I20260811 08:07:12.023838 985 tablet_bootstrap.cc:492] T 8ad9a8d86684444396762767f2e2256e P 4ad5179f7e1c41db9ba15fedad5fe751: No bootstrap required, opened a new log
I20260811 08:07:12.023909 985 ts_tablet_manager.cc:1397] T 8ad9a8d86684444396762767f2e2256e P 4ad5179f7e1c41db9ba15fedad5fe751: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 08:07:12.024053 985 raft_consensus.cc:348] T 8ad9a8d86684444396762767f2e2256e P 4ad5179f7e1c41db9ba15fedad5fe751 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de35f40802f14e4db0b11cf6d0ddb42c" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 41375 } } peers { permanent_uuid: "528d113641084072814e1638bbcc07bb" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 40471 } } peers { permanent_uuid: "4ad5179f7e1c41db9ba15fedad5fe751" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 46047 } }
I20260811 08:07:12.024142 985 raft_consensus.cc:374] T 8ad9a8d86684444396762767f2e2256e P 4ad5179f7e1c41db9ba15fedad5fe751 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:07:12.024221 985 raft_consensus.cc:729] T 8ad9a8d86684444396762767f2e2256e P 4ad5179f7e1c41db9ba15fedad5fe751 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ad5179f7e1c41db9ba15fedad5fe751, State: Initialized, Role: FOLLOWER
I20260811 08:07:12.024294 1434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:12.019916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.195:40471 (local address 127.0.0.1:58498)
0811 08:07:12.020038 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:12.020050 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:07:12.020115 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:07:12.020532 (+ 417us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:07:12.020533 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:07:12.020536 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:07:12.020614 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:12.020616 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:12.021819 (+ 1203us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:12.021820 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:12.022841 (+ 1021us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:12.022844 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:12.024027 (+ 1183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:12.024028 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:12.024105 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:12.024110 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 08:07:12.024147 (+ 37us) client_negotiation.cc:240] Negotiation successful
0811 08:07:12.024196 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":73,"threads_started":1}
I20260811 08:07:12.024276 985 consensus_queue.cc:260] T 8ad9a8d86684444396762767f2e2256e P 4ad5179f7e1c41db9ba15fedad5fe751 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de35f40802f14e4db0b11cf6d0ddb42c" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 41375 } } peers { permanent_uuid: "528d113641084072814e1638bbcc07bb" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 40471 } } peers { permanent_uuid: "4ad5179f7e1c41db9ba15fedad5fe751" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 46047 } }
I20260811 08:07:12.024405 985 ts_tablet_manager.cc:1428] T 8ad9a8d86684444396762767f2e2256e P 4ad5179f7e1c41db9ba15fedad5fe751: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:12.024459 1126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:12.019867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.194:41375 (local address 127.0.0.1:51582)
0811 08:07:12.019927 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:12.019940 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 08:07:12.019986 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:07:12.020884 (+ 898us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:07:12.020885 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:07:12.020886 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:07:12.020923 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:12.020925 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:12.022273 (+ 1348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:12.022274 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:12.023356 (+ 1082us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:12.023358 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:12.024190 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:12.024191 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:12.024266 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:12.024270 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:07:12.024324 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 08:07:12.024378 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260811 08:07:12.024677 1435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:12.020142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58498 (local address 127.15.36.195:40471)
0811 08:07:12.020354 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:12.020360 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:12.020372 (+ 12us) server_negotiation.cc:407] Connection header received
0811 08:07:12.020419 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:12.020421 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:12.020440 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:12.020535 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:07:12.020708 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:12.021731 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:12.022923 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:12.023905 (+ 982us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:12.024411 (+ 506us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:12.024489 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:12.024523 (+ 34us) server_negotiation.cc:299] Negotiation successful
0811 08:07:12.024571 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":96,"threads_started":1}
I20260811 08:07:12.024758 1436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:12.020118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51582 (local address 127.15.36.194:41375)
0811 08:07:12.020706 (+ 588us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:12.020711 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:12.020721 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:07:12.020762 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:12.020764 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:12.020780 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:12.020923 (+ 143us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:07:12.021017 (+ 94us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:12.022174 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:12.023423 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:12.024089 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:12.024187 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:12.024253 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:12.024618 (+ 365us) server_negotiation.cc:299] Negotiation successful
0811 08:07:12.024655 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":548,"thread_start_us":124,"threads_started":1}
I20260811 08:07:12.025476 1197 tablet_service.cc:1467] Processing CreateTablet for tablet 8ad9a8d86684444396762767f2e2256e (DEFAULT_TABLE table=test-table [id=1cc05aeeb608474ca7f4bf752e9adb1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:07:12.025471 1348 tablet_service.cc:1467] Processing CreateTablet for tablet 8ad9a8d86684444396762767f2e2256e (DEFAULT_TABLE table=test-table [id=1cc05aeeb608474ca7f4bf752e9adb1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:07:12.025786 1348 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ad9a8d86684444396762767f2e2256e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:07:12.025838 1197 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ad9a8d86684444396762767f2e2256e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:07:12.028911 1439 tablet_bootstrap.cc:492] T 8ad9a8d86684444396762767f2e2256e P de35f40802f14e4db0b11cf6d0ddb42c: Bootstrap starting.
I20260811 08:07:12.029130 1442 tablet_bootstrap.cc:492] T 8ad9a8d86684444396762767f2e2256e P 528d113641084072814e1638bbcc07bb: Bootstrap starting.
I20260811 08:07:12.029790 1442 tablet_bootstrap.cc:654] T 8ad9a8d86684444396762767f2e2256e P 528d113641084072814e1638bbcc07bb: Neither blocks nor log segments found. Creating new log.
I20260811 08:07:12.030253 1442 log.cc:824] T 8ad9a8d86684444396762767f2e2256e P 528d113641084072814e1638bbcc07bb: Log is configured to *not* fsync() on all Append() calls
I20260811 08:07:12.031189 1439 tablet_bootstrap.cc:654] T 8ad9a8d86684444396762767f2e2256e P de35f40802f14e4db0b11cf6d0ddb42c: Neither blocks nor log segments found. Creating new log.
I20260811 08:07:12.031250 1442 tablet_bootstrap.cc:492] T 8ad9a8d86684444396762767f2e2256e P 528d113641084072814e1638bbcc07bb: No bootstrap required, opened a new log
I20260811 08:07:12.031339 1442 ts_tablet_manager.cc:1397] T 8ad9a8d86684444396762767f2e2256e P 528d113641084072814e1638bbcc07bb: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 08:07:12.031764 1439 log.cc:824] T 8ad9a8d86684444396762767f2e2256e P de35f40802f14e4db0b11cf6d0ddb42c: Log is configured to *not* fsync() on all Append() calls
I20260811 08:07:12.032500 1439 tablet_bootstrap.cc:492] T 8ad9a8d86684444396762767f2e2256e P de35f40802f14e4db0b11cf6d0ddb42c: No bootstrap required, opened a new log
I20260811 08:07:12.032588 1439 ts_tablet_manager.cc:1397] T 8ad9a8d86684444396762767f2e2256e P de35f40802f14e4db0b11cf6d0ddb42c: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260811 08:07:12.033072 1442 raft_consensus.cc:348] T 8ad9a8d86684444396762767f2e2256e P 528d113641084072814e1638bbcc07bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de35f40802f14e4db0b11cf6d0ddb42c" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 41375 } } peers { permanent_uuid: "528d113641084072814e1638bbcc07bb" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 40471 } } peers { permanent_uuid: "4ad5179f7e1c41db9ba15fedad5fe751" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 46047 } }
I20260811 08:07:12.033233 1442 raft_consensus.cc:374] T 8ad9a8d86684444396762767f2e2256e P 528d113641084072814e1638bbcc07bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:07:12.033258 1442 raft_consensus.cc:729] T 8ad9a8d86684444396762767f2e2256e P 528d113641084072814e1638bbcc07bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 528d113641084072814e1638bbcc07bb, State: Initialized, Role: FOLLOWER
I20260811 08:07:12.033414 1442 consensus_queue.cc:260] T 8ad9a8d86684444396762767f2e2256e P 528d113641084072814e1638bbcc07bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de35f40802f14e4db0b11cf6d0ddb42c" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 41375 } } peers { permanent_uuid: "528d113641084072814e1638bbcc07bb" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 40471 } } peers { permanent_uuid: "4ad5179f7e1c41db9ba15fedad5fe751" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 46047 } }
I20260811 08:07:12.033747 1442 ts_tablet_manager.cc:1428] T 8ad9a8d86684444396762767f2e2256e P 528d113641084072814e1638bbcc07bb: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 08:07:12.033778 1426 heartbeater.cc:503] Master 127.15.36.254:32993 was elected leader, sending a full tablet report...
I20260811 08:07:12.034611 1439 raft_consensus.cc:348] T 8ad9a8d86684444396762767f2e2256e P de35f40802f14e4db0b11cf6d0ddb42c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de35f40802f14e4db0b11cf6d0ddb42c" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 41375 } } peers { permanent_uuid: "528d113641084072814e1638bbcc07bb" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 40471 } } peers { permanent_uuid: "4ad5179f7e1c41db9ba15fedad5fe751" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 46047 } }
I20260811 08:07:12.034807 1439 raft_consensus.cc:374] T 8ad9a8d86684444396762767f2e2256e P de35f40802f14e4db0b11cf6d0ddb42c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:07:12.034849 1439 raft_consensus.cc:729] T 8ad9a8d86684444396762767f2e2256e P de35f40802f14e4db0b11cf6d0ddb42c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de35f40802f14e4db0b11cf6d0ddb42c, State: Initialized, Role: FOLLOWER
I20260811 08:07:12.034956 1439 consensus_queue.cc:260] T 8ad9a8d86684444396762767f2e2256e P de35f40802f14e4db0b11cf6d0ddb42c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de35f40802f14e4db0b11cf6d0ddb42c" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 41375 } } peers { permanent_uuid: "528d113641084072814e1638bbcc07bb" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 40471 } } peers { permanent_uuid: "4ad5179f7e1c41db9ba15fedad5fe751" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 46047 } }
I20260811 08:07:12.035377 1439 ts_tablet_manager.cc:1428] T 8ad9a8d86684444396762767f2e2256e P de35f40802f14e4db0b11cf6d0ddb42c: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 08:07:12.035422 1271 heartbeater.cc:503] Master 127.15.36.254:32993 was elected leader, sending a full tablet report...
I20260811 08:07:12.087378 1447 raft_consensus.cc:482] T 8ad9a8d86684444396762767f2e2256e P de35f40802f14e4db0b11cf6d0ddb42c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:07:12.087514 1447 raft_consensus.cc:504] T 8ad9a8d86684444396762767f2e2256e P de35f40802f14e4db0b11cf6d0ddb42c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de35f40802f14e4db0b11cf6d0ddb42c" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 41375 } } peers { permanent_uuid: "528d113641084072814e1638bbcc07bb" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 40471 } } peers { permanent_uuid: "4ad5179f7e1c41db9ba15fedad5fe751" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 46047 } }
I20260811 08:07:12.087860 1447 leader_election.cc:288] T 8ad9a8d86684444396762767f2e2256e P de35f40802f14e4db0b11cf6d0ddb42c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 528d113641084072814e1638bbcc07bb (127.15.36.195:40471), 4ad5179f7e1c41db9ba15fedad5fe751 (127.15.36.193:46047)
I20260811 08:07:12.092506 1273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:12.088113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.195:40471 (local address 127.15.36.194:57145)
0811 08:07:12.088189 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:12.088204 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 08:07:12.088275 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:07:12.088599 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:07:12.088600 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:07:12.088601 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:07:12.088689 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:12.088691 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:12.089835 (+ 1144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:12.089836 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:12.091236 (+ 1400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:12.091241 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:12.092156 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:12.092157 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:12.092256 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:12.092258 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 08:07:12.092351 (+ 93us) client_negotiation.cc:240] Negotiation successful
0811 08:07:12.092385 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52,"mutex_wait_us":67}
I20260811 08:07:12.092535 1435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:12.088333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:57145 (local address 127.15.36.195:40471)
0811 08:07:12.088408 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:12.088409 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:12.088419 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:07:12.088470 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:12.088472 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:12.088483 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:12.088560 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:07:12.088867 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:12.089703 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:12.091392 (+ 1689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:12.092041 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:12.092131 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:12.092141 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:12.092390 (+ 249us) server_negotiation.cc:299] Negotiation successful
0811 08:07:12.092448 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 08:07:12.092535 1127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:12.088239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:40519 (local address 127.15.36.193:46047)
0811 08:07:12.088291 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:12.088293 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:12.088473 (+ 180us) server_negotiation.cc:407] Connection header received
0811 08:07:12.088506 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:12.088507 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:12.088517 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:12.088578 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:07:12.088807 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:12.089719 (+ 912us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:12.091389 (+ 1670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:12.092040 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:12.092131 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:12.092141 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:12.092391 (+ 250us) server_negotiation.cc:299] Negotiation successful
0811 08:07:12.092459 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 08:07:12.092520 1448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:12.088113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.193:46047 (local address 127.15.36.194:40519)
0811 08:07:12.088389 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:12.088405 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 08:07:12.088452 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:07:12.088599 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:07:12.088600 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:07:12.088601 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:07:12.088689 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:12.088691 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:12.089865 (+ 1174us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:12.089866 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:12.091236 (+ 1370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:12.091241 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:12.092156 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:12.092157 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:12.092251 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:12.092256 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 08:07:12.092325 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 08:07:12.092379 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":239,"mutex_wait_us":90,"thread_start_us":98,"threads_started":1}
W20260811 08:07:12.093122 1272 tablet.cc:2369] T 8ad9a8d86684444396762767f2e2256e P de35f40802f14e4db0b11cf6d0ddb42c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:07:12.093022 1371 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ad9a8d86684444396762767f2e2256e" candidate_uuid: "de35f40802f14e4db0b11cf6d0ddb42c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "528d113641084072814e1638bbcc07bb" is_pre_election: true
I20260811 08:07:12.093297 1371 raft_consensus.cc:2454] T 8ad9a8d86684444396762767f2e2256e P 528d113641084072814e1638bbcc07bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de35f40802f14e4db0b11cf6d0ddb42c in term 0.
I20260811 08:07:12.093253 1054 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ad9a8d86684444396762767f2e2256e" candidate_uuid: "de35f40802f14e4db0b11cf6d0ddb42c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ad5179f7e1c41db9ba15fedad5fe751" is_pre_election: true
I20260811 08:07:12.093441 1054 raft_consensus.cc:2454] T 8ad9a8d86684444396762767f2e2256e P 4ad5179f7e1c41db9ba15fedad5fe751 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de35f40802f14e4db0b11cf6d0ddb42c in term 0.
I20260811 08:07:12.093623 1150 leader_election.cc:302] T 8ad9a8d86684444396762767f2e2256e P de35f40802f14e4db0b11cf6d0ddb42c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 528d113641084072814e1638bbcc07bb, de35f40802f14e4db0b11cf6d0ddb42c; no voters:
I20260811 08:07:12.093838 1447 raft_consensus.cc:2781] T 8ad9a8d86684444396762767f2e2256e P de35f40802f14e4db0b11cf6d0ddb42c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:07:12.093940 1447 raft_consensus.cc:482] T 8ad9a8d86684444396762767f2e2256e P de35f40802f14e4db0b11cf6d0ddb42c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:07:12.093976 1447 raft_consensus.cc:3037] T 8ad9a8d86684444396762767f2e2256e P de35f40802f14e4db0b11cf6d0ddb42c [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:07:12.094913 1447 raft_consensus.cc:504] T 8ad9a8d86684444396762767f2e2256e P de35f40802f14e4db0b11cf6d0ddb42c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de35f40802f14e4db0b11cf6d0ddb42c" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 41375 } } peers { permanent_uuid: "528d113641084072814e1638bbcc07bb" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 40471 } } peers { permanent_uuid: "4ad5179f7e1c41db9ba15fedad5fe751" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 46047 } }
I20260811 08:07:12.095146 1447 leader_election.cc:288] T 8ad9a8d86684444396762767f2e2256e P de35f40802f14e4db0b11cf6d0ddb42c [CANDIDATE]: Term 1 election: Requested vote from peers 528d113641084072814e1638bbcc07bb (127.15.36.195:40471), 4ad5179f7e1c41db9ba15fedad5fe751 (127.15.36.193:46047)
I20260811 08:07:12.095381 1371 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ad9a8d86684444396762767f2e2256e" candidate_uuid: "de35f40802f14e4db0b11cf6d0ddb42c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "528d113641084072814e1638bbcc07bb"
I20260811 08:07:12.095474 1371 raft_consensus.cc:3037] T 8ad9a8d86684444396762767f2e2256e P 528d113641084072814e1638bbcc07bb [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:07:12.096282 1371 raft_consensus.cc:2454] T 8ad9a8d86684444396762767f2e2256e P 528d113641084072814e1638bbcc07bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de35f40802f14e4db0b11cf6d0ddb42c in term 1.
I20260811 08:07:12.096446 1054 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ad9a8d86684444396762767f2e2256e" candidate_uuid: "de35f40802f14e4db0b11cf6d0ddb42c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ad5179f7e1c41db9ba15fedad5fe751"
I20260811 08:07:12.096560 1054 raft_consensus.cc:3037] T 8ad9a8d86684444396762767f2e2256e P 4ad5179f7e1c41db9ba15fedad5fe751 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:07:12.096639 1150 leader_election.cc:302] T 8ad9a8d86684444396762767f2e2256e P de35f40802f14e4db0b11cf6d0ddb42c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 528d113641084072814e1638bbcc07bb, de35f40802f14e4db0b11cf6d0ddb42c; no voters:
I20260811 08:07:12.096773 1447 raft_consensus.cc:2781] T 8ad9a8d86684444396762767f2e2256e P de35f40802f14e4db0b11cf6d0ddb42c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:07:12.096984 1447 raft_consensus.cc:686] T 8ad9a8d86684444396762767f2e2256e P de35f40802f14e4db0b11cf6d0ddb42c [term 1 LEADER]: Becoming Leader. State: Replica: de35f40802f14e4db0b11cf6d0ddb42c, State: Running, Role: LEADER
I20260811 08:07:12.097090 1447 consensus_queue.cc:237] T 8ad9a8d86684444396762767f2e2256e P de35f40802f14e4db0b11cf6d0ddb42c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de35f40802f14e4db0b11cf6d0ddb42c" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 41375 } } peers { permanent_uuid: "528d113641084072814e1638bbcc07bb" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 40471 } } peers { permanent_uuid: "4ad5179f7e1c41db9ba15fedad5fe751" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 46047 } }
I20260811 08:07:12.097602 1054 raft_consensus.cc:2454] T 8ad9a8d86684444396762767f2e2256e P 4ad5179f7e1c41db9ba15fedad5fe751 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de35f40802f14e4db0b11cf6d0ddb42c in term 1.
I20260811 08:07:12.098038 887 catalog_manager.cc:5495] T 8ad9a8d86684444396762767f2e2256e P de35f40802f14e4db0b11cf6d0ddb42c reported cstate change: term changed from 0 to 1, leader changed from <none> to de35f40802f14e4db0b11cf6d0ddb42c (127.15.36.194). New cstate: current_term: 1 leader_uuid: "de35f40802f14e4db0b11cf6d0ddb42c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de35f40802f14e4db0b11cf6d0ddb42c" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "528d113641084072814e1638bbcc07bb" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 40471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ad5179f7e1c41db9ba15fedad5fe751" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 46047 } health_report { overall_health: UNKNOWN } } }
I20260811 08:07:12.120050 1436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:12.117505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51598 (local address 127.15.36.194:41375)
0811 08:07:12.117574 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:12.117576 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:12.117584 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:07:12.117625 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:12.117626 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:12.117668 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:12.117746 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:07:12.117902 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:12.118407 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:12.119205 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:12.119421 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:12.119497 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:12.119671 (+ 174us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:07:12.119790 (+ 119us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:07:12.119889 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:12.119910 (+ 21us) server_negotiation.cc:299] Negotiation successful
0811 08:07:12.119932 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 08:07:12.122486 1054 raft_consensus.cc:1261] T 8ad9a8d86684444396762767f2e2256e P 4ad5179f7e1c41db9ba15fedad5fe751 [term 1 FOLLOWER]: Refusing update from remote peer de35f40802f14e4db0b11cf6d0ddb42c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:07:12.122486 1371 raft_consensus.cc:1261] T 8ad9a8d86684444396762767f2e2256e P 528d113641084072814e1638bbcc07bb [term 1 FOLLOWER]: Refusing update from remote peer de35f40802f14e4db0b11cf6d0ddb42c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:07:12.122984 1447 consensus_queue.cc:1035] T 8ad9a8d86684444396762767f2e2256e P de35f40802f14e4db0b11cf6d0ddb42c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ad5179f7e1c41db9ba15fedad5fe751" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 46047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:07:12.123250 1449 consensus_queue.cc:1035] T 8ad9a8d86684444396762767f2e2256e P de35f40802f14e4db0b11cf6d0ddb42c [LEADER]: Connected to new peer: Peer: permanent_uuid: "528d113641084072814e1638bbcc07bb" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 40471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:07:12.125845 1451 mvcc.cc:205] Tried to move back new op lower bound from 7317240349169901568 to 7317240349070245888. Current Snapshot: MvccSnapshot[applied={T|T < 7317240349169901568}]
I20260811 08:07:12.129380 886 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50666:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:07:12.129513 886 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50666:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:07:12.130478 886 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 59497f3eef3b44289d9cb975538fd725: Sending DeleteTablet for 3 replicas of tablet 8ad9a8d86684444396762767f2e2256e
I20260811 08:07:12.130897 1031 tablet_service.cc:1514] Processing DeleteTablet for tablet 8ad9a8d86684444396762767f2e2256e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:07:12 UTC) from {username='kudu', principal='kudu/127.15.36.254@KRBTEST.COM'} at 127.0.0.1:54464
I20260811 08:07:12.130952 1348 tablet_service.cc:1514] Processing DeleteTablet for tablet 8ad9a8d86684444396762767f2e2256e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:07:12 UTC) from {username='kudu', principal='kudu/127.15.36.254@KRBTEST.COM'} at 127.0.0.1:58498
I20260811 08:07:12.131080 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 933
I20260811 08:07:12.131088 1197 tablet_service.cc:1514] Processing DeleteTablet for tablet 8ad9a8d86684444396762767f2e2256e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:07:12 UTC) from {username='kudu', principal='kudu/127.15.36.254@KRBTEST.COM'} at 127.0.0.1:51582
I20260811 08:07:12.131242 1129 tablet_replica.cc:330] T 8ad9a8d86684444396762767f2e2256e P 4ad5179f7e1c41db9ba15fedad5fe751: stopping tablet replica
I20260811 08:07:12.131312 1129 raft_consensus.cc:2229] T 8ad9a8d86684444396762767f2e2256e P 4ad5179f7e1c41db9ba15fedad5fe751 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:07:12.131387 1129 raft_consensus.cc:2258] T 8ad9a8d86684444396762767f2e2256e P 4ad5179f7e1c41db9ba15fedad5fe751 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:07:12.133174 1461 tablet_replica.cc:330] T 8ad9a8d86684444396762767f2e2256e P 528d113641084072814e1638bbcc07bb: stopping tablet replica
I20260811 08:07:12.133317 1461 raft_consensus.cc:2229] T 8ad9a8d86684444396762767f2e2256e P 528d113641084072814e1638bbcc07bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:07:12.133458 1461 raft_consensus.cc:2258] T 8ad9a8d86684444396762767f2e2256e P 528d113641084072814e1638bbcc07bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:07:12.134380 1461 ts_tablet_manager.cc:1905] T 8ad9a8d86684444396762767f2e2256e P 528d113641084072814e1638bbcc07bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:07:12.134753 1462 tablet_replica.cc:330] T 8ad9a8d86684444396762767f2e2256e P de35f40802f14e4db0b11cf6d0ddb42c: stopping tablet replica
I20260811 08:07:12.134912 1462 raft_consensus.cc:2229] T 8ad9a8d86684444396762767f2e2256e P de35f40802f14e4db0b11cf6d0ddb42c [term 1 LEADER]: Raft consensus shutting down.
I20260811 08:07:12.135126 1462 raft_consensus.cc:2258] T 8ad9a8d86684444396762767f2e2256e P de35f40802f14e4db0b11cf6d0ddb42c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:07:12.135955 1462 ts_tablet_manager.cc:1905] T 8ad9a8d86684444396762767f2e2256e P de35f40802f14e4db0b11cf6d0ddb42c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:07:12.137341 1461 ts_tablet_manager.cc:1918] T 8ad9a8d86684444396762767f2e2256e P 528d113641084072814e1638bbcc07bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:07:12.137535 1461 log.cc:1196] T 8ad9a8d86684444396762767f2e2256e P 528d113641084072814e1638bbcc07bb: Deleting WAL directory at /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-2/wal/wals/8ad9a8d86684444396762767f2e2256e
I20260811 08:07:12.138137 1461 ts_tablet_manager.cc:1939] T 8ad9a8d86684444396762767f2e2256e P 528d113641084072814e1638bbcc07bb: Deleting consensus metadata
I20260811 08:07:12.138214 1462 ts_tablet_manager.cc:1918] T 8ad9a8d86684444396762767f2e2256e P de35f40802f14e4db0b11cf6d0ddb42c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:07:12.138415 1462 log.cc:1196] T 8ad9a8d86684444396762767f2e2256e P de35f40802f14e4db0b11cf6d0ddb42c: Deleting WAL directory at /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-1/wal/wals/8ad9a8d86684444396762767f2e2256e
I20260811 08:07:12.138940 1462 ts_tablet_manager.cc:1939] T 8ad9a8d86684444396762767f2e2256e P de35f40802f14e4db0b11cf6d0ddb42c: Deleting consensus metadata
I20260811 08:07:12.138906 874 catalog_manager.cc:4841] TS 528d113641084072814e1638bbcc07bb (127.15.36.195:40471): tablet 8ad9a8d86684444396762767f2e2256e (table test-table [id=1cc05aeeb608474ca7f4bf752e9adb1d]) successfully deleted
I20260811 08:07:12.139575 875 catalog_manager.cc:4841] TS de35f40802f14e4db0b11cf6d0ddb42c (127.15.36.194:41375): tablet 8ad9a8d86684444396762767f2e2256e (table test-table [id=1cc05aeeb608474ca7f4bf752e9adb1d]) successfully deleted
W20260811 08:07:12.148689 875 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.36.193:46047 (error 108)
I20260811 08:07:12.149147 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 1124
I20260811 08:07:12.149443 1126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:12.149294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.193:46047 (local address 127.0.0.1:54466)
0811 08:07:12.149350 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:12.149395 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.193:46047: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260811 08:07:12.149667 875 catalog_manager.cc:4584] TS 4ad5179f7e1c41db9ba15fedad5fe751 (127.15.36.193:46047): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8ad9a8d86684444396762767f2e2256e: Network error: Client connection negotiation failed: client connection to 127.15.36.193:46047: connect: Connection refused (error 111)
I20260811 08:07:12.157578 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 1274
I20260811 08:07:12.169226 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 854
I20260811 08:07:32.180603 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:32993
--webserver_interface=127.15.36.254
--webserver_port=37861
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=kudu/127.15.36.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:46213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.36.254:32993
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:07:32.265812 1464 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:07:32.266101 1464 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:07:32.266147 1464 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:07:32.267367 1464 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 08:07:32.267417 1464 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 08:07:32.267431 1464 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 08:07:32.267442 1464 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:07:32.267455 1464 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:07:32.267468 1464 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:07:32.267480 1464 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:07:32.267493 1464 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:07:32.268966 1464 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:46213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.15.36.254:32993
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=kudu/127.15.36.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:32993
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.36.254
--webserver_port=37861
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1464
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:07:32.269181 1464 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:07:32.269364 1464 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:07:32.275079 1474 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:07:32.275094 1472 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:07:32.275079 1471 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:07:32.275573 1464 server_base.cc:1034] running on GCE node
I20260811 08:07:32.275960 1464 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:07:32.276412 1464 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:07:32.277583 1464 hybrid_clock.cc:648] HybridClock initialized: now 1786435652277560 us; error 56 us; skew 500 ppm
Aug 11 08:07:32 dist-test-slave-2w3w krb5kdc[32689](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435652, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:07:32.281220 1464 init.cc:377] Logged in from keytab as kudu/127.15.36.254@KRBTEST.COM (short username kudu)
I20260811 08:07:32.281901 1464 webserver.cc:460] Webserver started at http://127.15.36.254:37861/ using document root <none> and password file <none>
I20260811 08:07:32.282213 1464 fs_manager.cc:359] Metadata directory not provided
I20260811 08:07:32.282298 1464 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:07:32.284512 1464 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:07:32.285534 1483 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:32.285772 1464 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:07:32.285885 1464 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/master-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/master-0/wal
uuid: "59497f3eef3b44289d9cb975538fd725"
format_stamp: "Formatted at 2026-08-11 08:06:50 on dist-test-slave-2w3w"
server_key: "8cdcd2e73eace78475125e5bd94e0082"
server_key_iv: "48aee35c36bf873ec1dd367e3b738377"
server_key_version: "encryptionkey@0"
I20260811 08:07:32.286329 1464 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:07:32.301011 1464 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:07:32.304507 1464 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:07:32.304711 1464 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:07:32.310851 1464 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.254:32993
I20260811 08:07:32.310904 1542 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.254:32993 every 8 connection(s)
I20260811 08:07:32.311515 1464 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
I20260811 08:07:32.314152 1543 sys_catalog.cc:263] Verifying existing consensus state
I20260811 08:07:32.315485 1543 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 59497f3eef3b44289d9cb975538fd725: Bootstrap starting.
I20260811 08:07:32.317226 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 1464
I20260811 08:07:32.317605 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.193:46047
--local_ip_for_outbound_sockets=127.15.36.193
--tserver_master_addrs=127.15.36.254:32993
--webserver_port=42621
--webserver_interface=127.15.36.193
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab
--principal=kudu/127.15.36.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:46213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 08:07:32.326841 1543 log.cc:824] T 00000000000000000000000000000000 P 59497f3eef3b44289d9cb975538fd725: Log is configured to *not* fsync() on all Append() calls
I20260811 08:07:32.330894 1543 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 59497f3eef3b44289d9cb975538fd725: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 08:07:32.331463 1543 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 59497f3eef3b44289d9cb975538fd725: Bootstrap complete.
I20260811 08:07:32.336153 1543 raft_consensus.cc:348] T 00000000000000000000000000000000 P 59497f3eef3b44289d9cb975538fd725 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59497f3eef3b44289d9cb975538fd725" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 32993 } }
I20260811 08:07:32.336562 1543 raft_consensus.cc:729] T 00000000000000000000000000000000 P 59497f3eef3b44289d9cb975538fd725 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59497f3eef3b44289d9cb975538fd725, State: Initialized, Role: FOLLOWER
I20260811 08:07:32.336755 1543 consensus_queue.cc:260] T 00000000000000000000000000000000 P 59497f3eef3b44289d9cb975538fd725 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59497f3eef3b44289d9cb975538fd725" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 32993 } }
I20260811 08:07:32.336848 1543 raft_consensus.cc:388] T 00000000000000000000000000000000 P 59497f3eef3b44289d9cb975538fd725 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:07:32.336886 1543 raft_consensus.cc:482] T 00000000000000000000000000000000 P 59497f3eef3b44289d9cb975538fd725 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:07:32.336956 1543 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 59497f3eef3b44289d9cb975538fd725 [term 2 FOLLOWER]: Advancing to term 3
I20260811 08:07:32.338168 1543 raft_consensus.cc:504] T 00000000000000000000000000000000 P 59497f3eef3b44289d9cb975538fd725 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59497f3eef3b44289d9cb975538fd725" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 32993 } }
I20260811 08:07:32.338322 1543 leader_election.cc:302] T 00000000000000000000000000000000 P 59497f3eef3b44289d9cb975538fd725 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 59497f3eef3b44289d9cb975538fd725; no voters:
I20260811 08:07:32.338585 1543 leader_election.cc:288] T 00000000000000000000000000000000 P 59497f3eef3b44289d9cb975538fd725 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260811 08:07:32.338634 1547 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 59497f3eef3b44289d9cb975538fd725 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 08:07:32.338775 1547 raft_consensus.cc:686] T 00000000000000000000000000000000 P 59497f3eef3b44289d9cb975538fd725 [term 3 LEADER]: Becoming Leader. State: Replica: 59497f3eef3b44289d9cb975538fd725, State: Running, Role: LEADER
I20260811 08:07:32.338908 1543 sys_catalog.cc:564] T 00000000000000000000000000000000 P 59497f3eef3b44289d9cb975538fd725 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:07:32.338888 1547 consensus_queue.cc:237] T 00000000000000000000000000000000 P 59497f3eef3b44289d9cb975538fd725 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59497f3eef3b44289d9cb975538fd725" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 32993 } }
I20260811 08:07:32.339282 1547 sys_catalog.cc:455] T 00000000000000000000000000000000 P 59497f3eef3b44289d9cb975538fd725 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 59497f3eef3b44289d9cb975538fd725. Latest consensus state: current_term: 3 leader_uuid: "59497f3eef3b44289d9cb975538fd725" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59497f3eef3b44289d9cb975538fd725" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 32993 } } }
I20260811 08:07:32.339395 1547 sys_catalog.cc:458] T 00000000000000000000000000000000 P 59497f3eef3b44289d9cb975538fd725 [sys.catalog]: This master's current role is: LEADER
I20260811 08:07:32.339289 1548 sys_catalog.cc:455] T 00000000000000000000000000000000 P 59497f3eef3b44289d9cb975538fd725 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "59497f3eef3b44289d9cb975538fd725" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59497f3eef3b44289d9cb975538fd725" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 32993 } } }
I20260811 08:07:32.339581 1548 sys_catalog.cc:458] T 00000000000000000000000000000000 P 59497f3eef3b44289d9cb975538fd725 [sys.catalog]: This master's current role is: LEADER
I20260811 08:07:32.339771 1552 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:07:32.341048 1552 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:07:32.341439 1552 catalog_manager.cc:1259] Loaded cluster ID: 921fa01da16f4ebea41371c62cf5c12a
I20260811 08:07:32.341523 1552 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:07:32.343125 1552 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:07:32.343415 1552 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 59497f3eef3b44289d9cb975538fd725: Loaded TSK: 0
I20260811 08:07:32.343528 1552 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 59497f3eef3b44289d9cb975538fd725: Loaded TSK: 1
F20260811 08:07:32.343895 1552 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fd0f32ca9ad google::LogMessage::Fail() at ??:0
@ 0x7fd0f32cd88a google::LogMessage::SendToLog() at ??:0
@ 0x7fd0f32ca4de google::LogMessage::Flush() at ??:0
@ 0x7fd0f32cba19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fd0f5a37104 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7fd0f5a34d41 kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7fd0fb2281cd kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7fd0fb22848e kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7fd0fb228594 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7fd0fb1eec48 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7fd0fb1f8ad0 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fd0f51980d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fd0f518d954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fd0f5ff16db start_thread at ??:0
@ 0x7fd0f1dc861f clone at ??:0
W20260811 08:07:32.440800 1545 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:07:32.441012 1545 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:07:32.441039 1545 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:07:32.442260 1545 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:07:32.442306 1545 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:07:32.442335 1545 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.193
I20260811 08:07:32.443955 1545 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:46213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab
--principal=kudu/127.15.36.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.193:46047
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.36.193
--webserver_port=42621
--tserver_master_addrs=127.15.36.254:32993
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1545
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.193
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:07:32.444236 1545 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:07:32.444555 1545 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 08:07:32.450295 1545 server_base.cc:1034] running on GCE node
W20260811 08:07:32.450214 1590 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:07:32.450366 1589 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:07:32.450241 1592 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:07:32.450728 1545 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:07:32.451048 1545 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:07:32.452211 1545 hybrid_clock.cc:648] HybridClock initialized: now 1786435652452197 us; error 30 us; skew 500 ppm
Aug 11 08:07:32 dist-test-slave-2w3w krb5kdc[32689](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435652, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:07:32.455583 1545 init.cc:377] Logged in from keytab as kudu/127.15.36.193@KRBTEST.COM (short username kudu)
I20260811 08:07:32.456132 1545 webserver.cc:460] Webserver started at http://127.15.36.193:42621/ using document root <none> and password file <none>
I20260811 08:07:32.456434 1545 fs_manager.cc:359] Metadata directory not provided
I20260811 08:07:32.456501 1545 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:07:32.458341 1545 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 08:07:32.459167 1600 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:32.459388 1545 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:07:32.459491 1545 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-0/wal
uuid: "4ad5179f7e1c41db9ba15fedad5fe751"
format_stamp: "Formatted at 2026-08-11 08:06:50 on dist-test-slave-2w3w"
server_key: "8e1b2d781d07ae713de3f7d64fc22e4c"
server_key_iv: "7fd4fa3ee73e6959ad25572f8c9a8635"
server_key_version: "encryptionkey@0"
I20260811 08:07:32.459959 1545 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:07:32.481055 1545 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:07:32.483582 1545 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:07:32.483762 1545 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:07:32.484004 1545 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:07:32.484483 1610 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 08:07:32.486569 1545 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 08:07:32.486654 1545 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260811 08:07:32.486706 1545 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 08:07:32.487490 1545 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 08:07:32.487553 1545 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260811 08:07:32.487627 1610 tablet_bootstrap.cc:492] T 8ad9a8d86684444396762767f2e2256e P 4ad5179f7e1c41db9ba15fedad5fe751: Bootstrap starting.
I20260811 08:07:32.494611 1545 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.193:46047
I20260811 08:07:32.495121 1545 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
I20260811 08:07:32.495359 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 1545
I20260811 08:07:32.495683 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.194:41375
--local_ip_for_outbound_sockets=127.15.36.194
--tserver_master_addrs=127.15.36.254:32993
--webserver_port=45485
--webserver_interface=127.15.36.194
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab
--principal=kudu/127.15.36.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:46213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 08:07:32.499625 1610 log.cc:824] T 8ad9a8d86684444396762767f2e2256e P 4ad5179f7e1c41db9ba15fedad5fe751: Log is configured to *not* fsync() on all Append() calls
I20260811 08:07:32.500018 1729 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.193:46047 every 8 connection(s)
I20260811 08:07:32.502602 1610 tablet_bootstrap.cc:492] T 8ad9a8d86684444396762767f2e2256e P 4ad5179f7e1c41db9ba15fedad5fe751: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 08:07:32.502997 1610 tablet_bootstrap.cc:492] T 8ad9a8d86684444396762767f2e2256e P 4ad5179f7e1c41db9ba15fedad5fe751: Bootstrap complete.
I20260811 08:07:32.504356 1610 ts_tablet_manager.cc:1397] T 8ad9a8d86684444396762767f2e2256e P 4ad5179f7e1c41db9ba15fedad5fe751: Time spent bootstrapping tablet: real 0.017s user 0.007s sys 0.007s
I20260811 08:07:32.505875 1610 raft_consensus.cc:348] T 8ad9a8d86684444396762767f2e2256e P 4ad5179f7e1c41db9ba15fedad5fe751 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de35f40802f14e4db0b11cf6d0ddb42c" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 41375 } } peers { permanent_uuid: "528d113641084072814e1638bbcc07bb" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 40471 } } peers { permanent_uuid: "4ad5179f7e1c41db9ba15fedad5fe751" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 46047 } }
I20260811 08:07:32.506213 1610 raft_consensus.cc:729] T 8ad9a8d86684444396762767f2e2256e P 4ad5179f7e1c41db9ba15fedad5fe751 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ad5179f7e1c41db9ba15fedad5fe751, State: Initialized, Role: FOLLOWER
I20260811 08:07:32.506398 1610 consensus_queue.cc:260] T 8ad9a8d86684444396762767f2e2256e P 4ad5179f7e1c41db9ba15fedad5fe751 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de35f40802f14e4db0b11cf6d0ddb42c" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 41375 } } peers { permanent_uuid: "528d113641084072814e1638bbcc07bb" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 40471 } } peers { permanent_uuid: "4ad5179f7e1c41db9ba15fedad5fe751" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 46047 } }
I20260811 08:07:32.506716 1610 ts_tablet_manager.cc:1428] T 8ad9a8d86684444396762767f2e2256e P 4ad5179f7e1c41db9ba15fedad5fe751: Time spent starting tablet: real 0.002s user 0.001s sys 0.003s
W20260811 08:07:32.576573 1733 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:07:32.498511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32993 (local address 127.15.36.193:33527)
0811 08:07:32.498713 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:32.498760 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 08:07:32.499543 (+ 783us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:07:32.576361 (+ 76818us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:32993: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":124,"threads_started":1}
W20260811 08:07:32.576869 1730 heartbeater.cc:644] Failed to heartbeat to 127.15.36.254:32993 (0 consecutive failures): Network error: Failed to ping master at 127.15.36.254:32993: Client connection negotiation failed: client connection to 127.15.36.254:32993: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 08:07:32.577277 1733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:32.577150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32993 (local address 127.15.36.193:56917)
0811 08:07:32.577208 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:32.577257 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:32993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260811 08:07:32.577745 1733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:32.577601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32993 (local address 127.15.36.193:43305)
0811 08:07:32.577688 (+ 87us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:32.577722 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:32993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260811 08:07:32.578045 1730 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 08:07:32.589756 1732 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:07:32.589996 1732 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:07:32.590023 1732 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:07:32.591318 1732 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:07:32.591368 1732 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:07:32.591398 1732 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.194
I20260811 08:07:32.592945 1732 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:46213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab
--principal=kudu/127.15.36.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.194:41375
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.36.194
--webserver_port=45485
--tserver_master_addrs=127.15.36.254:32993
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1732
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.194
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:07:32.593209 1732 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:07:32.593474 1732 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:07:32.598742 1741 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:07:32.598771 1743 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:07:32.598821 1740 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:07:32.598937 1732 server_base.cc:1034] running on GCE node
I20260811 08:07:32.599207 1732 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:07:32.599504 1732 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:07:32.600675 1732 hybrid_clock.cc:648] HybridClock initialized: now 1786435652600666 us; error 48 us; skew 500 ppm
Aug 11 08:07:32 dist-test-slave-2w3w krb5kdc[32689](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435652, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:07:32.603441 1732 init.cc:377] Logged in from keytab as kudu/127.15.36.194@KRBTEST.COM (short username kudu)
I20260811 08:07:32.603847 1732 webserver.cc:460] Webserver started at http://127.15.36.194:45485/ using document root <none> and password file <none>
I20260811 08:07:32.604045 1732 fs_manager.cc:359] Metadata directory not provided
I20260811 08:07:32.604089 1732 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:07:32.605500 1732 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:07:32.606149 1751 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:32.606354 1732 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:07:32.606431 1732 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-1/wal
uuid: "de35f40802f14e4db0b11cf6d0ddb42c"
format_stamp: "Formatted at 2026-08-11 08:06:50 on dist-test-slave-2w3w"
server_key: "3a2414ce379f80403270a1eb8f02f41a"
server_key_iv: "98f3ae556d7c9b8e6601fb9d88ccd9d8"
server_key_version: "encryptionkey@0"
I20260811 08:07:32.606818 1732 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:07:32.618374 1732 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:07:32.620914 1732 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:07:32.621076 1732 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:07:32.621356 1732 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:07:32.621688 1732 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:07:32.621724 1732 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:32.621748 1732 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:07:32.621762 1732 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:32.628095 1732 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.194:41375
I20260811 08:07:32.628196 1875 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.194:41375 every 8 connection(s)
I20260811 08:07:32.628567 1732 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
I20260811 08:07:32.629768 1878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:32.629348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32993 (local address 127.15.36.194:54415)
0811 08:07:32.629543 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:32.629620 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:32993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":92,"threads_started":1}
W20260811 08:07:32.630246 1876 heartbeater.cc:644] Failed to heartbeat to 127.15.36.254:32993 (0 consecutive failures): Network error: Failed to ping master at 127.15.36.254:32993: Client connection negotiation failed: client connection to 127.15.36.254:32993: connect: Connection refused (error 111)
I20260811 08:07:32.630570 1878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:32.630459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32993 (local address 127.15.36.194:57695)
0811 08:07:32.630513 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:32.630547 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:32993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260811 08:07:32.630896 1878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:32.630807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32993 (local address 127.15.36.194:34869)
0811 08:07:32.630853 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:32.630879 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:32993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260811 08:07:32.631098 1876 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 08:07:32.633214 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 1732
I20260811 08:07:32.633533 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.195:40471
--local_ip_for_outbound_sockets=127.15.36.195
--tserver_master_addrs=127.15.36.254:32993
--webserver_port=38945
--webserver_interface=127.15.36.195
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab
--principal=kudu/127.15.36.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:46213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:07:32.721834 1880 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:07:32.722084 1880 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:07:32.722112 1880 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:07:32.723402 1880 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:07:32.723456 1880 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:07:32.723486 1880 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.195
I20260811 08:07:32.725063 1880 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:46213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab
--principal=kudu/127.15.36.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.195:40471
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.36.195
--webserver_port=38945
--tserver_master_addrs=127.15.36.254:32993
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1880
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.195
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:07:32.725363 1880 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:07:32.725638 1880 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:07:32.731210 1888 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:07:32.731196 1886 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:07:32.731196 1885 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:07:32.731572 1880 server_base.cc:1034] running on GCE node
I20260811 08:07:32.731796 1880 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:07:32.732061 1880 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:07:32.733258 1880 hybrid_clock.cc:648] HybridClock initialized: now 1786435652733218 us; error 36 us; skew 500 ppm
Aug 11 08:07:32 dist-test-slave-2w3w krb5kdc[32689](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435652, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:07:32.736203 1880 init.cc:377] Logged in from keytab as kudu/127.15.36.195@KRBTEST.COM (short username kudu)
I20260811 08:07:32.736752 1880 webserver.cc:460] Webserver started at http://127.15.36.195:38945/ using document root <none> and password file <none>
I20260811 08:07:32.736996 1880 fs_manager.cc:359] Metadata directory not provided
I20260811 08:07:32.737056 1880 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:07:32.738653 1880 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 08:07:32.739568 1896 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:32.740018 1880 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 08:07:32.740140 1880 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-2/wal
uuid: "528d113641084072814e1638bbcc07bb"
format_stamp: "Formatted at 2026-08-11 08:06:51 on dist-test-slave-2w3w"
server_key: "48efad997a8bc24d4401c870d6d3bdcd"
server_key_iv: "611d2d98decc2dddda41bcbd68d52a7c"
server_key_version: "encryptionkey@0"
I20260811 08:07:32.740540 1880 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:07:32.748214 1880 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:07:32.750793 1880 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:07:32.750941 1880 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:07:32.751252 1880 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:07:32.751554 1880 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:07:32.751587 1880 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:32.751611 1880 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:07:32.751624 1880 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:32.758157 1880 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.195:40471
I20260811 08:07:32.758216 2025 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.195:40471 every 8 connection(s)
I20260811 08:07:32.758630 1880 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
I20260811 08:07:32.759857 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 1880
I20260811 08:07:32.760175 2029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:32.759414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32993 (local address 127.15.36.195:45161)
0811 08:07:32.759590 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:32.759670 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:32993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":84,"threads_started":1}
W20260811 08:07:32.760466 2026 heartbeater.cc:644] Failed to heartbeat to 127.15.36.254:32993 (0 consecutive failures): Network error: Failed to ping master at 127.15.36.254:32993: Client connection negotiation failed: client connection to 127.15.36.254:32993: connect: Connection refused (error 111)
I20260811 08:07:32.760782 2029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:32.760669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32993 (local address 127.15.36.195:59267)
0811 08:07:32.760721 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:32.760753 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:32993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260811 08:07:32.761124 2029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:32.761004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32993 (local address 127.15.36.195:45503)
0811 08:07:32.761073 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:32.761103 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:32993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260811 08:07:32.761277 2026 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 08:07:33.578817 2031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:33.578527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32993 (local address 127.15.36.193:58171)
0811 08:07:33.578694 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:33.578745 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:32993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":75,"threads_started":1}
I20260811 08:07:33.631831 2032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:33.631516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32993 (local address 127.15.36.194:38403)
0811 08:07:33.631663 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:33.631714 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:32993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":65,"threads_started":1}
I20260811 08:07:33.761921 2033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:33.761663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32993 (local address 127.15.36.195:40977)
0811 08:07:33.761814 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:33.761864 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:32993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":67,"threads_started":1}
I20260811 08:07:34.296460 2034 raft_consensus.cc:482] T 8ad9a8d86684444396762767f2e2256e P 4ad5179f7e1c41db9ba15fedad5fe751 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:07:34.296607 2034 raft_consensus.cc:504] T 8ad9a8d86684444396762767f2e2256e P 4ad5179f7e1c41db9ba15fedad5fe751 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de35f40802f14e4db0b11cf6d0ddb42c" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 41375 } } peers { permanent_uuid: "528d113641084072814e1638bbcc07bb" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 40471 } } peers { permanent_uuid: "4ad5179f7e1c41db9ba15fedad5fe751" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 46047 } }
I20260811 08:07:34.297107 2034 leader_election.cc:288] T 8ad9a8d86684444396762767f2e2256e P 4ad5179f7e1c41db9ba15fedad5fe751 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers de35f40802f14e4db0b11cf6d0ddb42c (127.15.36.194:41375), 528d113641084072814e1638bbcc07bb (127.15.36.195:40471)
Aug 11 08:07:34 dist-test-slave-2w3w krb5kdc[32689](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435652, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.193@KRBTEST.COM for kudu/127.15.36.194@KRBTEST.COM
Aug 11 08:07:34 dist-test-slave-2w3w krb5kdc[32689](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435652, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.193@KRBTEST.COM for kudu/127.15.36.195@KRBTEST.COM
I20260811 08:07:34.309016 2036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:34.297390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.195:40471 (local address 127.15.36.193:58343)
0811 08:07:34.297547 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:34.297561 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 08:07:34.297633 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:07:34.298589 (+ 956us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:07:34.298592 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:07:34.299071 (+ 479us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:07:34.299295 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:34.299303 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:34.300560 (+ 1257us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:34.300562 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:34.301442 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:34.301444 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:34.302138 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:34.302139 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:34.302226 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:34.303016 (+ 790us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:07:34.303021 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:07:34.305094 (+ 2073us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:07:34.307342 (+ 2248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:07:34.307344 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:07:34.307344 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:07:34.307540 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:07:34.307820 (+ 280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:07:34.307821 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:07:34.307821 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:07:34.307892 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:07:34.308417 (+ 525us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:07:34.308430 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:07:34.308581 (+ 151us) client_negotiation.cc:769] Sending connection context
0811 08:07:34.308692 (+ 111us) client_negotiation.cc:240] Negotiation successful
0811 08:07:34.308939 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"mutex_wait_us":4,"thread_start_us":86,"threads_started":1}
I20260811 08:07:34.309059 2038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:34.297511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:39865 (local address 127.15.36.194:41375)
0811 08:07:34.297708 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:34.297720 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:34.297943 (+ 223us) server_negotiation.cc:407] Connection header received
0811 08:07:34.298381 (+ 438us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:34.298383 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:34.298429 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:34.298583 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:07:34.299473 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:34.300494 (+ 1021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:34.301560 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:34.301997 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:34.302122 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:34.304871 (+ 2749us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:07:34.304877 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:07:34.304878 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:07:34.304892 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:07:34.306982 (+ 2090us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:07:34.307513 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:07:34.307517 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:07:34.307518 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:07:34.307626 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:07:34.307906 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:07:34.307907 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:07:34.307907 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:07:34.308249 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:07:34.308361 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:34.308758 (+ 397us) server_negotiation.cc:299] Negotiation successful
0811 08:07:34.308908 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":68,"threads_started":1}
I20260811 08:07:34.309139 2035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:34.297398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.194:41375 (local address 127.15.36.193:39865)
0811 08:07:34.297758 (+ 360us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:34.297770 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:07:34.297860 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:07:34.298589 (+ 729us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:07:34.298592 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:07:34.299153 (+ 561us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:07:34.299296 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:34.299303 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:34.300611 (+ 1308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:34.300612 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:34.301441 (+ 829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:34.301444 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:34.302110 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:34.302111 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:34.302225 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:34.302897 (+ 672us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:07:34.302905 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:07:34.304657 (+ 1752us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:07:34.307134 (+ 2477us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:07:34.307146 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:07:34.307148 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:07:34.307406 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:07:34.307696 (+ 290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:07:34.307697 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:07:34.307698 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:07:34.307827 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:07:34.308448 (+ 621us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:07:34.308466 (+ 18us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:07:34.308581 (+ 115us) client_negotiation.cc:769] Sending connection context
0811 08:07:34.308694 (+ 113us) client_negotiation.cc:240] Negotiation successful
0811 08:07:34.309029 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":344,"mutex_wait_us":286,"thread_start_us":53,"threads_started":1}
I20260811 08:07:34.309566 2037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:34.297516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:58343 (local address 127.15.36.195:40471)
0811 08:07:34.297738 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:34.297750 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:34.297777 (+ 27us) server_negotiation.cc:407] Connection header received
0811 08:07:34.298294 (+ 517us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:34.298297 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:34.298352 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:34.298542 (+ 190us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:07:34.299458 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:34.300437 (+ 979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:34.301549 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:34.302031 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:34.302177 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:34.305236 (+ 3059us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:07:34.305241 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:07:34.305241 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:07:34.305252 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:07:34.307210 (+ 1958us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:07:34.307634 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:07:34.307637 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:07:34.307638 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:07:34.307739 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:07:34.307965 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:07:34.307966 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:07:34.307966 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:07:34.308280 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:07:34.308363 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:34.309283 (+ 920us) server_negotiation.cc:299] Negotiation successful
0811 08:07:34.309450 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":55,"threads_started":1}
W20260811 08:07:34.310027 1606 leader_election.cc:341] T 8ad9a8d86684444396762767f2e2256e P 4ad5179f7e1c41db9ba15fedad5fe751 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer de35f40802f14e4db0b11cf6d0ddb42c (127.15.36.194:41375): Not found: Tablet not found: 8ad9a8d86684444396762767f2e2256e
W20260811 08:07:34.310266 1604 leader_election.cc:341] T 8ad9a8d86684444396762767f2e2256e P 4ad5179f7e1c41db9ba15fedad5fe751 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 528d113641084072814e1638bbcc07bb (127.15.36.195:40471): Not found: Tablet not found: 8ad9a8d86684444396762767f2e2256e
I20260811 08:07:34.310331 1604 leader_election.cc:302] T 8ad9a8d86684444396762767f2e2256e P 4ad5179f7e1c41db9ba15fedad5fe751 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ad5179f7e1c41db9ba15fedad5fe751; no voters: 528d113641084072814e1638bbcc07bb, de35f40802f14e4db0b11cf6d0ddb42c
I20260811 08:07:34.310496 2034 raft_consensus.cc:2726] T 8ad9a8d86684444396762767f2e2256e P 4ad5179f7e1c41db9ba15fedad5fe751 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 08:07:34.579707 2035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:34.579522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32993 (local address 127.15.36.193:40155)
0811 08:07:34.579616 (+ 94us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:34.579665 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:32993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260811 08:07:34.632784 2039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:34.632485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32993 (local address 127.15.36.194:59225)
0811 08:07:34.632654 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:34.632726 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:32993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":88,"threads_started":1}
I20260811 08:07:34.762784 2040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:34.762498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32993 (local address 127.15.36.195:44849)
0811 08:07:34.762663 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:34.762726 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:32993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":70,"threads_started":1}
I20260811 08:07:35.580754 2041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:35.580464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32993 (local address 127.15.36.193:41069)
0811 08:07:35.580666 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:35.580705 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:32993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":111,"threads_started":1}
I20260811 08:07:35.633715 2043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:35.633393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32993 (local address 127.15.36.194:59759)
0811 08:07:35.633618 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:35.633666 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:32993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":109,"threads_started":1}
I20260811 08:07:35.763667 2045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:35.763419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32993 (local address 127.15.36.195:49745)
0811 08:07:35.763553 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:35.763596 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:32993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":65,"threads_started":1}
I20260811 08:07:36.436748 2047 raft_consensus.cc:482] T 8ad9a8d86684444396762767f2e2256e P 4ad5179f7e1c41db9ba15fedad5fe751 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:07:36.436870 2047 raft_consensus.cc:504] T 8ad9a8d86684444396762767f2e2256e P 4ad5179f7e1c41db9ba15fedad5fe751 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de35f40802f14e4db0b11cf6d0ddb42c" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 41375 } } peers { permanent_uuid: "528d113641084072814e1638bbcc07bb" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 40471 } } peers { permanent_uuid: "4ad5179f7e1c41db9ba15fedad5fe751" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 46047 } }
I20260811 08:07:36.437114 2047 leader_election.cc:288] T 8ad9a8d86684444396762767f2e2256e P 4ad5179f7e1c41db9ba15fedad5fe751 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers de35f40802f14e4db0b11cf6d0ddb42c (127.15.36.194:41375), 528d113641084072814e1638bbcc07bb (127.15.36.195:40471)
W20260811 08:07:36.437656 1604 leader_election.cc:341] T 8ad9a8d86684444396762767f2e2256e P 4ad5179f7e1c41db9ba15fedad5fe751 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 528d113641084072814e1638bbcc07bb (127.15.36.195:40471): Not found: Tablet not found: 8ad9a8d86684444396762767f2e2256e
W20260811 08:07:36.437744 1606 leader_election.cc:341] T 8ad9a8d86684444396762767f2e2256e P 4ad5179f7e1c41db9ba15fedad5fe751 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer de35f40802f14e4db0b11cf6d0ddb42c (127.15.36.194:41375): Not found: Tablet not found: 8ad9a8d86684444396762767f2e2256e
I20260811 08:07:36.437808 1604 leader_election.cc:302] T 8ad9a8d86684444396762767f2e2256e P 4ad5179f7e1c41db9ba15fedad5fe751 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ad5179f7e1c41db9ba15fedad5fe751; no voters: 528d113641084072814e1638bbcc07bb, de35f40802f14e4db0b11cf6d0ddb42c
I20260811 08:07:36.437892 2047 raft_consensus.cc:2726] T 8ad9a8d86684444396762767f2e2256e P 4ad5179f7e1c41db9ba15fedad5fe751 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 08:07:36.581797 2048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:36.581539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32993 (local address 127.15.36.193:37797)
0811 08:07:36.581700 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:36.581750 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:32993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":68,"threads_started":1}
I20260811 08:07:36.634682 2049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:36.634378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32993 (local address 127.15.36.194:46987)
0811 08:07:36.634551 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:36.634608 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:32993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":93,"threads_started":1}
I20260811 08:07:36.764529 2051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:36.764223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32993 (local address 127.15.36.195:55079)
0811 08:07:36.764408 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:36.764460 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:32993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":88,"threads_started":1}
I20260811 08:07:37.583016 2053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:37.582661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32993 (local address 127.15.36.193:46963)
0811 08:07:37.582842 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:37.582893 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:32993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":78,"threads_started":1}
I20260811 08:07:37.635608 2054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:37.635366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32993 (local address 127.15.36.194:58631)
0811 08:07:37.635511 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:37.635558 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:32993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":73,"threads_started":1}
I20260811 08:07:37.765403 2055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:37.765144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32993 (local address 127.15.36.195:53295)
0811 08:07:37.765306 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:37.765352 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:32993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":63,"threads_started":1}
I20260811 08:07:38.583850 2056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:38.583579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32993 (local address 127.15.36.193:60919)
0811 08:07:38.583748 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:38.583790 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:32993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":90,"threads_started":1}
I20260811 08:07:38.636421 2057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:38.636198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32993 (local address 127.15.36.194:56889)
0811 08:07:38.636335 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:38.636371 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:32993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":80,"threads_started":1}
I20260811 08:07:38.766310 2058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:38.766020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32993 (local address 127.15.36.195:50109)
0811 08:07:38.766188 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:38.766259 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:32993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":88,"threads_started":1}
I20260811 08:07:39.035149 2059 raft_consensus.cc:482] T 8ad9a8d86684444396762767f2e2256e P 4ad5179f7e1c41db9ba15fedad5fe751 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:07:39.035282 2059 raft_consensus.cc:504] T 8ad9a8d86684444396762767f2e2256e P 4ad5179f7e1c41db9ba15fedad5fe751 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de35f40802f14e4db0b11cf6d0ddb42c" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 41375 } } peers { permanent_uuid: "528d113641084072814e1638bbcc07bb" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 40471 } } peers { permanent_uuid: "4ad5179f7e1c41db9ba15fedad5fe751" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 46047 } }
I20260811 08:07:39.035517 2059 leader_election.cc:288] T 8ad9a8d86684444396762767f2e2256e P 4ad5179f7e1c41db9ba15fedad5fe751 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers de35f40802f14e4db0b11cf6d0ddb42c (127.15.36.194:41375), 528d113641084072814e1638bbcc07bb (127.15.36.195:40471)
W20260811 08:07:39.035990 1604 leader_election.cc:341] T 8ad9a8d86684444396762767f2e2256e P 4ad5179f7e1c41db9ba15fedad5fe751 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 528d113641084072814e1638bbcc07bb (127.15.36.195:40471): Not found: Tablet not found: 8ad9a8d86684444396762767f2e2256e
W20260811 08:07:39.036058 1606 leader_election.cc:341] T 8ad9a8d86684444396762767f2e2256e P 4ad5179f7e1c41db9ba15fedad5fe751 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer de35f40802f14e4db0b11cf6d0ddb42c (127.15.36.194:41375): Not found: Tablet not found: 8ad9a8d86684444396762767f2e2256e
I20260811 08:07:39.036087 1604 leader_election.cc:302] T 8ad9a8d86684444396762767f2e2256e P 4ad5179f7e1c41db9ba15fedad5fe751 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ad5179f7e1c41db9ba15fedad5fe751; no voters: 528d113641084072814e1638bbcc07bb, de35f40802f14e4db0b11cf6d0ddb42c
I20260811 08:07:39.036185 2059 raft_consensus.cc:2726] T 8ad9a8d86684444396762767f2e2256e P 4ad5179f7e1c41db9ba15fedad5fe751 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 08:07:39.584964 2060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:39.584639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32993 (local address 127.15.36.193:47639)
0811 08:07:39.584867 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:39.584915 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:32993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":122,"threads_started":1}
I20260811 08:07:39.637346 2061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:39.637036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32993 (local address 127.15.36.194:44453)
0811 08:07:39.637236 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:39.637286 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:32993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":87,"threads_started":1}
I20260811 08:07:39.767270 2062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:39.766965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32993 (local address 127.15.36.195:45069)
0811 08:07:39.767173 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:39.767221 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:32993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":120,"threads_started":1}
I20260811 08:07:40.585896 2063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:40.585653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32993 (local address 127.15.36.193:44101)
0811 08:07:40.585792 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:40.585846 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:32993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":73,"threads_started":1}
I20260811 08:07:40.638252 2064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:40.637970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32993 (local address 127.15.36.194:57057)
0811 08:07:40.638150 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:40.638200 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:32993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":70,"threads_started":1}
I20260811 08:07:40.768144 2065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:40.767875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32993 (local address 127.15.36.195:47721)
0811 08:07:40.768049 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:40.768096 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:32993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":84,"threads_started":1}
I20260811 08:07:40.859509 2066 raft_consensus.cc:482] T 8ad9a8d86684444396762767f2e2256e P 4ad5179f7e1c41db9ba15fedad5fe751 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:07:40.859616 2066 raft_consensus.cc:504] T 8ad9a8d86684444396762767f2e2256e P 4ad5179f7e1c41db9ba15fedad5fe751 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de35f40802f14e4db0b11cf6d0ddb42c" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 41375 } } peers { permanent_uuid: "528d113641084072814e1638bbcc07bb" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 40471 } } peers { permanent_uuid: "4ad5179f7e1c41db9ba15fedad5fe751" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 46047 } }
I20260811 08:07:40.859843 2066 leader_election.cc:288] T 8ad9a8d86684444396762767f2e2256e P 4ad5179f7e1c41db9ba15fedad5fe751 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers de35f40802f14e4db0b11cf6d0ddb42c (127.15.36.194:41375), 528d113641084072814e1638bbcc07bb (127.15.36.195:40471)
W20260811 08:07:40.860442 1604 leader_election.cc:341] T 8ad9a8d86684444396762767f2e2256e P 4ad5179f7e1c41db9ba15fedad5fe751 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 528d113641084072814e1638bbcc07bb (127.15.36.195:40471): Not found: Tablet not found: 8ad9a8d86684444396762767f2e2256e
W20260811 08:07:40.860536 1606 leader_election.cc:341] T 8ad9a8d86684444396762767f2e2256e P 4ad5179f7e1c41db9ba15fedad5fe751 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer de35f40802f14e4db0b11cf6d0ddb42c (127.15.36.194:41375): Not found: Tablet not found: 8ad9a8d86684444396762767f2e2256e
I20260811 08:07:40.860607 1606 leader_election.cc:302] T 8ad9a8d86684444396762767f2e2256e P 4ad5179f7e1c41db9ba15fedad5fe751 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ad5179f7e1c41db9ba15fedad5fe751; no voters: 528d113641084072814e1638bbcc07bb, de35f40802f14e4db0b11cf6d0ddb42c
I20260811 08:07:40.860711 2066 raft_consensus.cc:2726] T 8ad9a8d86684444396762767f2e2256e P 4ad5179f7e1c41db9ba15fedad5fe751 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 08:07:41.586879 2067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:41.586572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32993 (local address 127.15.36.193:44157)
0811 08:07:41.586779 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:41.586829 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:32993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":76,"threads_started":1}
I20260811 08:07:41.639358 2068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:41.639071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32993 (local address 127.15.36.194:37511)
0811 08:07:41.639247 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:41.639297 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:32993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":71,"threads_started":1}
I20260811 08:07:41.768965 2069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:41.768674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32993 (local address 127.15.36.195:60261)
0811 08:07:41.768855 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:41.768916 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:32993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":117,"threads_started":1}
I20260811 08:07:42.587666 2070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:42.587443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32993 (local address 127.15.36.193:60067)
0811 08:07:42.587575 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:42.587618 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:32993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":66,"threads_started":1}
I20260811 08:07:42.640115 2071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:42.639842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32993 (local address 127.15.36.194:58671)
0811 08:07:42.640026 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:42.640066 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:32993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":88,"threads_started":1}
I20260811 08:07:42.769800 2072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:42.769547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32993 (local address 127.15.36.195:43387)
0811 08:07:42.769696 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:42.769741 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:32993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":70,"threads_started":1}
I20260811 08:07:43.588692 2073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:43.588333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32993 (local address 127.15.36.193:43143)
0811 08:07:43.588563 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:43.588625 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:32993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":103,"threads_started":1}
I20260811 08:07:43.641017 2075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:43.640736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32993 (local address 127.15.36.194:41373)
0811 08:07:43.640916 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:43.640965 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:32993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":137,"threads_started":1}
I20260811 08:07:43.658795 2076 raft_consensus.cc:482] T 8ad9a8d86684444396762767f2e2256e P 4ad5179f7e1c41db9ba15fedad5fe751 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:07:43.658912 2076 raft_consensus.cc:504] T 8ad9a8d86684444396762767f2e2256e P 4ad5179f7e1c41db9ba15fedad5fe751 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de35f40802f14e4db0b11cf6d0ddb42c" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 41375 } } peers { permanent_uuid: "528d113641084072814e1638bbcc07bb" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 40471 } } peers { permanent_uuid: "4ad5179f7e1c41db9ba15fedad5fe751" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 46047 } }
I20260811 08:07:43.659173 2076 leader_election.cc:288] T 8ad9a8d86684444396762767f2e2256e P 4ad5179f7e1c41db9ba15fedad5fe751 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers de35f40802f14e4db0b11cf6d0ddb42c (127.15.36.194:41375), 528d113641084072814e1638bbcc07bb (127.15.36.195:40471)
W20260811 08:07:43.659693 1604 leader_election.cc:341] T 8ad9a8d86684444396762767f2e2256e P 4ad5179f7e1c41db9ba15fedad5fe751 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 528d113641084072814e1638bbcc07bb (127.15.36.195:40471): Not found: Tablet not found: 8ad9a8d86684444396762767f2e2256e
W20260811 08:07:43.659830 1606 leader_election.cc:341] T 8ad9a8d86684444396762767f2e2256e P 4ad5179f7e1c41db9ba15fedad5fe751 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer de35f40802f14e4db0b11cf6d0ddb42c (127.15.36.194:41375): Not found: Tablet not found: 8ad9a8d86684444396762767f2e2256e
I20260811 08:07:43.659886 1606 leader_election.cc:302] T 8ad9a8d86684444396762767f2e2256e P 4ad5179f7e1c41db9ba15fedad5fe751 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ad5179f7e1c41db9ba15fedad5fe751; no voters: 528d113641084072814e1638bbcc07bb, de35f40802f14e4db0b11cf6d0ddb42c
I20260811 08:07:43.659997 2076 raft_consensus.cc:2726] T 8ad9a8d86684444396762767f2e2256e P 4ad5179f7e1c41db9ba15fedad5fe751 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 08:07:43.770525 2077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:43.770299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32993 (local address 127.15.36.195:60289)
0811 08:07:43.770444 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:43.770477 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:32993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":92,"threads_started":1}
I20260811 08:07:44.589493 2078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:44.589250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32993 (local address 127.15.36.193:54527)
0811 08:07:44.589390 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:44.589443 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:32993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":81,"threads_started":1}
I20260811 08:07:44.641875 2079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:44.641636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32993 (local address 127.15.36.194:34501)
0811 08:07:44.641778 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:44.641826 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:32993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":70,"threads_started":1}
I20260811 08:07:44.771598 2080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:44.771314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32993 (local address 127.15.36.195:46305)
0811 08:07:44.771472 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:44.771546 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:32993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":79,"threads_started":1}
I20260811 08:07:45.590370 2081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:45.590076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32993 (local address 127.15.36.193:47547)
0811 08:07:45.590243 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:45.590293 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:32993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":82,"threads_started":1}
I20260811 08:07:45.642752 2083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:45.642443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32993 (local address 127.15.36.194:41759)
0811 08:07:45.642618 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:45.642690 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:32993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":65,"threads_started":1}
I20260811 08:07:45.772410 2084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:45.772158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32993 (local address 127.15.36.195:42849)
0811 08:07:45.772305 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:45.772361 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:32993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":78,"threads_started":1}
I20260811 08:07:46.591320 2085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:46.591058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32993 (local address 127.15.36.193:49007)
0811 08:07:46.591218 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:46.591269 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:32993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":81,"threads_started":1}
I20260811 08:07:46.643535 2086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:46.643292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32993 (local address 127.15.36.194:42847)
0811 08:07:46.643447 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:46.643488 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:32993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":70,"threads_started":1}
I20260811 08:07:46.773382 2087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:46.773069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32993 (local address 127.15.36.195:44155)
0811 08:07:46.773256 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:46.773303 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:32993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":98,"threads_started":1}
I20260811 08:07:47.592335 2088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:47.592085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32993 (local address 127.15.36.193:46093)
0811 08:07:47.592236 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:47.592287 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:32993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":70,"threads_started":1}
I20260811 08:07:47.644465 2089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:47.644197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32993 (local address 127.15.36.194:44045)
0811 08:07:47.644364 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:47.644412 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:32993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":73,"threads_started":1}
I20260811 08:07:47.766728 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 1545
I20260811 08:07:47.773890 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 1732
I20260811 08:07:47.776345 2090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:47.774041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32993 (local address 127.15.36.195:57033)
0811 08:07:47.776238 (+ 2197us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:47.776287 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.254:32993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2171,"thread_start_us":61,"threads_started":1}
I20260811 08:07:47.782943 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 1880
2026-08-11T08:07:47Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (58680 ms)
[----------] 30 tests from SecurityITest (266948 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:07:47 dist-test-slave-2w3w krb5kdc[2094](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:07:47 dist-test-slave-2w3w krb5kdc[2094](info): set up 2 sockets
Aug 11 08:07:47 dist-test-slave-2w3w krb5kdc[2094](info): commencing operation
krb5kdc: starting...
W20260811 08:07:48.925364 15507 mini_kdc.cc:121] Time spent starting KDC: real 1.117s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Aug 11 08:07:49 dist-test-slave-2w3w krb5kdc[2094](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435669, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:07:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:07:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.36.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab.
Entry for principal kudu/127.15.36.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab.
I20260811 08:07:49.066185 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:38549
--webserver_interface=127.15.36.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=kudu/127.15.36.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:37003
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.36.254:38549
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:07:49.151105 2107 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:07:49.151384 2107 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:07:49.151429 2107 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:07:49.152702 2107 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:07:49.152784 2107 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:07:49.152809 2107 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:07:49.152833 2107 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:07:49.152863 2107 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:07:49.154464 2107 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:37003
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.36.254:38549
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=kudu/127.15.36.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:38549
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.36.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2107
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:07:49.154793 2107 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:07:49.155068 2107 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:07:49.160790 2112 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:07:49.160795 2107 server_base.cc:1034] running on GCE node
W20260811 08:07:49.160754 2117 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:07:49.160760 2115 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:07:49.161283 2107 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:07:49.161634 2107 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:07:49.162786 2107 hybrid_clock.cc:648] HybridClock initialized: now 1786435669162760 us; error 42 us; skew 500 ppm
Aug 11 08:07:49 dist-test-slave-2w3w krb5kdc[2094](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435669, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:07:49.165489 2107 init.cc:377] Logged in from keytab as kudu/127.15.36.254@KRBTEST.COM (short username kudu)
I20260811 08:07:49.165910 2107 webserver.cc:460] Webserver started at http://127.15.36.254:38343/ using document root <none> and password file <none>
I20260811 08:07:49.166158 2107 fs_manager.cc:359] Metadata directory not provided
I20260811 08:07:49.166206 2107 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:07:49.166363 2107 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:07:49.167577 2107 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/minicluster-data/master-0/data/instance:
uuid: "5f03d6c255d246eda988489ffc77733d"
format_stamp: "Formatted at 2026-08-11 08:07:49 on dist-test-slave-2w3w"
server_key: "b5935340499501f438ec5e6fc68717e2"
server_key_iv: "0dfe3a39d4d1aceef752fdc9f786cc07"
server_key_version: "encryptionkey@0"
I20260811 08:07:49.167959 2107 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/minicluster-data/master-0/wal/instance:
uuid: "5f03d6c255d246eda988489ffc77733d"
format_stamp: "Formatted at 2026-08-11 08:07:49 on dist-test-slave-2w3w"
server_key: "b5935340499501f438ec5e6fc68717e2"
server_key_iv: "0dfe3a39d4d1aceef752fdc9f786cc07"
server_key_version: "encryptionkey@0"
I20260811 08:07:49.169477 2107 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260811 08:07:49.170369 2124 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:49.170589 2107 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:07:49.170708 2107 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/minicluster-data/master-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/minicluster-data/master-0/wal
uuid: "5f03d6c255d246eda988489ffc77733d"
format_stamp: "Formatted at 2026-08-11 08:07:49 on dist-test-slave-2w3w"
server_key: "b5935340499501f438ec5e6fc68717e2"
server_key_iv: "0dfe3a39d4d1aceef752fdc9f786cc07"
server_key_version: "encryptionkey@0"
I20260811 08:07:49.170831 2107 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:07:49.186617 2107 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:07:49.188844 2107 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:07:49.189029 2107 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:07:49.193594 2107 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.254:38549
I20260811 08:07:49.193634 2182 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.254:38549 every 8 connection(s)
I20260811 08:07:49.194016 2107 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
I20260811 08:07:49.194944 2183 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:07:49.197389 2183 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f03d6c255d246eda988489ffc77733d: Bootstrap starting.
I20260811 08:07:49.198024 2183 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5f03d6c255d246eda988489ffc77733d: Neither blocks nor log segments found. Creating new log.
I20260811 08:07:49.198345 2183 log.cc:824] T 00000000000000000000000000000000 P 5f03d6c255d246eda988489ffc77733d: Log is configured to *not* fsync() on all Append() calls
I20260811 08:07:49.199239 2183 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f03d6c255d246eda988489ffc77733d: No bootstrap required, opened a new log
I20260811 08:07:49.200949 2183 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5f03d6c255d246eda988489ffc77733d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f03d6c255d246eda988489ffc77733d" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38549 } }
I20260811 08:07:49.201108 2183 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5f03d6c255d246eda988489ffc77733d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:07:49.201133 2183 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5f03d6c255d246eda988489ffc77733d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f03d6c255d246eda988489ffc77733d, State: Initialized, Role: FOLLOWER
I20260811 08:07:49.201301 2183 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5f03d6c255d246eda988489ffc77733d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f03d6c255d246eda988489ffc77733d" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38549 } }
I20260811 08:07:49.201378 2183 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5f03d6c255d246eda988489ffc77733d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:07:49.201429 2183 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5f03d6c255d246eda988489ffc77733d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:07:49.201489 2183 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5f03d6c255d246eda988489ffc77733d [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:07:49.202162 2183 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5f03d6c255d246eda988489ffc77733d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f03d6c255d246eda988489ffc77733d" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38549 } }
I20260811 08:07:49.202257 2183 leader_election.cc:302] T 00000000000000000000000000000000 P 5f03d6c255d246eda988489ffc77733d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5f03d6c255d246eda988489ffc77733d; no voters:
I20260811 08:07:49.202366 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 2107
I20260811 08:07:49.202497 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/minicluster-data/master-0/wal/instance
I20260811 08:07:49.202513 2183 leader_election.cc:288] T 00000000000000000000000000000000 P 5f03d6c255d246eda988489ffc77733d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:07:49.202554 2187 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5f03d6c255d246eda988489ffc77733d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:07:49.202749 2187 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5f03d6c255d246eda988489ffc77733d [term 1 LEADER]: Becoming Leader. State: Replica: 5f03d6c255d246eda988489ffc77733d, State: Running, Role: LEADER
I20260811 08:07:49.202761 15507 external_mini_cluster.cc:1428] Setting key 9fb9796a63bf2bde12c67445ecad3dc8
I20260811 08:07:49.202790 2183 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5f03d6c255d246eda988489ffc77733d [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:07:49.202940 2187 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5f03d6c255d246eda988489ffc77733d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f03d6c255d246eda988489ffc77733d" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38549 } }
I20260811 08:07:49.203647 2188 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f03d6c255d246eda988489ffc77733d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5f03d6c255d246eda988489ffc77733d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f03d6c255d246eda988489ffc77733d" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38549 } } }
I20260811 08:07:49.203744 2188 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f03d6c255d246eda988489ffc77733d [sys.catalog]: This master's current role is: LEADER
I20260811 08:07:49.203979 2199 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:07:49.204180 2189 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f03d6c255d246eda988489ffc77733d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5f03d6c255d246eda988489ffc77733d. Latest consensus state: current_term: 1 leader_uuid: "5f03d6c255d246eda988489ffc77733d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f03d6c255d246eda988489ffc77733d" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38549 } } }
I20260811 08:07:49.204545 2189 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f03d6c255d246eda988489ffc77733d [sys.catalog]: This master's current role is: LEADER
I20260811 08:07:49.204597 2199 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:07:49.206430 2199 catalog_manager.cc:1347] Generated new cluster ID: ff399a36a25f4f0886f076d468f5745e
I20260811 08:07:49.206496 2199 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 08:07:49 dist-test-slave-2w3w krb5kdc[2094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435669, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:07:49.214308 2199 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:07:49.215152 2199 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:07:49.216707 2192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:49.203363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48432 (local address 127.15.36.254:38549)
0811 08:07:49.204261 (+ 898us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:49.204271 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:49.204308 (+ 37us) server_negotiation.cc:407] Connection header received
0811 08:07:49.204442 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:49.204451 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:49.204515 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:49.204912 (+ 397us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:07:49.205632 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:49.207067 (+ 1435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:49.208354 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:49.209062 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:49.209185 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:49.212453 (+ 3268us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:07:49.212459 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:07:49.212459 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:07:49.212475 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:07:49.214807 (+ 2332us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:07:49.215328 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:07:49.215332 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:07:49.215332 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:07:49.215463 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:07:49.215706 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:07:49.215707 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:07:49.215707 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:07:49.216012 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:07:49.216184 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:49.216293 (+ 109us) server_negotiation.cc:299] Negotiation successful
0811 08:07:49.216462 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":846,"thread_start_us":75,"threads_started":1}
I20260811 08:07:49.222502 2199 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5f03d6c255d246eda988489ffc77733d: Generated new TSK 0
I20260811 08:07:49.222726 2199 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.36.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab.
Entry for principal kudu/127.15.36.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab.
I20260811 08:07:49.256147 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.193:0
--local_ip_for_outbound_sockets=127.15.36.193
--webserver_interface=127.15.36.193
--webserver_port=0
--tserver_master_addrs=127.15.36.254:38549
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab
--principal=kudu/127.15.36.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:37003
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:07:49.347693 2212 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:07:49.347926 2212 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:07:49.347954 2212 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:07:49.349151 2212 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:07:49.349205 2212 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:07:49.349234 2212 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.193
I20260811 08:07:49.351073 2212 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:37003
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab
--principal=kudu/127.15.36.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.36.193
--webserver_port=0
--tserver_master_addrs=127.15.36.254:38549
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2212
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.193
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:07:49.351367 2212 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:07:49.351653 2212 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:07:49.357405 2218 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:07:49.357412 2217 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:07:49.357412 2220 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:07:49.357524 2212 server_base.cc:1034] running on GCE node
I20260811 08:07:49.357897 2212 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:07:49.358155 2212 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:07:49.359340 2212 hybrid_clock.cc:648] HybridClock initialized: now 1786435669359318 us; error 42 us; skew 500 ppm
Aug 11 08:07:49 dist-test-slave-2w3w krb5kdc[2094](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435669, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:07:49.362254 2212 init.cc:377] Logged in from keytab as kudu/127.15.36.193@KRBTEST.COM (short username kudu)
I20260811 08:07:49.362709 2212 webserver.cc:460] Webserver started at http://127.15.36.193:39883/ using document root <none> and password file <none>
I20260811 08:07:49.363019 2212 fs_manager.cc:359] Metadata directory not provided
I20260811 08:07:49.363090 2212 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:07:49.363251 2212 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:07:49.364390 2212 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/minicluster-data/ts-0/data/instance:
uuid: "18d6367c47e848e2863b9d2adab74ccf"
format_stamp: "Formatted at 2026-08-11 08:07:49 on dist-test-slave-2w3w"
server_key: "d7b9c9bbf69ad258921309f59d1ebc60"
server_key_iv: "e05d450bb3613186303bab1e16563552"
server_key_version: "encryptionkey@0"
I20260811 08:07:49.364779 2212 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/minicluster-data/ts-0/wal/instance:
uuid: "18d6367c47e848e2863b9d2adab74ccf"
format_stamp: "Formatted at 2026-08-11 08:07:49 on dist-test-slave-2w3w"
server_key: "d7b9c9bbf69ad258921309f59d1ebc60"
server_key_iv: "e05d450bb3613186303bab1e16563552"
server_key_version: "encryptionkey@0"
I20260811 08:07:49.366226 2212 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 08:07:49.367061 2228 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:49.367239 2212 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:07:49.367339 2212 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/minicluster-data/ts-0/wal
uuid: "18d6367c47e848e2863b9d2adab74ccf"
format_stamp: "Formatted at 2026-08-11 08:07:49 on dist-test-slave-2w3w"
server_key: "d7b9c9bbf69ad258921309f59d1ebc60"
server_key_iv: "e05d450bb3613186303bab1e16563552"
server_key_version: "encryptionkey@0"
I20260811 08:07:49.367424 2212 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:07:49.383565 2212 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:07:49.385788 2212 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:07:49.385982 2212 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:07:49.386237 2212 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:07:49.386587 2212 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:07:49.386641 2212 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:49.386684 2212 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:07:49.386726 2212 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:49.393676 2212 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.193:38359
I20260811 08:07:49.393734 2356 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.193:38359 every 8 connection(s)
I20260811 08:07:49.394106 2212 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
Aug 11 08:07:49 dist-test-slave-2w3w krb5kdc[2094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435669, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.193@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:07:49.402938 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 2212
I20260811 08:07:49.403134 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/minicluster-data/ts-0/wal/instance
I20260811 08:07:49.403445 15507 external_mini_cluster.cc:1428] Setting key fd93e391dcb0f872b83923dfb734964a
I20260811 08:07:49.404934 2192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:49.395005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:56427 (local address 127.15.36.254:38549)
0811 08:07:49.395063 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:49.395065 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:49.395271 (+ 206us) server_negotiation.cc:407] Connection header received
0811 08:07:49.395838 (+ 567us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:49.395840 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:49.395851 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:49.395921 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:07:49.396934 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:49.397477 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:49.398595 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:49.398855 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:49.398925 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:49.401353 (+ 2428us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:07:49.401355 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:07:49.401356 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:07:49.401363 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:07:49.403048 (+ 1685us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:07:49.403647 (+ 599us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:07:49.403649 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:07:49.403649 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:07:49.403728 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:07:49.404100 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:07:49.404101 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:07:49.404102 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:07:49.404243 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:07:49.404382 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:49.404714 (+ 332us) server_negotiation.cc:299] Negotiation successful
0811 08:07:49.404828 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 08:07:49.405213 2359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:49.394945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:38549 (local address 127.15.36.193:56427)
0811 08:07:49.395131 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:49.395172 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 08:07:49.395678 (+ 506us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:07:49.395995 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:07:49.395998 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:07:49.396583 (+ 585us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:07:49.396831 (+ 248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:49.396835 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:49.397595 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:49.397596 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:49.398494 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:49.398497 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:49.398954 (+ 457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:49.398955 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:49.399146 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:49.399787 (+ 641us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:07:49.399797 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:07:49.401236 (+ 1439us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:07:49.403184 (+ 1948us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:07:49.403195 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:07:49.403198 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:07:49.403556 (+ 358us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:07:49.403881 (+ 325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:07:49.403882 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:07:49.403882 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:07:49.404016 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:07:49.404382 (+ 366us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:07:49.404391 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:07:49.404556 (+ 165us) client_negotiation.cc:769] Sending connection context
0811 08:07:49.404677 (+ 121us) client_negotiation.cc:240] Negotiation successful
0811 08:07:49.404901 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":111,"threads_started":1}
I20260811 08:07:49.405733 2357 heartbeater.cc:347] Connected to a master server at 127.15.36.254:38549
I20260811 08:07:49.405862 2357 heartbeater.cc:464] Registering TS with master...
I20260811 08:07:49.406065 2357 heartbeater.cc:511] Master 127.15.36.254:38549 requested a full tablet report, sending...
I20260811 08:07:49.406725 2141 ts_manager.cc:194] Registered new tserver with Master: 18d6367c47e848e2863b9d2adab74ccf (127.15.36.193:38359)
I20260811 08:07:49.407591 2141 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.36.193@KRBTEST.COM'} at 127.15.36.193:56427
WARNING: no policy specified for kudu/127.15.36.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab.
Entry for principal kudu/127.15.36.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab.
I20260811 08:07:49.434301 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.194:0
--local_ip_for_outbound_sockets=127.15.36.194
--webserver_interface=127.15.36.194
--webserver_port=0
--tserver_master_addrs=127.15.36.254:38549
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab
--principal=kudu/127.15.36.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:37003
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:07:49.519613 2362 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:07:49.519868 2362 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:07:49.519919 2362 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:07:49.521144 2362 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:07:49.521222 2362 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:07:49.521270 2362 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.194
I20260811 08:07:49.522827 2362 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:37003
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab
--principal=kudu/127.15.36.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.36.194
--webserver_port=0
--tserver_master_addrs=127.15.36.254:38549
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2362
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.194
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:07:49.523152 2362 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:07:49.523418 2362 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:07:49.528833 2369 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:07:49.528832 2371 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:07:49.528826 2367 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:07:49.529227 2362 server_base.cc:1034] running on GCE node
I20260811 08:07:49.529464 2362 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:07:49.529740 2362 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:07:49.530915 2362 hybrid_clock.cc:648] HybridClock initialized: now 1786435669530927 us; error 54 us; skew 500 ppm
Aug 11 08:07:49 dist-test-slave-2w3w krb5kdc[2094](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435669, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:07:49.533756 2362 init.cc:377] Logged in from keytab as kudu/127.15.36.194@KRBTEST.COM (short username kudu)
I20260811 08:07:49.534271 2362 webserver.cc:460] Webserver started at http://127.15.36.194:39643/ using document root <none> and password file <none>
I20260811 08:07:49.534487 2362 fs_manager.cc:359] Metadata directory not provided
I20260811 08:07:49.534530 2362 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:07:49.534626 2362 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:07:49.535742 2362 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/minicluster-data/ts-1/data/instance:
uuid: "97a0d3251aa94bdcb9088542cba47652"
format_stamp: "Formatted at 2026-08-11 08:07:49 on dist-test-slave-2w3w"
server_key: "0ac41a16755dd7eca793ec6105105537"
server_key_iv: "7704a423475d86a8fde63bea012460bd"
server_key_version: "encryptionkey@0"
I20260811 08:07:49.536054 2362 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/minicluster-data/ts-1/wal/instance:
uuid: "97a0d3251aa94bdcb9088542cba47652"
format_stamp: "Formatted at 2026-08-11 08:07:49 on dist-test-slave-2w3w"
server_key: "0ac41a16755dd7eca793ec6105105537"
server_key_iv: "7704a423475d86a8fde63bea012460bd"
server_key_version: "encryptionkey@0"
I20260811 08:07:49.537427 2362 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 08:07:49.538211 2378 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:49.538465 2362 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:07:49.538568 2362 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/minicluster-data/ts-1/wal
uuid: "97a0d3251aa94bdcb9088542cba47652"
format_stamp: "Formatted at 2026-08-11 08:07:49 on dist-test-slave-2w3w"
server_key: "0ac41a16755dd7eca793ec6105105537"
server_key_iv: "7704a423475d86a8fde63bea012460bd"
server_key_version: "encryptionkey@0"
I20260811 08:07:49.538640 2362 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:07:49.574880 2362 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:07:49.577519 2362 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:07:49.577646 2362 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:07:49.577862 2362 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:07:49.578157 2362 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:07:49.578189 2362 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:49.578212 2362 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:07:49.578225 2362 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:49.584352 2362 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.194:37219
I20260811 08:07:49.584434 2500 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.194:37219 every 8 connection(s)
I20260811 08:07:49.584781 2362 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
I20260811 08:07:49.590683 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 2362
I20260811 08:07:49.590824 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/minicluster-data/ts-1/wal/instance
I20260811 08:07:49.591113 15507 external_mini_cluster.cc:1428] Setting key 20ee303c5f77fdc68db9c64b2f3a7f1d
Aug 11 08:07:49 dist-test-slave-2w3w krb5kdc[2094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435669, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.194@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:07:49.596019 2192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:49.585604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:35641 (local address 127.15.36.254:38549)
0811 08:07:49.585650 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:49.585652 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:49.585954 (+ 302us) server_negotiation.cc:407] Connection header received
0811 08:07:49.586538 (+ 584us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:49.586539 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:49.586552 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:49.586623 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:07:49.587707 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:49.588247 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:49.589308 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:49.589505 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:49.589575 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:49.592237 (+ 2662us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:07:49.592238 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:07:49.592239 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:07:49.592248 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:07:49.594168 (+ 1920us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:07:49.594840 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:07:49.594841 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:07:49.594841 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:07:49.594908 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:07:49.595250 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:07:49.595251 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:07:49.595252 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:07:49.595379 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:07:49.595439 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:49.595855 (+ 416us) server_negotiation.cc:299] Negotiation successful
0811 08:07:49.595936 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 08:07:49.596268 2504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:49.585557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:38549 (local address 127.15.36.194:35641)
0811 08:07:49.585789 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:49.585833 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 08:07:49.586421 (+ 588us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:07:49.586706 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:07:49.586710 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:07:49.587393 (+ 683us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:07:49.587599 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:49.587604 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:49.588357 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:49.588358 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:49.589202 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:49.589204 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:49.589609 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:49.589610 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:49.589739 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:49.590313 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:07:49.590322 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:07:49.592137 (+ 1815us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:07:49.594306 (+ 2169us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:07:49.594316 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:07:49.594319 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:07:49.594682 (+ 363us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:07:49.595016 (+ 334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:07:49.595017 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:07:49.595018 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:07:49.595178 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:07:49.595449 (+ 271us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:07:49.595456 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:07:49.595644 (+ 188us) client_negotiation.cc:769] Sending connection context
0811 08:07:49.595759 (+ 115us) client_negotiation.cc:240] Negotiation successful
0811 08:07:49.595961 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":97,"threads_started":1}
I20260811 08:07:49.596825 2502 heartbeater.cc:347] Connected to a master server at 127.15.36.254:38549
I20260811 08:07:49.596951 2502 heartbeater.cc:464] Registering TS with master...
I20260811 08:07:49.597152 2502 heartbeater.cc:511] Master 127.15.36.254:38549 requested a full tablet report, sending...
I20260811 08:07:49.597631 2141 ts_manager.cc:194] Registered new tserver with Master: 97a0d3251aa94bdcb9088542cba47652 (127.15.36.194:37219)
I20260811 08:07:49.598043 2141 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.36.194@KRBTEST.COM'} at 127.15.36.194:35641
WARNING: no policy specified for kudu/127.15.36.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab.
Entry for principal kudu/127.15.36.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab.
I20260811 08:07:49.622537 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.195:0
--local_ip_for_outbound_sockets=127.15.36.195
--webserver_interface=127.15.36.195
--webserver_port=0
--tserver_master_addrs=127.15.36.254:38549
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab
--principal=kudu/127.15.36.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:37003
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:07:49.708948 2507 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:07:49.709177 2507 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:07:49.709203 2507 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:07:49.710419 2507 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:07:49.710471 2507 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:07:49.710500 2507 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.195
I20260811 08:07:49.712131 2507 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:37003
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab
--principal=kudu/127.15.36.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.36.195
--webserver_port=0
--tserver_master_addrs=127.15.36.254:38549
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2507
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.195
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:07:49.712404 2507 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:07:49.712658 2507 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:07:49.718212 2517 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:07:49.718201 2515 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:07:49.718201 2514 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:07:49.718495 2507 server_base.cc:1034] running on GCE node
I20260811 08:07:49.718721 2507 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:07:49.719103 2507 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:07:49.720283 2507 hybrid_clock.cc:648] HybridClock initialized: now 1786435669720262 us; error 56 us; skew 500 ppm
Aug 11 08:07:49 dist-test-slave-2w3w krb5kdc[2094](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435669, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:07:49.723183 2507 init.cc:377] Logged in from keytab as kudu/127.15.36.195@KRBTEST.COM (short username kudu)
I20260811 08:07:49.723595 2507 webserver.cc:460] Webserver started at http://127.15.36.195:33541/ using document root <none> and password file <none>
I20260811 08:07:49.723798 2507 fs_manager.cc:359] Metadata directory not provided
I20260811 08:07:49.723850 2507 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:07:49.723945 2507 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:07:49.724969 2507 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/minicluster-data/ts-2/data/instance:
uuid: "7ca7abd38a5f4e6b8481eb78b8ab800f"
format_stamp: "Formatted at 2026-08-11 08:07:49 on dist-test-slave-2w3w"
server_key: "4c855621bf746eb512a24145b7871e15"
server_key_iv: "0797aca4904706d144edc493ed6689b6"
server_key_version: "encryptionkey@0"
I20260811 08:07:49.725286 2507 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/minicluster-data/ts-2/wal/instance:
uuid: "7ca7abd38a5f4e6b8481eb78b8ab800f"
format_stamp: "Formatted at 2026-08-11 08:07:49 on dist-test-slave-2w3w"
server_key: "4c855621bf746eb512a24145b7871e15"
server_key_iv: "0797aca4904706d144edc493ed6689b6"
server_key_version: "encryptionkey@0"
I20260811 08:07:49.726624 2507 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 08:07:49.727581 2524 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:49.727826 2507 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 08:07:49.727917 2507 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/minicluster-data/ts-2/wal
uuid: "7ca7abd38a5f4e6b8481eb78b8ab800f"
format_stamp: "Formatted at 2026-08-11 08:07:49 on dist-test-slave-2w3w"
server_key: "4c855621bf746eb512a24145b7871e15"
server_key_iv: "0797aca4904706d144edc493ed6689b6"
server_key_version: "encryptionkey@0"
I20260811 08:07:49.727979 2507 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:07:49.746097 2507 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:07:49.748246 2507 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:07:49.748432 2507 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:07:49.748688 2507 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:07:49.748972 2507 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:07:49.749003 2507 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:49.749027 2507 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:07:49.749039 2507 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:49.754818 2507 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.195:40309
I20260811 08:07:49.754922 2649 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.195:40309 every 8 connection(s)
I20260811 08:07:49.755259 2507 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
I20260811 08:07:49.758706 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 2507
I20260811 08:07:49.758812 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/minicluster-data/ts-2/wal/instance
I20260811 08:07:49.759014 15507 external_mini_cluster.cc:1428] Setting key 66af7c0b955e449f38886b6f9dad343f
Aug 11 08:07:49 dist-test-slave-2w3w krb5kdc[2094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435669, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.195@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:07:49.765710 2192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:49.756117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:40585 (local address 127.15.36.254:38549)
0811 08:07:49.756164 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:49.756166 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:49.756433 (+ 267us) server_negotiation.cc:407] Connection header received
0811 08:07:49.756997 (+ 564us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:49.756999 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:49.757012 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:49.757071 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:07:49.758053 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:49.758616 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:49.760109 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:49.760301 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:49.760362 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:49.762771 (+ 2409us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:07:49.762772 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:07:49.762772 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:07:49.762779 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:07:49.764348 (+ 1569us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:07:49.764756 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:07:49.764757 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:07:49.764758 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:07:49.764858 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:07:49.765111 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:07:49.765112 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:07:49.765112 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:07:49.765238 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:07:49.765296 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:49.765573 (+ 277us) server_negotiation.cc:299] Negotiation successful
0811 08:07:49.765644 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 08:07:49.765965 2652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:49.756084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:38549 (local address 127.15.36.195:40585)
0811 08:07:49.756281 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:49.756344 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0811 08:07:49.756872 (+ 528us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:07:49.757151 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:07:49.757154 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:07:49.757741 (+ 587us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:07:49.757942 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:49.757946 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:49.758731 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:49.758732 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:49.760028 (+ 1296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:49.760031 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:49.760402 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:49.760403 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:49.760522 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:49.761188 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:07:49.761197 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:07:49.762684 (+ 1487us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:07:49.764443 (+ 1759us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:07:49.764451 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:07:49.764453 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:07:49.764680 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:07:49.764932 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:07:49.764933 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:07:49.764933 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:07:49.765045 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:07:49.765303 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:07:49.765308 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:07:49.765454 (+ 146us) client_negotiation.cc:769] Sending connection context
0811 08:07:49.765546 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 08:07:49.765675 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":102,"threads_started":1}
I20260811 08:07:49.766510 2650 heartbeater.cc:347] Connected to a master server at 127.15.36.254:38549
I20260811 08:07:49.766628 2650 heartbeater.cc:464] Registering TS with master...
I20260811 08:07:49.766865 2650 heartbeater.cc:511] Master 127.15.36.254:38549 requested a full tablet report, sending...
I20260811 08:07:49.767277 2141 ts_manager.cc:194] Registered new tserver with Master: 7ca7abd38a5f4e6b8481eb78b8ab800f (127.15.36.195:40309)
I20260811 08:07:49.767623 2141 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.36.195@KRBTEST.COM'} at 127.15.36.195:40585
I20260811 08:07:49.770932 15507 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 08:07:49.779254 2192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:49.772339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48434 (local address 127.15.36.254:38549)
0811 08:07:49.772454 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:49.772456 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:49.772559 (+ 103us) server_negotiation.cc:407] Connection header received
0811 08:07:49.772676 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:49.772677 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:49.772688 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:49.772747 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:07:49.773403 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:49.773948 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:49.774669 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:49.774930 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:49.775043 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:49.776369 (+ 1326us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:07:49.776371 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:07:49.776371 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:07:49.776400 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:07:49.777902 (+ 1502us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:07:49.778332 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:07:49.778333 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:07:49.778334 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:07:49.778407 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:07:49.778610 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:07:49.778611 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:07:49.778612 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:07:49.778777 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:07:49.778890 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:49.779059 (+ 169us) server_negotiation.cc:299] Negotiation successful
0811 08:07:49.779145 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260811 08:07:49.781136 2141 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48434:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:07:49.782793 2141 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:07:49.790060 2665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:49.785717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42898 (local address 127.15.36.195:40309)
0811 08:07:49.786182 (+ 465us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:49.786186 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:49.786199 (+ 13us) server_negotiation.cc:407] Connection header received
0811 08:07:49.786265 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:49.786268 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:49.786284 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:49.786575 (+ 291us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:07:49.786654 (+ 79us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:49.787539 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:49.789132 (+ 1593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:49.789623 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:49.789715 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:49.789772 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:49.789933 (+ 161us) server_negotiation.cc:299] Negotiation successful
0811 08:07:49.789976 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":420,"thread_start_us":160,"threads_started":1}
I20260811 08:07:49.790061 2663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:49.785570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.195:40309 (local address 127.0.0.1:42898)
0811 08:07:49.785936 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:49.785945 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 08:07:49.786023 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:07:49.786424 (+ 401us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:07:49.786425 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:07:49.786427 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:07:49.786493 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:49.786495 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:49.787647 (+ 1152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:49.787648 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:49.789042 (+ 1394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:49.789044 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:49.789716 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:49.789725 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:49.789792 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:49.789818 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 08:07:49.789914 (+ 96us) client_negotiation.cc:240] Negotiation successful
0811 08:07:49.789961 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":353,"mutex_wait_us":33,"thread_start_us":112,"threads_started":1}
I20260811 08:07:49.790335 2666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:49.785796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.194:37219 (local address 127.0.0.1:33408)
0811 08:07:49.786206 (+ 410us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:49.786217 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:07:49.786497 (+ 280us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:07:49.786762 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:07:49.786762 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:07:49.786764 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:07:49.786818 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:49.786820 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:49.788055 (+ 1235us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:49.788056 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:49.789027 (+ 971us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:49.789030 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:49.789705 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:49.789706 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:49.789800 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:49.789817 (+ 17us) client_negotiation.cc:769] Sending connection context
0811 08:07:49.789886 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 08:07:49.789941 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":388,"mutex_wait_us":5,"thread_start_us":89,"threads_started":1}
I20260811 08:07:49.790586 2667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:49.785953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33408 (local address 127.15.36.194:37219)
0811 08:07:49.786159 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:49.786165 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:49.786476 (+ 311us) server_negotiation.cc:407] Connection header received
0811 08:07:49.786600 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:49.786602 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:49.786617 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:49.786685 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:07:49.786889 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:49.787950 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:49.789113 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:49.789604 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:49.789694 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:49.789756 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:49.790011 (+ 255us) server_negotiation.cc:299] Negotiation successful
0811 08:07:49.790054 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":96,"threads_started":1}
I20260811 08:07:49.790865 2664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:49.785566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.193:38359 (local address 127.0.0.1:59998)
0811 08:07:49.785740 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:49.785783 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 08:07:49.785854 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:07:49.786351 (+ 497us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:07:49.786354 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:07:49.786357 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:07:49.786437 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:49.786439 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:49.787816 (+ 1377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:49.787817 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:49.789017 (+ 1200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:49.789020 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:49.790630 (+ 1610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:49.790631 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:49.790696 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:49.790699 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:07:49.790759 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 08:07:49.790802 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":65,"threads_started":1}
I20260811 08:07:49.790879 2578 tablet_service.cc:1467] Processing CreateTablet for tablet d61b92f0d3544616a61cb063bc52ae32 (DEFAULT_TABLE table=test-table [id=8ace7d1ae1c944a0835c1e1ee6aeeb8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:07:49.791381 2578 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d61b92f0d3544616a61cb063bc52ae32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:07:49.791384 2668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:49.786021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59998 (local address 127.15.36.193:38359)
0811 08:07:49.786194 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:49.786198 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:49.786207 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:07:49.786247 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:49.786249 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:49.786265 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:49.786344 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:07:49.786530 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:49.787709 (+ 1179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:49.789808 (+ 2099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:49.790538 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:49.790621 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:49.790685 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:49.790796 (+ 111us) server_negotiation.cc:299] Negotiation successful
0811 08:07:49.791212 (+ 416us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":87,"threads_started":1}
I20260811 08:07:49.791553 2429 tablet_service.cc:1467] Processing CreateTablet for tablet d61b92f0d3544616a61cb063bc52ae32 (DEFAULT_TABLE table=test-table [id=8ace7d1ae1c944a0835c1e1ee6aeeb8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:07:49.791860 2429 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d61b92f0d3544616a61cb063bc52ae32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:07:49.792044 2280 tablet_service.cc:1467] Processing CreateTablet for tablet d61b92f0d3544616a61cb063bc52ae32 (DEFAULT_TABLE table=test-table [id=8ace7d1ae1c944a0835c1e1ee6aeeb8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:07:49.792369 2280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d61b92f0d3544616a61cb063bc52ae32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:07:49.795197 2670 tablet_bootstrap.cc:492] T d61b92f0d3544616a61cb063bc52ae32 P 18d6367c47e848e2863b9d2adab74ccf: Bootstrap starting.
I20260811 08:07:49.795352 2672 tablet_bootstrap.cc:492] T d61b92f0d3544616a61cb063bc52ae32 P 7ca7abd38a5f4e6b8481eb78b8ab800f: Bootstrap starting.
I20260811 08:07:49.795869 2670 tablet_bootstrap.cc:654] T d61b92f0d3544616a61cb063bc52ae32 P 18d6367c47e848e2863b9d2adab74ccf: Neither blocks nor log segments found. Creating new log.
I20260811 08:07:49.795892 2672 tablet_bootstrap.cc:654] T d61b92f0d3544616a61cb063bc52ae32 P 7ca7abd38a5f4e6b8481eb78b8ab800f: Neither blocks nor log segments found. Creating new log.
I20260811 08:07:49.796366 2672 log.cc:824] T d61b92f0d3544616a61cb063bc52ae32 P 7ca7abd38a5f4e6b8481eb78b8ab800f: Log is configured to *not* fsync() on all Append() calls
I20260811 08:07:49.796380 2670 log.cc:824] T d61b92f0d3544616a61cb063bc52ae32 P 18d6367c47e848e2863b9d2adab74ccf: Log is configured to *not* fsync() on all Append() calls
I20260811 08:07:49.796733 2671 tablet_bootstrap.cc:492] T d61b92f0d3544616a61cb063bc52ae32 P 97a0d3251aa94bdcb9088542cba47652: Bootstrap starting.
I20260811 08:07:49.797308 2670 tablet_bootstrap.cc:492] T d61b92f0d3544616a61cb063bc52ae32 P 18d6367c47e848e2863b9d2adab74ccf: No bootstrap required, opened a new log
I20260811 08:07:49.797339 2671 tablet_bootstrap.cc:654] T d61b92f0d3544616a61cb063bc52ae32 P 97a0d3251aa94bdcb9088542cba47652: Neither blocks nor log segments found. Creating new log.
I20260811 08:07:49.797500 2670 ts_tablet_manager.cc:1397] T d61b92f0d3544616a61cb063bc52ae32 P 18d6367c47e848e2863b9d2adab74ccf: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 08:07:49.797919 2671 log.cc:824] T d61b92f0d3544616a61cb063bc52ae32 P 97a0d3251aa94bdcb9088542cba47652: Log is configured to *not* fsync() on all Append() calls
I20260811 08:07:49.798457 2672 tablet_bootstrap.cc:492] T d61b92f0d3544616a61cb063bc52ae32 P 7ca7abd38a5f4e6b8481eb78b8ab800f: No bootstrap required, opened a new log
I20260811 08:07:49.798537 2672 ts_tablet_manager.cc:1397] T d61b92f0d3544616a61cb063bc52ae32 P 7ca7abd38a5f4e6b8481eb78b8ab800f: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260811 08:07:49.798732 2671 tablet_bootstrap.cc:492] T d61b92f0d3544616a61cb063bc52ae32 P 97a0d3251aa94bdcb9088542cba47652: No bootstrap required, opened a new log
I20260811 08:07:49.798799 2671 ts_tablet_manager.cc:1397] T d61b92f0d3544616a61cb063bc52ae32 P 97a0d3251aa94bdcb9088542cba47652: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 08:07:49.799495 2670 raft_consensus.cc:348] T d61b92f0d3544616a61cb063bc52ae32 P 18d6367c47e848e2863b9d2adab74ccf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca7abd38a5f4e6b8481eb78b8ab800f" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 40309 } } peers { permanent_uuid: "18d6367c47e848e2863b9d2adab74ccf" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 38359 } } peers { permanent_uuid: "97a0d3251aa94bdcb9088542cba47652" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 37219 } }
I20260811 08:07:49.799718 2670 raft_consensus.cc:374] T d61b92f0d3544616a61cb063bc52ae32 P 18d6367c47e848e2863b9d2adab74ccf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:07:49.799775 2670 raft_consensus.cc:729] T d61b92f0d3544616a61cb063bc52ae32 P 18d6367c47e848e2863b9d2adab74ccf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18d6367c47e848e2863b9d2adab74ccf, State: Initialized, Role: FOLLOWER
I20260811 08:07:49.799908 2670 consensus_queue.cc:260] T d61b92f0d3544616a61cb063bc52ae32 P 18d6367c47e848e2863b9d2adab74ccf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca7abd38a5f4e6b8481eb78b8ab800f" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 40309 } } peers { permanent_uuid: "18d6367c47e848e2863b9d2adab74ccf" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 38359 } } peers { permanent_uuid: "97a0d3251aa94bdcb9088542cba47652" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 37219 } }
I20260811 08:07:49.800244 2670 ts_tablet_manager.cc:1428] T d61b92f0d3544616a61cb063bc52ae32 P 18d6367c47e848e2863b9d2adab74ccf: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 08:07:49.800259 2357 heartbeater.cc:503] Master 127.15.36.254:38549 was elected leader, sending a full tablet report...
I20260811 08:07:49.800741 2672 raft_consensus.cc:348] T d61b92f0d3544616a61cb063bc52ae32 P 7ca7abd38a5f4e6b8481eb78b8ab800f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca7abd38a5f4e6b8481eb78b8ab800f" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 40309 } } peers { permanent_uuid: "18d6367c47e848e2863b9d2adab74ccf" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 38359 } } peers { permanent_uuid: "97a0d3251aa94bdcb9088542cba47652" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 37219 } }
I20260811 08:07:49.800936 2672 raft_consensus.cc:374] T d61b92f0d3544616a61cb063bc52ae32 P 7ca7abd38a5f4e6b8481eb78b8ab800f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:07:49.800976 2672 raft_consensus.cc:729] T d61b92f0d3544616a61cb063bc52ae32 P 7ca7abd38a5f4e6b8481eb78b8ab800f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ca7abd38a5f4e6b8481eb78b8ab800f, State: Initialized, Role: FOLLOWER
I20260811 08:07:49.800874 2671 raft_consensus.cc:348] T d61b92f0d3544616a61cb063bc52ae32 P 97a0d3251aa94bdcb9088542cba47652 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca7abd38a5f4e6b8481eb78b8ab800f" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 40309 } } peers { permanent_uuid: "18d6367c47e848e2863b9d2adab74ccf" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 38359 } } peers { permanent_uuid: "97a0d3251aa94bdcb9088542cba47652" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 37219 } }
I20260811 08:07:49.801020 2671 raft_consensus.cc:374] T d61b92f0d3544616a61cb063bc52ae32 P 97a0d3251aa94bdcb9088542cba47652 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:07:49.801059 2671 raft_consensus.cc:729] T d61b92f0d3544616a61cb063bc52ae32 P 97a0d3251aa94bdcb9088542cba47652 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97a0d3251aa94bdcb9088542cba47652, State: Initialized, Role: FOLLOWER
I20260811 08:07:49.801141 2672 consensus_queue.cc:260] T d61b92f0d3544616a61cb063bc52ae32 P 7ca7abd38a5f4e6b8481eb78b8ab800f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca7abd38a5f4e6b8481eb78b8ab800f" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 40309 } } peers { permanent_uuid: "18d6367c47e848e2863b9d2adab74ccf" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 38359 } } peers { permanent_uuid: "97a0d3251aa94bdcb9088542cba47652" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 37219 } }
I20260811 08:07:49.801167 2671 consensus_queue.cc:260] T d61b92f0d3544616a61cb063bc52ae32 P 97a0d3251aa94bdcb9088542cba47652 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca7abd38a5f4e6b8481eb78b8ab800f" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 40309 } } peers { permanent_uuid: "18d6367c47e848e2863b9d2adab74ccf" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 38359 } } peers { permanent_uuid: "97a0d3251aa94bdcb9088542cba47652" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 37219 } }
I20260811 08:07:49.801442 2672 ts_tablet_manager.cc:1428] T d61b92f0d3544616a61cb063bc52ae32 P 7ca7abd38a5f4e6b8481eb78b8ab800f: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 08:07:49.801442 2671 ts_tablet_manager.cc:1428] T d61b92f0d3544616a61cb063bc52ae32 P 97a0d3251aa94bdcb9088542cba47652: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 08:07:49.801537 2650 heartbeater.cc:503] Master 127.15.36.254:38549 was elected leader, sending a full tablet report...
I20260811 08:07:49.801839 2502 heartbeater.cc:503] Master 127.15.36.254:38549 was elected leader, sending a full tablet report...
W20260811 08:07:49.835407 2503 tablet.cc:2369] T d61b92f0d3544616a61cb063bc52ae32 P 97a0d3251aa94bdcb9088542cba47652: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 08:07:49.894922 2358 tablet.cc:2369] T d61b92f0d3544616a61cb063bc52ae32 P 18d6367c47e848e2863b9d2adab74ccf: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:07:49.915827 2680 raft_consensus.cc:482] T d61b92f0d3544616a61cb063bc52ae32 P 7ca7abd38a5f4e6b8481eb78b8ab800f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:07:49.915953 2680 raft_consensus.cc:504] T d61b92f0d3544616a61cb063bc52ae32 P 7ca7abd38a5f4e6b8481eb78b8ab800f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca7abd38a5f4e6b8481eb78b8ab800f" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 40309 } } peers { permanent_uuid: "18d6367c47e848e2863b9d2adab74ccf" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 38359 } } peers { permanent_uuid: "97a0d3251aa94bdcb9088542cba47652" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 37219 } }
I20260811 08:07:49.916386 2680 leader_election.cc:288] T d61b92f0d3544616a61cb063bc52ae32 P 7ca7abd38a5f4e6b8481eb78b8ab800f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18d6367c47e848e2863b9d2adab74ccf (127.15.36.193:38359), 97a0d3251aa94bdcb9088542cba47652 (127.15.36.194:37219)
I20260811 08:07:49.920861 2668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:49.916714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:33267 (local address 127.15.36.193:38359)
0811 08:07:49.916787 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:49.916790 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:49.916802 (+ 12us) server_negotiation.cc:407] Connection header received
0811 08:07:49.916841 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:49.916842 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:49.916852 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:49.916949 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:07:49.917143 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:49.918009 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:49.919782 (+ 1773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:49.920430 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:49.920521 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:49.920531 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:49.920737 (+ 206us) server_negotiation.cc:299] Negotiation successful
0811 08:07:49.920784 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 08:07:49.920915 2667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:49.916937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:33683 (local address 127.15.36.194:37219)
0811 08:07:49.916991 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:49.916993 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:49.917082 (+ 89us) server_negotiation.cc:407] Connection header received
0811 08:07:49.917132 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:49.917133 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:49.917145 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:49.917210 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:07:49.917340 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:49.918058 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:49.919782 (+ 1724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:49.920430 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:49.920521 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:49.920531 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:49.920737 (+ 206us) server_negotiation.cc:299] Negotiation successful
0811 08:07:49.920784 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 08:07:49.920910 2652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:49.916628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.193:38359 (local address 127.15.36.195:33267)
0811 08:07:49.916691 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:49.916705 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 08:07:49.916756 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:07:49.916966 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:07:49.916967 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:07:49.916970 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:07:49.917052 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:49.917054 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:49.918141 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:49.918143 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:49.919635 (+ 1492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:49.919639 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:49.920546 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:49.920547 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:49.920644 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:49.920646 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 08:07:49.920714 (+ 68us) client_negotiation.cc:240] Negotiation successful
0811 08:07:49.920782 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39,"mutex_wait_us":117}
I20260811 08:07:49.920923 2681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:49.916791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.194:37219 (local address 127.15.36.195:33683)
0811 08:07:49.917006 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:49.917016 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:07:49.917080 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:07:49.917217 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:07:49.917218 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:07:49.917219 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:07:49.917274 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:49.917276 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:49.918151 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:49.918151 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:49.919635 (+ 1484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:49.919639 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:49.920548 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:49.920549 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:49.920641 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:49.920646 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 08:07:49.920714 (+ 68us) client_negotiation.cc:240] Negotiation successful
0811 08:07:49.920826 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":200,"mutex_wait_us":71,"thread_start_us":150,"threads_started":1}
I20260811 08:07:49.921382 2301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d61b92f0d3544616a61cb063bc52ae32" candidate_uuid: "7ca7abd38a5f4e6b8481eb78b8ab800f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18d6367c47e848e2863b9d2adab74ccf" is_pre_election: true
I20260811 08:07:49.921412 2451 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d61b92f0d3544616a61cb063bc52ae32" candidate_uuid: "7ca7abd38a5f4e6b8481eb78b8ab800f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97a0d3251aa94bdcb9088542cba47652" is_pre_election: true
I20260811 08:07:49.921571 2301 raft_consensus.cc:2454] T d61b92f0d3544616a61cb063bc52ae32 P 18d6367c47e848e2863b9d2adab74ccf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ca7abd38a5f4e6b8481eb78b8ab800f in term 0.
I20260811 08:07:49.921576 2451 raft_consensus.cc:2454] T d61b92f0d3544616a61cb063bc52ae32 P 97a0d3251aa94bdcb9088542cba47652 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ca7abd38a5f4e6b8481eb78b8ab800f in term 0.
I20260811 08:07:49.921808 2526 leader_election.cc:302] T d61b92f0d3544616a61cb063bc52ae32 P 7ca7abd38a5f4e6b8481eb78b8ab800f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18d6367c47e848e2863b9d2adab74ccf, 7ca7abd38a5f4e6b8481eb78b8ab800f; no voters:
I20260811 08:07:49.921959 2680 raft_consensus.cc:2781] T d61b92f0d3544616a61cb063bc52ae32 P 7ca7abd38a5f4e6b8481eb78b8ab800f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:07:49.922024 2680 raft_consensus.cc:482] T d61b92f0d3544616a61cb063bc52ae32 P 7ca7abd38a5f4e6b8481eb78b8ab800f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:07:49.922055 2680 raft_consensus.cc:3037] T d61b92f0d3544616a61cb063bc52ae32 P 7ca7abd38a5f4e6b8481eb78b8ab800f [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:07:49.922775 2680 raft_consensus.cc:504] T d61b92f0d3544616a61cb063bc52ae32 P 7ca7abd38a5f4e6b8481eb78b8ab800f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca7abd38a5f4e6b8481eb78b8ab800f" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 40309 } } peers { permanent_uuid: "18d6367c47e848e2863b9d2adab74ccf" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 38359 } } peers { permanent_uuid: "97a0d3251aa94bdcb9088542cba47652" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 37219 } }
I20260811 08:07:49.922932 2680 leader_election.cc:288] T d61b92f0d3544616a61cb063bc52ae32 P 7ca7abd38a5f4e6b8481eb78b8ab800f [CANDIDATE]: Term 1 election: Requested vote from peers 18d6367c47e848e2863b9d2adab74ccf (127.15.36.193:38359), 97a0d3251aa94bdcb9088542cba47652 (127.15.36.194:37219)
I20260811 08:07:49.923131 2301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d61b92f0d3544616a61cb063bc52ae32" candidate_uuid: "7ca7abd38a5f4e6b8481eb78b8ab800f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18d6367c47e848e2863b9d2adab74ccf"
I20260811 08:07:49.923141 2451 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d61b92f0d3544616a61cb063bc52ae32" candidate_uuid: "7ca7abd38a5f4e6b8481eb78b8ab800f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97a0d3251aa94bdcb9088542cba47652"
I20260811 08:07:49.923225 2451 raft_consensus.cc:3037] T d61b92f0d3544616a61cb063bc52ae32 P 97a0d3251aa94bdcb9088542cba47652 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:07:49.923228 2301 raft_consensus.cc:3037] T d61b92f0d3544616a61cb063bc52ae32 P 18d6367c47e848e2863b9d2adab74ccf [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:07:49.924057 2451 raft_consensus.cc:2454] T d61b92f0d3544616a61cb063bc52ae32 P 97a0d3251aa94bdcb9088542cba47652 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ca7abd38a5f4e6b8481eb78b8ab800f in term 1.
I20260811 08:07:49.924162 2301 raft_consensus.cc:2454] T d61b92f0d3544616a61cb063bc52ae32 P 18d6367c47e848e2863b9d2adab74ccf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ca7abd38a5f4e6b8481eb78b8ab800f in term 1.
I20260811 08:07:49.924239 2526 leader_election.cc:302] T d61b92f0d3544616a61cb063bc52ae32 P 7ca7abd38a5f4e6b8481eb78b8ab800f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ca7abd38a5f4e6b8481eb78b8ab800f, 97a0d3251aa94bdcb9088542cba47652; no voters:
I20260811 08:07:49.924358 2680 raft_consensus.cc:2781] T d61b92f0d3544616a61cb063bc52ae32 P 7ca7abd38a5f4e6b8481eb78b8ab800f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:07:49.924522 2680 raft_consensus.cc:686] T d61b92f0d3544616a61cb063bc52ae32 P 7ca7abd38a5f4e6b8481eb78b8ab800f [term 1 LEADER]: Becoming Leader. State: Replica: 7ca7abd38a5f4e6b8481eb78b8ab800f, State: Running, Role: LEADER
I20260811 08:07:49.924642 2680 consensus_queue.cc:237] T d61b92f0d3544616a61cb063bc52ae32 P 7ca7abd38a5f4e6b8481eb78b8ab800f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca7abd38a5f4e6b8481eb78b8ab800f" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 40309 } } peers { permanent_uuid: "18d6367c47e848e2863b9d2adab74ccf" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 38359 } } peers { permanent_uuid: "97a0d3251aa94bdcb9088542cba47652" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 37219 } }
I20260811 08:07:49.925544 2141 catalog_manager.cc:5495] T d61b92f0d3544616a61cb063bc52ae32 P 7ca7abd38a5f4e6b8481eb78b8ab800f reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ca7abd38a5f4e6b8481eb78b8ab800f (127.15.36.195). New cstate: current_term: 1 leader_uuid: "7ca7abd38a5f4e6b8481eb78b8ab800f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca7abd38a5f4e6b8481eb78b8ab800f" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 40309 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18d6367c47e848e2863b9d2adab74ccf" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 38359 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97a0d3251aa94bdcb9088542cba47652" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 37219 } health_report { overall_health: UNKNOWN } } }
I20260811 08:07:49.936156 2665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:49.933525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42906 (local address 127.15.36.195:40309)
0811 08:07:49.933596 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:49.933598 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:49.933607 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:07:49.933650 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:49.933651 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:49.933669 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:49.933751 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:07:49.933935 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:49.934426 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:49.935335 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:49.935533 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:49.935610 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:49.935798 (+ 188us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:07:49.935903 (+ 105us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:07:49.936000 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:49.936019 (+ 19us) server_negotiation.cc:299] Negotiation successful
0811 08:07:49.936039 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 08:07:49.938060 2451 raft_consensus.cc:1261] T d61b92f0d3544616a61cb063bc52ae32 P 97a0d3251aa94bdcb9088542cba47652 [term 1 FOLLOWER]: Refusing update from remote peer 7ca7abd38a5f4e6b8481eb78b8ab800f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:07:49.938153 2301 raft_consensus.cc:1261] T d61b92f0d3544616a61cb063bc52ae32 P 18d6367c47e848e2863b9d2adab74ccf [term 1 FOLLOWER]: Refusing update from remote peer 7ca7abd38a5f4e6b8481eb78b8ab800f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:07:49.938450 2682 consensus_queue.cc:1035] T d61b92f0d3544616a61cb063bc52ae32 P 7ca7abd38a5f4e6b8481eb78b8ab800f [LEADER]: Connected to new peer: Peer: permanent_uuid: "97a0d3251aa94bdcb9088542cba47652" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 37219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:07:49.938623 2680 consensus_queue.cc:1035] T d61b92f0d3544616a61cb063bc52ae32 P 7ca7abd38a5f4e6b8481eb78b8ab800f [LEADER]: Connected to new peer: Peer: permanent_uuid: "18d6367c47e848e2863b9d2adab74ccf" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 38359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:07:49.941133 2685 mvcc.cc:205] Tried to move back new op lower bound from 7317240504063401984 to 7317240504012087296. Current Snapshot: MvccSnapshot[applied={T|T < 7317240504063401984}]
I20260811 08:07:49.941346 2686 mvcc.cc:205] Tried to move back new op lower bound from 7317240504063401984 to 7317240504012087296. Current Snapshot: MvccSnapshot[applied={T|T < 7317240504063401984}]
I20260811 08:07:49.941870 2687 mvcc.cc:205] Tried to move back new op lower bound from 7317240504063401984 to 7317240504012087296. Current Snapshot: MvccSnapshot[applied={T|T < 7317240504063401984}]
I20260811 08:07:49.944173 2141 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48434:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:07:49.944280 2141 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48434:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:07:49.945093 2141 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5f03d6c255d246eda988489ffc77733d: Sending DeleteTablet for 3 replicas of tablet d61b92f0d3544616a61cb063bc52ae32
I20260811 08:07:49.945425 2578 tablet_service.cc:1514] Processing DeleteTablet for tablet d61b92f0d3544616a61cb063bc52ae32 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:07:49 UTC) from {username='kudu', principal='kudu/127.15.36.254@KRBTEST.COM'} at 127.0.0.1:42898
I20260811 08:07:49.945530 2280 tablet_service.cc:1514] Processing DeleteTablet for tablet d61b92f0d3544616a61cb063bc52ae32 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:07:49 UTC) from {username='kudu', principal='kudu/127.15.36.254@KRBTEST.COM'} at 127.0.0.1:59998
I20260811 08:07:49.945782 2695 tablet_replica.cc:330] T d61b92f0d3544616a61cb063bc52ae32 P 18d6367c47e848e2863b9d2adab74ccf: stopping tablet replica
I20260811 08:07:49.945782 2429 tablet_service.cc:1514] Processing DeleteTablet for tablet d61b92f0d3544616a61cb063bc52ae32 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:07:49 UTC) from {username='kudu', principal='kudu/127.15.36.254@KRBTEST.COM'} at 127.0.0.1:33408
I20260811 08:07:49.945911 2695 raft_consensus.cc:2229] T d61b92f0d3544616a61cb063bc52ae32 P 18d6367c47e848e2863b9d2adab74ccf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:07:49.946053 2695 raft_consensus.cc:2258] T d61b92f0d3544616a61cb063bc52ae32 P 18d6367c47e848e2863b9d2adab74ccf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:07:49.946050 2696 tablet_replica.cc:330] T d61b92f0d3544616a61cb063bc52ae32 P 97a0d3251aa94bdcb9088542cba47652: stopping tablet replica
I20260811 08:07:49.946158 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 2212
I20260811 08:07:49.946197 2696 raft_consensus.cc:2229] T d61b92f0d3544616a61cb063bc52ae32 P 97a0d3251aa94bdcb9088542cba47652 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:07:49.946312 2696 raft_consensus.cc:2258] T d61b92f0d3544616a61cb063bc52ae32 P 97a0d3251aa94bdcb9088542cba47652 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:07:49.947407 2696 ts_tablet_manager.cc:1905] T d61b92f0d3544616a61cb063bc52ae32 P 97a0d3251aa94bdcb9088542cba47652: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:07:49.950129 2696 ts_tablet_manager.cc:1918] T d61b92f0d3544616a61cb063bc52ae32 P 97a0d3251aa94bdcb9088542cba47652: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:07:49.950305 2696 log.cc:1196] T d61b92f0d3544616a61cb063bc52ae32 P 97a0d3251aa94bdcb9088542cba47652: Deleting WAL directory at /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/minicluster-data/ts-1/wal/wals/d61b92f0d3544616a61cb063bc52ae32
I20260811 08:07:49.950718 2696 ts_tablet_manager.cc:1939] T d61b92f0d3544616a61cb063bc52ae32 P 97a0d3251aa94bdcb9088542cba47652: Deleting consensus metadata
I20260811 08:07:49.952335 2694 tablet_replica.cc:330] T d61b92f0d3544616a61cb063bc52ae32 P 7ca7abd38a5f4e6b8481eb78b8ab800f: stopping tablet replica
I20260811 08:07:49.952503 2694 raft_consensus.cc:2229] T d61b92f0d3544616a61cb063bc52ae32 P 7ca7abd38a5f4e6b8481eb78b8ab800f [term 1 LEADER]: Raft consensus shutting down.
I20260811 08:07:49.952670 2694 raft_consensus.cc:2258] T d61b92f0d3544616a61cb063bc52ae32 P 7ca7abd38a5f4e6b8481eb78b8ab800f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:07:49.954030 2126 catalog_manager.cc:4841] TS 97a0d3251aa94bdcb9088542cba47652 (127.15.36.194:37219): tablet d61b92f0d3544616a61cb063bc52ae32 (table test-table [id=8ace7d1ae1c944a0835c1e1ee6aeeb8f]) successfully deleted
I20260811 08:07:49.954442 2694 ts_tablet_manager.cc:1905] T d61b92f0d3544616a61cb063bc52ae32 P 7ca7abd38a5f4e6b8481eb78b8ab800f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:07:49.956288 2694 ts_tablet_manager.cc:1918] T d61b92f0d3544616a61cb063bc52ae32 P 7ca7abd38a5f4e6b8481eb78b8ab800f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:07:49.956377 2694 log.cc:1196] T d61b92f0d3544616a61cb063bc52ae32 P 7ca7abd38a5f4e6b8481eb78b8ab800f: Deleting WAL directory at /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786435400844580-15507-0/minicluster-data/ts-2/wal/wals/d61b92f0d3544616a61cb063bc52ae32
W20260811 08:07:49.956629 2126 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.36.193:38359 (error 108)
I20260811 08:07:49.956658 2694 ts_tablet_manager.cc:1939] T d61b92f0d3544616a61cb063bc52ae32 P 7ca7abd38a5f4e6b8481eb78b8ab800f: Deleting consensus metadata
I20260811 08:07:49.957079 2127 catalog_manager.cc:4841] TS 7ca7abd38a5f4e6b8481eb78b8ab800f (127.15.36.195:40309): tablet d61b92f0d3544616a61cb063bc52ae32 (table test-table [id=8ace7d1ae1c944a0835c1e1ee6aeeb8f]) successfully deleted
I20260811 08:07:49.957247 2664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:49.957094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.193:38359 (local address 127.0.0.1:60002)
0811 08:07:49.957149 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:49.957207 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.193:38359: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260811 08:07:49.957389 2126 catalog_manager.cc:4584] TS 18d6367c47e848e2863b9d2adab74ccf (127.15.36.193:38359): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d61b92f0d3544616a61cb063bc52ae32: Network error: Client connection negotiation failed: client connection to 127.15.36.193:38359: connect: Connection refused (error 111)
I20260811 08:07:49.957868 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 2362
I20260811 08:07:49.965418 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 2507
I20260811 08:07:49.974876 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 2107
2026-08-11T08:07:49Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2189 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-11T08:07:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:07:49Z Disabled control of system clock
I20260811 08:07:50.006220 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435400844580-15507-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435400844580-15507-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435400844580-15507-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:34441
--webserver_interface=127.15.36.254
--webserver_port=0
--builtin_ntp_servers=127.15.36.212:33717
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.36.254:34441
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 08:07:50.092070 2703 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:07:50.092314 2703 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:07:50.092335 2703 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:07:50.093497 2703 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:07:50.093535 2703 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:07:50.093549 2703 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:07:50.093561 2703 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:07:50.093575 2703 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:07:50.094933 2703 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:33717
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435400844580-15507-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435400844580-15507-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.36.254:34441
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:34441
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.36.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2703
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435400844580-15507-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:07:50.095175 2703 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:07:50.095432 2703 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:07:50.100445 2712 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:07:50.100466 2709 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:07:50.100632 2703 server_base.cc:1034] running on GCE node
W20260811 08:07:50.100509 2710 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:07:50.100965 2703 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:07:50.101305 2703 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:07:50.102491 2703 hybrid_clock.cc:648] HybridClock initialized: now 1786435670102480 us; error 44 us; skew 500 ppm
I20260811 08:07:50.103972 2703 webserver.cc:460] Webserver started at http://127.15.36.254:38899/ using document root <none> and password file <none>
I20260811 08:07:50.104202 2703 fs_manager.cc:359] Metadata directory not provided
I20260811 08:07:50.104269 2703 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:07:50.104369 2703 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:07:50.105475 2703 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435400844580-15507-0/minicluster-data/master-0/data/instance:
uuid: "558b84e2d3f04181b903e0e6411898f5"
format_stamp: "Formatted at 2026-08-11 08:07:50 on dist-test-slave-2w3w"
server_key: "0e3e49551a997f6bef9bf306e1d38ceb"
server_key_iv: "557883950cf257c36b9e5ecc9d3da275"
server_key_version: "encryptionkey@0"
I20260811 08:07:50.105795 2703 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435400844580-15507-0/minicluster-data/master-0/wal/instance:
uuid: "558b84e2d3f04181b903e0e6411898f5"
format_stamp: "Formatted at 2026-08-11 08:07:50 on dist-test-slave-2w3w"
server_key: "0e3e49551a997f6bef9bf306e1d38ceb"
server_key_iv: "557883950cf257c36b9e5ecc9d3da275"
server_key_version: "encryptionkey@0"
I20260811 08:07:50.107236 2703 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 08:07:50.108080 2718 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:50.108314 2703 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:07:50.108398 2703 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435400844580-15507-0/minicluster-data/master-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435400844580-15507-0/minicluster-data/master-0/wal
uuid: "558b84e2d3f04181b903e0e6411898f5"
format_stamp: "Formatted at 2026-08-11 08:07:50 on dist-test-slave-2w3w"
server_key: "0e3e49551a997f6bef9bf306e1d38ceb"
server_key_iv: "557883950cf257c36b9e5ecc9d3da275"
server_key_version: "encryptionkey@0"
I20260811 08:07:50.108464 2703 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435400844580-15507-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435400844580-15507-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435400844580-15507-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:07:50.117810 2703 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:07:50.118124 2703 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:07:50.118235 2703 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:07:50.122562 2703 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.254:34441
I20260811 08:07:50.122659 2782 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.254:34441 every 8 connection(s)
I20260811 08:07:50.123127 2703 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
I20260811 08:07:50.124310 2783 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:07:50.126847 2783 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 558b84e2d3f04181b903e0e6411898f5: Bootstrap starting.
I20260811 08:07:50.127547 2783 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 558b84e2d3f04181b903e0e6411898f5: Neither blocks nor log segments found. Creating new log.
I20260811 08:07:50.127908 2783 log.cc:824] T 00000000000000000000000000000000 P 558b84e2d3f04181b903e0e6411898f5: Log is configured to *not* fsync() on all Append() calls
I20260811 08:07:50.128669 2783 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 558b84e2d3f04181b903e0e6411898f5: No bootstrap required, opened a new log
I20260811 08:07:50.130522 2783 raft_consensus.cc:348] T 00000000000000000000000000000000 P 558b84e2d3f04181b903e0e6411898f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "558b84e2d3f04181b903e0e6411898f5" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 34441 } }
I20260811 08:07:50.130705 2783 raft_consensus.cc:374] T 00000000000000000000000000000000 P 558b84e2d3f04181b903e0e6411898f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:07:50.130761 2783 raft_consensus.cc:729] T 00000000000000000000000000000000 P 558b84e2d3f04181b903e0e6411898f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 558b84e2d3f04181b903e0e6411898f5, State: Initialized, Role: FOLLOWER
I20260811 08:07:50.131006 2783 consensus_queue.cc:260] T 00000000000000000000000000000000 P 558b84e2d3f04181b903e0e6411898f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "558b84e2d3f04181b903e0e6411898f5" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 34441 } }
I20260811 08:07:50.131108 2783 raft_consensus.cc:388] T 00000000000000000000000000000000 P 558b84e2d3f04181b903e0e6411898f5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:07:50.131157 2783 raft_consensus.cc:482] T 00000000000000000000000000000000 P 558b84e2d3f04181b903e0e6411898f5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:07:50.131212 2783 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 558b84e2d3f04181b903e0e6411898f5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:07:50.131821 2783 raft_consensus.cc:504] T 00000000000000000000000000000000 P 558b84e2d3f04181b903e0e6411898f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "558b84e2d3f04181b903e0e6411898f5" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 34441 } }
I20260811 08:07:50.131956 2783 leader_election.cc:302] T 00000000000000000000000000000000 P 558b84e2d3f04181b903e0e6411898f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 558b84e2d3f04181b903e0e6411898f5; no voters:
I20260811 08:07:50.131996 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 2703
I20260811 08:07:50.132125 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435400844580-15507-0/minicluster-data/master-0/wal/instance
I20260811 08:07:50.132212 2783 leader_election.cc:288] T 00000000000000000000000000000000 P 558b84e2d3f04181b903e0e6411898f5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:07:50.132318 2788 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 558b84e2d3f04181b903e0e6411898f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:07:50.132354 15507 external_mini_cluster.cc:1428] Setting key 2414637f30b35541c5b1d92ccbf9a6c1
I20260811 08:07:50.132507 2783 sys_catalog.cc:564] T 00000000000000000000000000000000 P 558b84e2d3f04181b903e0e6411898f5 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:07:50.132581 2788 raft_consensus.cc:686] T 00000000000000000000000000000000 P 558b84e2d3f04181b903e0e6411898f5 [term 1 LEADER]: Becoming Leader. State: Replica: 558b84e2d3f04181b903e0e6411898f5, State: Running, Role: LEADER
I20260811 08:07:50.132702 2788 consensus_queue.cc:237] T 00000000000000000000000000000000 P 558b84e2d3f04181b903e0e6411898f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "558b84e2d3f04181b903e0e6411898f5" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 34441 } }
I20260811 08:07:50.133294 2789 sys_catalog.cc:455] T 00000000000000000000000000000000 P 558b84e2d3f04181b903e0e6411898f5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "558b84e2d3f04181b903e0e6411898f5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "558b84e2d3f04181b903e0e6411898f5" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 34441 } } }
I20260811 08:07:50.133420 2789 sys_catalog.cc:458] T 00000000000000000000000000000000 P 558b84e2d3f04181b903e0e6411898f5 [sys.catalog]: This master's current role is: LEADER
I20260811 08:07:50.133611 2790 sys_catalog.cc:455] T 00000000000000000000000000000000 P 558b84e2d3f04181b903e0e6411898f5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 558b84e2d3f04181b903e0e6411898f5. Latest consensus state: current_term: 1 leader_uuid: "558b84e2d3f04181b903e0e6411898f5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "558b84e2d3f04181b903e0e6411898f5" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 34441 } } }
I20260811 08:07:50.133637 2799 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:07:50.133704 2790 sys_catalog.cc:458] T 00000000000000000000000000000000 P 558b84e2d3f04181b903e0e6411898f5 [sys.catalog]: This master's current role is: LEADER
I20260811 08:07:50.134232 2799 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:07:50.136087 2799 catalog_manager.cc:1347] Generated new cluster ID: fb0996225c494041b80f1842b099ceac
I20260811 08:07:50.136149 2799 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:07:50.140798 2793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:50.133040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55138 (local address 127.15.36.254:34441)
0811 08:07:50.133258 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:50.133269 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:50.133990 (+ 721us) server_negotiation.cc:407] Connection header received
0811 08:07:50.134221 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:50.134229 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:50.134307 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:50.134436 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:07:50.134940 (+ 504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:50.136522 (+ 1582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:50.137825 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:50.138597 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:50.138709 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:50.139861 (+ 1152us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:07:50.139866 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:07:50.139867 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:07:50.140114 (+ 247us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:07:50.140166 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:07:50.140184 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:07:50.140232 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:50.140414 (+ 182us) server_negotiation.cc:299] Negotiation successful
0811 08:07:50.140522 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":66,"threads_started":1}
I20260811 08:07:50.142839 2799 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:07:50.143739 2799 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:07:50.155768 2799 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 558b84e2d3f04181b903e0e6411898f5: Generated new TSK 0
I20260811 08:07:50.155997 2799 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:07:50.159454 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435400844580-15507-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435400844580-15507-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435400844580-15507-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.193:0
--local_ip_for_outbound_sockets=127.15.36.193
--webserver_interface=127.15.36.193
--webserver_port=0
--tserver_master_addrs=127.15.36.254:34441
--builtin_ntp_servers=127.15.36.212:33717
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 08:07:50.246645 2812 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:07:50.246855 2812 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:07:50.246878 2812 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:07:50.248091 2812 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:07:50.248135 2812 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:07:50.248162 2812 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.193
I20260811 08:07:50.249522 2812 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:33717
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435400844580-15507-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435400844580-15507-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.36.193
--webserver_port=0
--tserver_master_addrs=127.15.36.254:34441
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2812
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.193
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435400844580-15507-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:07:50.249768 2812 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:07:50.250084 2812 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:07:50.255311 2818 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:07:50.255503 2812 server_base.cc:1034] running on GCE node
W20260811 08:07:50.255565 2817 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:07:50.255609 2820 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:07:50.255815 2812 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:07:50.256100 2812 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:07:50.257257 2812 hybrid_clock.cc:648] HybridClock initialized: now 1786435670257233 us; error 43 us; skew 500 ppm
I20260811 08:07:50.258665 2812 webserver.cc:460] Webserver started at http://127.15.36.193:36221/ using document root <none> and password file <none>
I20260811 08:07:50.259002 2812 fs_manager.cc:359] Metadata directory not provided
I20260811 08:07:50.259076 2812 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:07:50.259261 2812 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:07:50.260411 2812 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435400844580-15507-0/minicluster-data/ts-0/data/instance:
uuid: "883b9795cb2b498fab593c29856a0842"
format_stamp: "Formatted at 2026-08-11 08:07:50 on dist-test-slave-2w3w"
server_key: "ff00355323b85d7567a24cf1d4b6d0ad"
server_key_iv: "d2c1a4b1e6235eef64fc7e43e31e4583"
server_key_version: "encryptionkey@0"
I20260811 08:07:50.260840 2812 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435400844580-15507-0/minicluster-data/ts-0/wal/instance:
uuid: "883b9795cb2b498fab593c29856a0842"
format_stamp: "Formatted at 2026-08-11 08:07:50 on dist-test-slave-2w3w"
server_key: "ff00355323b85d7567a24cf1d4b6d0ad"
server_key_iv: "d2c1a4b1e6235eef64fc7e43e31e4583"
server_key_version: "encryptionkey@0"
I20260811 08:07:50.262223 2812 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 08:07:50.263055 2826 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:50.263296 2812 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:07:50.263396 2812 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435400844580-15507-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435400844580-15507-0/minicluster-data/ts-0/wal
uuid: "883b9795cb2b498fab593c29856a0842"
format_stamp: "Formatted at 2026-08-11 08:07:50 on dist-test-slave-2w3w"
server_key: "ff00355323b85d7567a24cf1d4b6d0ad"
server_key_iv: "d2c1a4b1e6235eef64fc7e43e31e4583"
server_key_version: "encryptionkey@0"
I20260811 08:07:50.263464 2812 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435400844580-15507-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435400844580-15507-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435400844580-15507-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:07:50.288080 2812 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:07:50.288388 2812 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:07:50.288498 2812 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:07:50.288699 2812 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:07:50.288992 2812 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:07:50.289026 2812 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:50.289049 2812 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:07:50.289062 2812 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:50.295449 2812 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.193:35043
I20260811 08:07:50.295495 2954 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.193:35043 every 8 connection(s)
I20260811 08:07:50.295907 2812 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
I20260811 08:07:50.301877 2793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:50.296933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:38291 (local address 127.15.36.254:34441)
0811 08:07:50.296996 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:50.296999 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:50.297159 (+ 160us) server_negotiation.cc:407] Connection header received
0811 08:07:50.297654 (+ 495us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:50.297655 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:50.297668 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:50.297739 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:07:50.298436 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:50.299067 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:50.300274 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:50.300496 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:50.300568 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:50.301538 (+ 970us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:07:50.301539 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:07:50.301540 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:07:50.301545 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:07:50.301560 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:07:50.301564 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:07:50.301620 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:50.301763 (+ 143us) server_negotiation.cc:299] Negotiation successful
0811 08:07:50.301800 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 08:07:50.302165 2957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:50.296815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:34441 (local address 127.15.36.193:38291)
0811 08:07:50.297035 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:50.297079 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 08:07:50.297578 (+ 499us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:07:50.297794 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:07:50.297797 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:07:50.297806 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:07:50.298334 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:50.298339 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:50.299175 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:50.299176 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:50.300119 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:50.300123 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:50.300631 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:50.300632 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:50.300769 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:50.301371 (+ 602us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 08:07:50.301372 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:07:50.301403 (+ 31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 08:07:50.301430 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:07:50.301658 (+ 228us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:07:50.301667 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:07:50.301670 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:07:50.301755 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 08:07:50.301875 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":118,"threads_started":1}
I20260811 08:07:50.302775 2955 heartbeater.cc:347] Connected to a master server at 127.15.36.254:34441
I20260811 08:07:50.302881 2955 heartbeater.cc:464] Registering TS with master...
I20260811 08:07:50.303071 2955 heartbeater.cc:511] Master 127.15.36.254:34441 requested a full tablet report, sending...
I20260811 08:07:50.303609 2740 ts_manager.cc:194] Registered new tserver with Master: 883b9795cb2b498fab593c29856a0842 (127.15.36.193:35043)
I20260811 08:07:50.304355 2740 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.36.193:38291
I20260811 08:07:50.306005 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 2812
I20260811 08:07:50.306092 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435400844580-15507-0/minicluster-data/ts-0/wal/instance
I20260811 08:07:50.306344 15507 external_mini_cluster.cc:1428] Setting key d52a1f790992775f4d8866dbfe9cfa87
I20260811 08:07:50.307701 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435400844580-15507-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435400844580-15507-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435400844580-15507-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.194:0
--local_ip_for_outbound_sockets=127.15.36.194
--webserver_interface=127.15.36.194
--webserver_port=0
--tserver_master_addrs=127.15.36.254:34441
--builtin_ntp_servers=127.15.36.212:33717
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 08:07:50.392350 2958 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:07:50.392627 2958 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:07:50.392665 2958 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:07:50.393882 2958 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:07:50.393959 2958 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:07:50.394006 2958 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.194
I20260811 08:07:50.395692 2958 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:33717
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435400844580-15507-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435400844580-15507-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.36.194
--webserver_port=0
--tserver_master_addrs=127.15.36.254:34441
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2958
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.194
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435400844580-15507-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:07:50.396004 2958 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:07:50.396351 2958 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:07:50.401857 2968 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:07:50.401850 2964 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:07:50.401857 2965 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:07:50.402438 2958 server_base.cc:1034] running on GCE node
I20260811 08:07:50.402678 2958 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:07:50.403017 2958 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:07:50.404211 2958 hybrid_clock.cc:648] HybridClock initialized: now 1786435670404198 us; error 32 us; skew 500 ppm
I20260811 08:07:50.405683 2958 webserver.cc:460] Webserver started at http://127.15.36.194:40363/ using document root <none> and password file <none>
I20260811 08:07:50.405990 2958 fs_manager.cc:359] Metadata directory not provided
I20260811 08:07:50.406071 2958 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:07:50.406239 2958 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:07:50.407519 2958 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435400844580-15507-0/minicluster-data/ts-1/data/instance:
uuid: "c06512f413484170bb8951a6b466ca76"
format_stamp: "Formatted at 2026-08-11 08:07:50 on dist-test-slave-2w3w"
server_key: "35b2dc8a5f28b663b1da27ed8490e5e8"
server_key_iv: "9a321410590d4a6d33927f104476aab8"
server_key_version: "encryptionkey@0"
I20260811 08:07:50.407918 2958 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435400844580-15507-0/minicluster-data/ts-1/wal/instance:
uuid: "c06512f413484170bb8951a6b466ca76"
format_stamp: "Formatted at 2026-08-11 08:07:50 on dist-test-slave-2w3w"
server_key: "35b2dc8a5f28b663b1da27ed8490e5e8"
server_key_iv: "9a321410590d4a6d33927f104476aab8"
server_key_version: "encryptionkey@0"
I20260811 08:07:50.409391 2958 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 08:07:50.410348 2975 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:50.410593 2958 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:07:50.410732 2958 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435400844580-15507-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435400844580-15507-0/minicluster-data/ts-1/wal
uuid: "c06512f413484170bb8951a6b466ca76"
format_stamp: "Formatted at 2026-08-11 08:07:50 on dist-test-slave-2w3w"
server_key: "35b2dc8a5f28b663b1da27ed8490e5e8"
server_key_iv: "9a321410590d4a6d33927f104476aab8"
server_key_version: "encryptionkey@0"
I20260811 08:07:50.410828 2958 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435400844580-15507-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435400844580-15507-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435400844580-15507-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:07:50.428201 2958 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:07:50.428570 2958 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:07:50.428759 2958 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:07:50.429122 2958 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:07:50.429554 2958 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:07:50.429596 2958 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:50.429625 2958 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:07:50.429639 2958 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:50.436378 2958 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.194:37335
I20260811 08:07:50.436471 3103 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.194:37335 every 8 connection(s)
I20260811 08:07:50.436892 2958 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
I20260811 08:07:50.442550 2793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:50.437767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:34541 (local address 127.15.36.254:34441)
0811 08:07:50.437823 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:50.437825 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:50.438082 (+ 257us) server_negotiation.cc:407] Connection header received
0811 08:07:50.438561 (+ 479us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:50.438562 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:50.438573 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:50.438638 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:07:50.439320 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:50.439830 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:50.440896 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:50.441105 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:50.441165 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:50.442140 (+ 975us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:07:50.442142 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:07:50.442142 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:07:50.442148 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:07:50.442170 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:07:50.442175 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:07:50.442240 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:50.442451 (+ 211us) server_negotiation.cc:299] Negotiation successful
0811 08:07:50.442483 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 08:07:50.442759 3106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:50.437725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:34441 (local address 127.15.36.194:34541)
0811 08:07:50.437925 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:50.437975 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 08:07:50.438464 (+ 489us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:07:50.438689 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:07:50.438692 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:07:50.438701 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:07:50.439229 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:50.439234 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:50.439923 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:50.439924 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:50.440792 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:50.440795 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:50.441188 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:50.441189 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:50.441303 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:50.441940 (+ 637us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 08:07:50.441940 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:07:50.441969 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 08:07:50.441996 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:07:50.442277 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:07:50.442285 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:07:50.442288 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:07:50.442406 (+ 118us) client_negotiation.cc:240] Negotiation successful
0811 08:07:50.442504 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":103,"threads_started":1}
I20260811 08:07:50.443415 3104 heartbeater.cc:347] Connected to a master server at 127.15.36.254:34441
I20260811 08:07:50.443549 3104 heartbeater.cc:464] Registering TS with master...
I20260811 08:07:50.443832 3104 heartbeater.cc:511] Master 127.15.36.254:34441 requested a full tablet report, sending...
I20260811 08:07:50.444098 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 2958
I20260811 08:07:50.444213 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435400844580-15507-0/minicluster-data/ts-1/wal/instance
I20260811 08:07:50.444367 2740 ts_manager.cc:194] Registered new tserver with Master: c06512f413484170bb8951a6b466ca76 (127.15.36.194:37335)
I20260811 08:07:50.444474 15507 external_mini_cluster.cc:1428] Setting key 1f98f6a075029c499bf00dc7aebacfc2
I20260811 08:07:50.444856 2740 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.36.194:34541
I20260811 08:07:50.445613 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435400844580-15507-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435400844580-15507-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435400844580-15507-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.195:0
--local_ip_for_outbound_sockets=127.15.36.195
--webserver_interface=127.15.36.195
--webserver_port=0
--tserver_master_addrs=127.15.36.254:34441
--builtin_ntp_servers=127.15.36.212:33717
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 08:07:50.531562 3107 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:07:50.531802 3107 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:07:50.531826 3107 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:07:50.533308 3107 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:07:50.533399 3107 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:07:50.533464 3107 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.195
I20260811 08:07:50.535117 3107 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:33717
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435400844580-15507-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435400844580-15507-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.36.195
--webserver_port=0
--tserver_master_addrs=127.15.36.254:34441
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3107
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.195
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435400844580-15507-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:07:50.535355 3107 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:07:50.535641 3107 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:07:50.541189 3115 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:07:50.541178 3112 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:07:50.541463 3107 server_base.cc:1034] running on GCE node
W20260811 08:07:50.541182 3113 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:07:50.541776 3107 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:07:50.542028 3107 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:07:50.543184 3107 hybrid_clock.cc:648] HybridClock initialized: now 1786435670543159 us; error 46 us; skew 500 ppm
I20260811 08:07:50.544605 3107 webserver.cc:460] Webserver started at http://127.15.36.195:38663/ using document root <none> and password file <none>
I20260811 08:07:50.544893 3107 fs_manager.cc:359] Metadata directory not provided
I20260811 08:07:50.544970 3107 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:07:50.545135 3107 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:07:50.546674 3107 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435400844580-15507-0/minicluster-data/ts-2/data/instance:
uuid: "69661914a4314a529a8cb2afb06ed89a"
format_stamp: "Formatted at 2026-08-11 08:07:50 on dist-test-slave-2w3w"
server_key: "fa64dd78c5f4531945618dc01755c25b"
server_key_iv: "729c4b358072fe8ab0017f3d1055087c"
server_key_version: "encryptionkey@0"
I20260811 08:07:50.547107 3107 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435400844580-15507-0/minicluster-data/ts-2/wal/instance:
uuid: "69661914a4314a529a8cb2afb06ed89a"
format_stamp: "Formatted at 2026-08-11 08:07:50 on dist-test-slave-2w3w"
server_key: "fa64dd78c5f4531945618dc01755c25b"
server_key_iv: "729c4b358072fe8ab0017f3d1055087c"
server_key_version: "encryptionkey@0"
I20260811 08:07:50.548538 3107 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:07:50.549372 3121 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:50.549569 3107 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:07:50.549674 3107 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435400844580-15507-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435400844580-15507-0/minicluster-data/ts-2/wal
uuid: "69661914a4314a529a8cb2afb06ed89a"
format_stamp: "Formatted at 2026-08-11 08:07:50 on dist-test-slave-2w3w"
server_key: "fa64dd78c5f4531945618dc01755c25b"
server_key_iv: "729c4b358072fe8ab0017f3d1055087c"
server_key_version: "encryptionkey@0"
I20260811 08:07:50.549764 3107 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435400844580-15507-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435400844580-15507-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435400844580-15507-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:07:50.565323 3107 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:07:50.565737 3107 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:07:50.565960 3107 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:07:50.566253 3107 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:07:50.566663 3107 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:07:50.566756 3107 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:50.566810 3107 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:07:50.566862 3107 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:50.573487 3107 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.195:33227
I20260811 08:07:50.573562 3249 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.195:33227 every 8 connection(s)
I20260811 08:07:50.573963 3107 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
I20260811 08:07:50.579520 2793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:50.574819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:57727 (local address 127.15.36.254:34441)
0811 08:07:50.574897 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:50.574900 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:50.575137 (+ 237us) server_negotiation.cc:407] Connection header received
0811 08:07:50.575623 (+ 486us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:50.575623 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:50.575635 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:50.575712 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:07:50.576420 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:50.576988 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:50.578046 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:50.578253 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:50.578317 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:50.579258 (+ 941us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:07:50.579259 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:07:50.579259 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:07:50.579264 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:07:50.579278 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:07:50.579282 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:07:50.579331 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:50.579419 (+ 88us) server_negotiation.cc:299] Negotiation successful
0811 08:07:50.579445 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 08:07:50.579701 3253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:50.574763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:34441 (local address 127.15.36.195:57727)
0811 08:07:50.574991 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:50.575034 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 08:07:50.575520 (+ 486us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:07:50.575793 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:07:50.575797 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:07:50.575805 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:07:50.576317 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:50.576321 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:50.577112 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:50.577113 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:50.577946 (+ 833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:50.577949 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:50.578356 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:50.578356 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:50.578478 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:50.579116 (+ 638us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 08:07:50.579116 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:07:50.579146 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 08:07:50.579170 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:07:50.579351 (+ 181us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:07:50.579354 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:07:50.579356 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 08:07:50.579408 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 08:07:50.579489 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":98,"threads_started":1}
I20260811 08:07:50.580199 3250 heartbeater.cc:347] Connected to a master server at 127.15.36.254:34441
I20260811 08:07:50.580309 3250 heartbeater.cc:464] Registering TS with master...
I20260811 08:07:50.580528 3250 heartbeater.cc:511] Master 127.15.36.254:34441 requested a full tablet report, sending...
I20260811 08:07:50.580992 2738 ts_manager.cc:194] Registered new tserver with Master: 69661914a4314a529a8cb2afb06ed89a (127.15.36.195:33227)
I20260811 08:07:50.581409 2738 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.36.195:57727
I20260811 08:07:50.581549 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 3107
I20260811 08:07:50.581660 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435400844580-15507-0/minicluster-data/ts-2/wal/instance
I20260811 08:07:50.581924 15507 external_mini_cluster.cc:1428] Setting key d04ef752efde79336f4ba7ea3d7fe871
I20260811 08:07:50.583212 15507 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 08:07:50.587778 2793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:50.584661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55154 (local address 127.15.36.254:34441)
0811 08:07:50.584740 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:50.584743 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:50.584882 (+ 139us) server_negotiation.cc:407] Connection header received
0811 08:07:50.584953 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:50.584954 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:50.584967 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:50.585044 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:07:50.585237 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:50.585727 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:50.586485 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:50.586683 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:50.586762 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:50.587507 (+ 745us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:07:50.587508 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:07:50.587509 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:07:50.587514 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:07:50.587535 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:07:50.587539 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:07:50.587599 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:50.587663 (+ 64us) server_negotiation.cc:299] Negotiation successful
0811 08:07:50.587687 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 08:07:50.589607 2738 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55154:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:07:50.591327 2738 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:07:50.598052 3260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:50.593685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.195:33227 (local address 127.0.0.1:40456)
0811 08:07:50.593922 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:50.593976 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 08:07:50.594060 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:07:50.594371 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:07:50.594376 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:07:50.594378 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:07:50.594554 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:50.594557 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:50.595676 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:50.595677 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:50.596865 (+ 1188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:50.596868 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:50.597727 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:50.597728 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:50.597819 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:50.597832 (+ 13us) client_negotiation.cc:769] Sending connection context
0811 08:07:50.597913 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 08:07:50.597972 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":196,"mutex_wait_us":1,"thread_start_us":85,"threads_started":1}
I20260811 08:07:50.598068 3262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:50.593927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40456 (local address 127.15.36.195:33227)
0811 08:07:50.594141 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:50.594146 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:50.594156 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:07:50.594193 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:50.594195 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:50.594243 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:50.594362 (+ 119us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:07:50.594645 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:50.595586 (+ 941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:50.596964 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:50.597633 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:50.597755 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:50.597857 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:50.597928 (+ 71us) server_negotiation.cc:299] Negotiation successful
0811 08:07:50.597966 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":179,"thread_start_us":93,"threads_started":1}
I20260811 08:07:50.598625 3261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:50.593930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.194:37335 (local address 127.0.0.1:43418)
0811 08:07:50.594350 (+ 420us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:50.594361 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:07:50.594415 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:07:50.594647 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:07:50.594648 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:07:50.594650 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:07:50.594697 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:50.594699 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:50.596145 (+ 1446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:50.596146 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:50.597189 (+ 1043us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:50.597192 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:50.598407 (+ 1215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:50.598408 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:50.598469 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:50.598474 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 08:07:50.598530 (+ 56us) client_negotiation.cc:240] Negotiation successful
0811 08:07:50.598576 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":404,"mutex_wait_us":30,"thread_start_us":85,"threads_started":1}
I20260811 08:07:50.598665 3264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:50.594160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43418 (local address 127.15.36.194:37335)
0811 08:07:50.594358 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:50.594362 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:50.594406 (+ 44us) server_negotiation.cc:407] Connection header received
0811 08:07:50.594485 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:50.594487 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:50.594502 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:50.594580 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:07:50.594800 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:50.596044 (+ 1244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:50.597364 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:50.598333 (+ 969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:50.598404 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:50.598482 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:50.598543 (+ 61us) server_negotiation.cc:299] Negotiation successful
0811 08:07:50.598583 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":89,"threads_started":1}
I20260811 08:07:50.599004 3177 tablet_service.cc:1467] Processing CreateTablet for tablet ec05c92c1bf34dee9ce6a4579f3bb363 (DEFAULT_TABLE table=test-table [id=2f872849ba6a4876a7d5e6d1af23f6a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:07:50.599274 3028 tablet_service.cc:1467] Processing CreateTablet for tablet ec05c92c1bf34dee9ce6a4579f3bb363 (DEFAULT_TABLE table=test-table [id=2f872849ba6a4876a7d5e6d1af23f6a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:07:50.599412 3177 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ec05c92c1bf34dee9ce6a4579f3bb363. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:07:50.599586 3028 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ec05c92c1bf34dee9ce6a4579f3bb363. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:07:50.599582 3259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:50.593750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.193:35043 (local address 127.0.0.1:33532)
0811 08:07:50.594155 (+ 405us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:50.594165 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:07:50.594222 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:07:50.594786 (+ 564us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:07:50.594787 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:07:50.594789 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:07:50.594827 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:50.594828 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:50.596154 (+ 1326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:50.596155 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:50.597265 (+ 1110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:50.597268 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:50.599347 (+ 2079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:50.599348 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:50.599396 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:50.599399 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:07:50.599473 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 08:07:50.599511 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":389,"mutex_wait_us":25,"thread_start_us":105,"threads_started":1}
I20260811 08:07:50.599926 3263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:50.593930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33532 (local address 127.15.36.193:35043)
0811 08:07:50.594550 (+ 620us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:50.594555 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:50.594566 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:07:50.594608 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:50.594610 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:50.594626 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:50.594701 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:07:50.594920 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:50.596044 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:50.597360 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:50.598482 (+ 1122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:50.599196 (+ 714us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:50.599315 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:50.599788 (+ 473us) server_negotiation.cc:299] Negotiation successful
0811 08:07:50.599842 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":578,"thread_start_us":122,"threads_started":1}
I20260811 08:07:50.603706 2880 tablet_service.cc:1467] Processing CreateTablet for tablet ec05c92c1bf34dee9ce6a4579f3bb363 (DEFAULT_TABLE table=test-table [id=2f872849ba6a4876a7d5e6d1af23f6a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:07:50.604001 2880 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ec05c92c1bf34dee9ce6a4579f3bb363. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:07:50.606885 3267 tablet_bootstrap.cc:492] T ec05c92c1bf34dee9ce6a4579f3bb363 P 883b9795cb2b498fab593c29856a0842: Bootstrap starting.
I20260811 08:07:50.606930 3266 tablet_bootstrap.cc:492] T ec05c92c1bf34dee9ce6a4579f3bb363 P c06512f413484170bb8951a6b466ca76: Bootstrap starting.
I20260811 08:07:50.607095 3265 tablet_bootstrap.cc:492] T ec05c92c1bf34dee9ce6a4579f3bb363 P 69661914a4314a529a8cb2afb06ed89a: Bootstrap starting.
I20260811 08:07:50.607641 3266 tablet_bootstrap.cc:654] T ec05c92c1bf34dee9ce6a4579f3bb363 P c06512f413484170bb8951a6b466ca76: Neither blocks nor log segments found. Creating new log.
I20260811 08:07:50.607708 3267 tablet_bootstrap.cc:654] T ec05c92c1bf34dee9ce6a4579f3bb363 P 883b9795cb2b498fab593c29856a0842: Neither blocks nor log segments found. Creating new log.
I20260811 08:07:50.607760 3265 tablet_bootstrap.cc:654] T ec05c92c1bf34dee9ce6a4579f3bb363 P 69661914a4314a529a8cb2afb06ed89a: Neither blocks nor log segments found. Creating new log.
I20260811 08:07:50.608021 3266 log.cc:824] T ec05c92c1bf34dee9ce6a4579f3bb363 P c06512f413484170bb8951a6b466ca76: Log is configured to *not* fsync() on all Append() calls
I20260811 08:07:50.608081 3265 log.cc:824] T ec05c92c1bf34dee9ce6a4579f3bb363 P 69661914a4314a529a8cb2afb06ed89a: Log is configured to *not* fsync() on all Append() calls
I20260811 08:07:50.608084 3267 log.cc:824] T ec05c92c1bf34dee9ce6a4579f3bb363 P 883b9795cb2b498fab593c29856a0842: Log is configured to *not* fsync() on all Append() calls
I20260811 08:07:50.608942 3267 tablet_bootstrap.cc:492] T ec05c92c1bf34dee9ce6a4579f3bb363 P 883b9795cb2b498fab593c29856a0842: No bootstrap required, opened a new log
I20260811 08:07:50.608940 3266 tablet_bootstrap.cc:492] T ec05c92c1bf34dee9ce6a4579f3bb363 P c06512f413484170bb8951a6b466ca76: No bootstrap required, opened a new log
I20260811 08:07:50.609025 3266 ts_tablet_manager.cc:1397] T ec05c92c1bf34dee9ce6a4579f3bb363 P c06512f413484170bb8951a6b466ca76: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 08:07:50.609025 3267 ts_tablet_manager.cc:1397] T ec05c92c1bf34dee9ce6a4579f3bb363 P 883b9795cb2b498fab593c29856a0842: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260811 08:07:50.609020 3265 tablet_bootstrap.cc:492] T ec05c92c1bf34dee9ce6a4579f3bb363 P 69661914a4314a529a8cb2afb06ed89a: No bootstrap required, opened a new log
I20260811 08:07:50.609089 3265 ts_tablet_manager.cc:1397] T ec05c92c1bf34dee9ce6a4579f3bb363 P 69661914a4314a529a8cb2afb06ed89a: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20260811 08:07:50.611369 3265 raft_consensus.cc:348] T ec05c92c1bf34dee9ce6a4579f3bb363 P 69661914a4314a529a8cb2afb06ed89a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69661914a4314a529a8cb2afb06ed89a" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 33227 } } peers { permanent_uuid: "883b9795cb2b498fab593c29856a0842" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 35043 } } peers { permanent_uuid: "c06512f413484170bb8951a6b466ca76" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 37335 } }
I20260811 08:07:50.611531 3265 raft_consensus.cc:374] T ec05c92c1bf34dee9ce6a4579f3bb363 P 69661914a4314a529a8cb2afb06ed89a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:07:50.611569 3265 raft_consensus.cc:729] T ec05c92c1bf34dee9ce6a4579f3bb363 P 69661914a4314a529a8cb2afb06ed89a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69661914a4314a529a8cb2afb06ed89a, State: Initialized, Role: FOLLOWER
I20260811 08:07:50.611697 3265 consensus_queue.cc:260] T ec05c92c1bf34dee9ce6a4579f3bb363 P 69661914a4314a529a8cb2afb06ed89a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69661914a4314a529a8cb2afb06ed89a" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 33227 } } peers { permanent_uuid: "883b9795cb2b498fab593c29856a0842" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 35043 } } peers { permanent_uuid: "c06512f413484170bb8951a6b466ca76" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 37335 } }
I20260811 08:07:50.611850 3266 raft_consensus.cc:348] T ec05c92c1bf34dee9ce6a4579f3bb363 P c06512f413484170bb8951a6b466ca76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69661914a4314a529a8cb2afb06ed89a" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 33227 } } peers { permanent_uuid: "883b9795cb2b498fab593c29856a0842" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 35043 } } peers { permanent_uuid: "c06512f413484170bb8951a6b466ca76" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 37335 } }
I20260811 08:07:50.611912 3267 raft_consensus.cc:348] T ec05c92c1bf34dee9ce6a4579f3bb363 P 883b9795cb2b498fab593c29856a0842 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69661914a4314a529a8cb2afb06ed89a" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 33227 } } peers { permanent_uuid: "883b9795cb2b498fab593c29856a0842" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 35043 } } peers { permanent_uuid: "c06512f413484170bb8951a6b466ca76" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 37335 } }
I20260811 08:07:50.611995 3265 ts_tablet_manager.cc:1428] T ec05c92c1bf34dee9ce6a4579f3bb363 P 69661914a4314a529a8cb2afb06ed89a: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 08:07:50.612021 3266 raft_consensus.cc:374] T ec05c92c1bf34dee9ce6a4579f3bb363 P c06512f413484170bb8951a6b466ca76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:07:50.612044 3267 raft_consensus.cc:374] T ec05c92c1bf34dee9ce6a4579f3bb363 P 883b9795cb2b498fab593c29856a0842 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:07:50.612062 3266 raft_consensus.cc:729] T ec05c92c1bf34dee9ce6a4579f3bb363 P c06512f413484170bb8951a6b466ca76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c06512f413484170bb8951a6b466ca76, State: Initialized, Role: FOLLOWER
I20260811 08:07:50.612078 3267 raft_consensus.cc:729] T ec05c92c1bf34dee9ce6a4579f3bb363 P 883b9795cb2b498fab593c29856a0842 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 883b9795cb2b498fab593c29856a0842, State: Initialized, Role: FOLLOWER
I20260811 08:07:50.612016 3250 heartbeater.cc:503] Master 127.15.36.254:34441 was elected leader, sending a full tablet report...
I20260811 08:07:50.612197 3267 consensus_queue.cc:260] T ec05c92c1bf34dee9ce6a4579f3bb363 P 883b9795cb2b498fab593c29856a0842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69661914a4314a529a8cb2afb06ed89a" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 33227 } } peers { permanent_uuid: "883b9795cb2b498fab593c29856a0842" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 35043 } } peers { permanent_uuid: "c06512f413484170bb8951a6b466ca76" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 37335 } }
I20260811 08:07:50.612197 3266 consensus_queue.cc:260] T ec05c92c1bf34dee9ce6a4579f3bb363 P c06512f413484170bb8951a6b466ca76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69661914a4314a529a8cb2afb06ed89a" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 33227 } } peers { permanent_uuid: "883b9795cb2b498fab593c29856a0842" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 35043 } } peers { permanent_uuid: "c06512f413484170bb8951a6b466ca76" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 37335 } }
I20260811 08:07:50.612476 3267 ts_tablet_manager.cc:1428] T ec05c92c1bf34dee9ce6a4579f3bb363 P 883b9795cb2b498fab593c29856a0842: Time spent starting tablet: real 0.003s user 0.003s sys 0.001s
I20260811 08:07:50.612476 3266 ts_tablet_manager.cc:1428] T ec05c92c1bf34dee9ce6a4579f3bb363 P c06512f413484170bb8951a6b466ca76: Time spent starting tablet: real 0.003s user 0.003s sys 0.001s
I20260811 08:07:50.612601 2955 heartbeater.cc:503] Master 127.15.36.254:34441 was elected leader, sending a full tablet report...
I20260811 08:07:50.612601 3104 heartbeater.cc:503] Master 127.15.36.254:34441 was elected leader, sending a full tablet report...
I20260811 08:07:50.636554 3273 raft_consensus.cc:482] T ec05c92c1bf34dee9ce6a4579f3bb363 P 883b9795cb2b498fab593c29856a0842 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:07:50.636682 3273 raft_consensus.cc:504] T ec05c92c1bf34dee9ce6a4579f3bb363 P 883b9795cb2b498fab593c29856a0842 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69661914a4314a529a8cb2afb06ed89a" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 33227 } } peers { permanent_uuid: "883b9795cb2b498fab593c29856a0842" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 35043 } } peers { permanent_uuid: "c06512f413484170bb8951a6b466ca76" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 37335 } }
I20260811 08:07:50.637112 3273 leader_election.cc:288] T ec05c92c1bf34dee9ce6a4579f3bb363 P 883b9795cb2b498fab593c29856a0842 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69661914a4314a529a8cb2afb06ed89a (127.15.36.195:33227), c06512f413484170bb8951a6b466ca76 (127.15.36.194:37335)
I20260811 08:07:50.640148 2957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:50.637347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.195:33227 (local address 127.15.36.193:36431)
0811 08:07:50.637436 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:50.637453 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 08:07:50.637520 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:07:50.637671 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:07:50.637672 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:07:50.637673 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:07:50.637760 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:50.637762 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:50.638444 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:50.638445 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:50.639312 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:50.639314 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:50.639867 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:50.639868 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:50.639948 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:50.639951 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:07:50.640028 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 08:07:50.640075 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59}
I20260811 08:07:50.640146 3262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:50.637479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:36431 (local address 127.15.36.195:33227)
0811 08:07:50.637532 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:50.637534 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:50.637545 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:07:50.637580 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:50.637581 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:50.637596 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:50.637658 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:07:50.637848 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:50.638355 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:50.639406 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:50.639781 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:50.639868 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:50.639876 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:50.640040 (+ 164us) server_negotiation.cc:299] Negotiation successful
0811 08:07:50.640078 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 08:07:50.640388 3264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:50.637541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:50995 (local address 127.15.36.194:37335)
0811 08:07:50.637587 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:50.637589 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:50.637718 (+ 129us) server_negotiation.cc:407] Connection header received
0811 08:07:50.637854 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:50.637855 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:50.637874 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:50.637942 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:07:50.638102 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:50.638581 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:50.639628 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:50.639981 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:50.640080 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:50.640088 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:50.640282 (+ 194us) server_negotiation.cc:299] Negotiation successful
0811 08:07:50.640325 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 08:07:50.640592 3274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:50.637463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.194:37335 (local address 127.15.36.193:50995)
0811 08:07:50.637630 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:50.637639 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 08:07:50.637721 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:07:50.637946 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:07:50.637947 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:07:50.637949 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:07:50.638022 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:50.638024 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:50.638670 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:50.638671 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:50.639534 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:50.639536 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:50.640101 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:50.640103 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:50.640172 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:50.640175 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:07:50.640472 (+ 297us) client_negotiation.cc:240] Negotiation successful
0811 08:07:50.640516 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":106,"threads_started":1}
I20260811 08:07:50.640669 3198 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec05c92c1bf34dee9ce6a4579f3bb363" candidate_uuid: "883b9795cb2b498fab593c29856a0842" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69661914a4314a529a8cb2afb06ed89a" is_pre_election: true
I20260811 08:07:50.640833 3198 raft_consensus.cc:2454] T ec05c92c1bf34dee9ce6a4579f3bb363 P 69661914a4314a529a8cb2afb06ed89a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 883b9795cb2b498fab593c29856a0842 in term 0.
I20260811 08:07:50.640913 3051 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec05c92c1bf34dee9ce6a4579f3bb363" candidate_uuid: "883b9795cb2b498fab593c29856a0842" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c06512f413484170bb8951a6b466ca76" is_pre_election: true
I20260811 08:07:50.641065 3051 raft_consensus.cc:2454] T ec05c92c1bf34dee9ce6a4579f3bb363 P c06512f413484170bb8951a6b466ca76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 883b9795cb2b498fab593c29856a0842 in term 0.
I20260811 08:07:50.641093 2828 leader_election.cc:302] T ec05c92c1bf34dee9ce6a4579f3bb363 P 883b9795cb2b498fab593c29856a0842 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69661914a4314a529a8cb2afb06ed89a, 883b9795cb2b498fab593c29856a0842; no voters:
I20260811 08:07:50.641208 3273 raft_consensus.cc:2781] T ec05c92c1bf34dee9ce6a4579f3bb363 P 883b9795cb2b498fab593c29856a0842 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:07:50.641256 3273 raft_consensus.cc:482] T ec05c92c1bf34dee9ce6a4579f3bb363 P 883b9795cb2b498fab593c29856a0842 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:07:50.641281 3273 raft_consensus.cc:3037] T ec05c92c1bf34dee9ce6a4579f3bb363 P 883b9795cb2b498fab593c29856a0842 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:07:50.642016 3273 raft_consensus.cc:504] T ec05c92c1bf34dee9ce6a4579f3bb363 P 883b9795cb2b498fab593c29856a0842 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69661914a4314a529a8cb2afb06ed89a" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 33227 } } peers { permanent_uuid: "883b9795cb2b498fab593c29856a0842" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 35043 } } peers { permanent_uuid: "c06512f413484170bb8951a6b466ca76" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 37335 } }
I20260811 08:07:50.642159 3273 leader_election.cc:288] T ec05c92c1bf34dee9ce6a4579f3bb363 P 883b9795cb2b498fab593c29856a0842 [CANDIDATE]: Term 1 election: Requested vote from peers 69661914a4314a529a8cb2afb06ed89a (127.15.36.195:33227), c06512f413484170bb8951a6b466ca76 (127.15.36.194:37335)
I20260811 08:07:50.642382 3051 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec05c92c1bf34dee9ce6a4579f3bb363" candidate_uuid: "883b9795cb2b498fab593c29856a0842" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c06512f413484170bb8951a6b466ca76"
I20260811 08:07:50.642387 3198 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec05c92c1bf34dee9ce6a4579f3bb363" candidate_uuid: "883b9795cb2b498fab593c29856a0842" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69661914a4314a529a8cb2afb06ed89a"
I20260811 08:07:50.642465 3198 raft_consensus.cc:3037] T ec05c92c1bf34dee9ce6a4579f3bb363 P 69661914a4314a529a8cb2afb06ed89a [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:07:50.642477 3051 raft_consensus.cc:3037] T ec05c92c1bf34dee9ce6a4579f3bb363 P c06512f413484170bb8951a6b466ca76 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:07:50.643301 3051 raft_consensus.cc:2454] T ec05c92c1bf34dee9ce6a4579f3bb363 P c06512f413484170bb8951a6b466ca76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 883b9795cb2b498fab593c29856a0842 in term 1.
I20260811 08:07:50.643404 3198 raft_consensus.cc:2454] T ec05c92c1bf34dee9ce6a4579f3bb363 P 69661914a4314a529a8cb2afb06ed89a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 883b9795cb2b498fab593c29856a0842 in term 1.
I20260811 08:07:50.643601 2828 leader_election.cc:302] T ec05c92c1bf34dee9ce6a4579f3bb363 P 883b9795cb2b498fab593c29856a0842 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69661914a4314a529a8cb2afb06ed89a, 883b9795cb2b498fab593c29856a0842; no voters:
I20260811 08:07:50.643754 3273 raft_consensus.cc:2781] T ec05c92c1bf34dee9ce6a4579f3bb363 P 883b9795cb2b498fab593c29856a0842 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:07:50.644011 3273 raft_consensus.cc:686] T ec05c92c1bf34dee9ce6a4579f3bb363 P 883b9795cb2b498fab593c29856a0842 [term 1 LEADER]: Becoming Leader. State: Replica: 883b9795cb2b498fab593c29856a0842, State: Running, Role: LEADER
I20260811 08:07:50.644131 3273 consensus_queue.cc:237] T ec05c92c1bf34dee9ce6a4579f3bb363 P 883b9795cb2b498fab593c29856a0842 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69661914a4314a529a8cb2afb06ed89a" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 33227 } } peers { permanent_uuid: "883b9795cb2b498fab593c29856a0842" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 35043 } } peers { permanent_uuid: "c06512f413484170bb8951a6b466ca76" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 37335 } }
I20260811 08:07:50.645069 2740 catalog_manager.cc:5495] T ec05c92c1bf34dee9ce6a4579f3bb363 P 883b9795cb2b498fab593c29856a0842 reported cstate change: term changed from 0 to 1, leader changed from <none> to 883b9795cb2b498fab593c29856a0842 (127.15.36.193). New cstate: current_term: 1 leader_uuid: "883b9795cb2b498fab593c29856a0842" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69661914a4314a529a8cb2afb06ed89a" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 33227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "883b9795cb2b498fab593c29856a0842" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 35043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c06512f413484170bb8951a6b466ca76" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 37335 } health_report { overall_health: UNKNOWN } } }
I20260811 08:07:50.657711 3263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:50.655220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33534 (local address 127.15.36.193:35043)
0811 08:07:50.655289 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:50.655291 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:50.655302 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:07:50.655380 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:50.655381 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:50.655404 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:50.655493 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:07:50.655626 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:50.656116 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:50.656865 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:50.657084 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:50.657164 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:50.657333 (+ 169us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:07:50.657450 (+ 117us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:07:50.657541 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:50.657580 (+ 39us) server_negotiation.cc:299] Negotiation successful
0811 08:07:50.657600 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 08:07:50.659745 3051 raft_consensus.cc:1261] T ec05c92c1bf34dee9ce6a4579f3bb363 P c06512f413484170bb8951a6b466ca76 [term 1 FOLLOWER]: Refusing update from remote peer 883b9795cb2b498fab593c29856a0842: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:07:50.659745 3198 raft_consensus.cc:1261] T ec05c92c1bf34dee9ce6a4579f3bb363 P 69661914a4314a529a8cb2afb06ed89a [term 1 FOLLOWER]: Refusing update from remote peer 883b9795cb2b498fab593c29856a0842: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:07:50.660105 3273 consensus_queue.cc:1035] T ec05c92c1bf34dee9ce6a4579f3bb363 P 883b9795cb2b498fab593c29856a0842 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69661914a4314a529a8cb2afb06ed89a" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 33227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:07:50.660280 3275 consensus_queue.cc:1035] T ec05c92c1bf34dee9ce6a4579f3bb363 P 883b9795cb2b498fab593c29856a0842 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c06512f413484170bb8951a6b466ca76" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 37335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:07:50.663336 3280 mvcc.cc:205] Tried to move back new op lower bound from 7317240507019268096 to 7317240506958954496. Current Snapshot: MvccSnapshot[applied={T|T < 7317240507019268096 or (T in {7317240507019268096})}]
I20260811 08:07:50.663817 3279 mvcc.cc:205] Tried to move back new op lower bound from 7317240507019268096 to 7317240506958954496. Current Snapshot: MvccSnapshot[applied={T|T < 7317240507019268096}]
I20260811 08:07:50.665941 2738 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55154:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:07:50.666047 2738 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:55154:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:07:50.666878 2738 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 558b84e2d3f04181b903e0e6411898f5: Sending DeleteTablet for 3 replicas of tablet ec05c92c1bf34dee9ce6a4579f3bb363
I20260811 08:07:50.667330 3177 tablet_service.cc:1514] Processing DeleteTablet for tablet ec05c92c1bf34dee9ce6a4579f3bb363 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:07:50 UTC) from {username='slave'} at 127.0.0.1:40456
I20260811 08:07:50.667397 2880 tablet_service.cc:1514] Processing DeleteTablet for tablet ec05c92c1bf34dee9ce6a4579f3bb363 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:07:50 UTC) from {username='slave'} at 127.0.0.1:33532
I20260811 08:07:50.667641 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 2812
I20260811 08:07:50.667630 3028 tablet_service.cc:1514] Processing DeleteTablet for tablet ec05c92c1bf34dee9ce6a4579f3bb363 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:07:50 UTC) from {username='slave'} at 127.0.0.1:43418
I20260811 08:07:50.672236 3289 tablet_replica.cc:330] T ec05c92c1bf34dee9ce6a4579f3bb363 P c06512f413484170bb8951a6b466ca76: stopping tablet replica
I20260811 08:07:50.672459 3289 raft_consensus.cc:2229] T ec05c92c1bf34dee9ce6a4579f3bb363 P c06512f413484170bb8951a6b466ca76 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:07:50.672598 3289 raft_consensus.cc:2258] T ec05c92c1bf34dee9ce6a4579f3bb363 P c06512f413484170bb8951a6b466ca76 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:07:50.673177 3289 ts_tablet_manager.cc:1905] T ec05c92c1bf34dee9ce6a4579f3bb363 P c06512f413484170bb8951a6b466ca76: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:07:50.674945 3289 ts_tablet_manager.cc:1918] T ec05c92c1bf34dee9ce6a4579f3bb363 P c06512f413484170bb8951a6b466ca76: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:07:50.675114 3289 log.cc:1196] T ec05c92c1bf34dee9ce6a4579f3bb363 P c06512f413484170bb8951a6b466ca76: Deleting WAL directory at /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435400844580-15507-0/minicluster-data/ts-1/wal/wals/ec05c92c1bf34dee9ce6a4579f3bb363
I20260811 08:07:50.675443 3289 ts_tablet_manager.cc:1939] T ec05c92c1bf34dee9ce6a4579f3bb363 P c06512f413484170bb8951a6b466ca76: Deleting consensus metadata
I20260811 08:07:50.675927 2720 catalog_manager.cc:4841] TS c06512f413484170bb8951a6b466ca76 (127.15.36.194:37335): tablet ec05c92c1bf34dee9ce6a4579f3bb363 (table test-table [id=2f872849ba6a4876a7d5e6d1af23f6a8]) successfully deleted
W20260811 08:07:50.676849 2722 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.36.193:35043 (error 108)
I20260811 08:07:50.677057 3287 tablet_replica.cc:330] T ec05c92c1bf34dee9ce6a4579f3bb363 P 69661914a4314a529a8cb2afb06ed89a: stopping tablet replica
I20260811 08:07:50.677212 3287 raft_consensus.cc:2229] T ec05c92c1bf34dee9ce6a4579f3bb363 P 69661914a4314a529a8cb2afb06ed89a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:07:50.677372 3287 raft_consensus.cc:2258] T ec05c92c1bf34dee9ce6a4579f3bb363 P 69661914a4314a529a8cb2afb06ed89a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:07:50.677408 3259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:50.677273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.193:35043 (local address 127.0.0.1:33538)
0811 08:07:50.677330 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:50.677372 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.193:35043: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260811 08:07:50.677525 2722 catalog_manager.cc:4584] TS 883b9795cb2b498fab593c29856a0842 (127.15.36.193:35043): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ec05c92c1bf34dee9ce6a4579f3bb363: Network error: Client connection negotiation failed: client connection to 127.15.36.193:35043: connect: Connection refused (error 111)
I20260811 08:07:50.677601 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 2958
I20260811 08:07:50.679014 3287 ts_tablet_manager.cc:1905] T ec05c92c1bf34dee9ce6a4579f3bb363 P 69661914a4314a529a8cb2afb06ed89a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:07:50.681504 3287 ts_tablet_manager.cc:1918] T ec05c92c1bf34dee9ce6a4579f3bb363 P 69661914a4314a529a8cb2afb06ed89a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:07:50.681627 3287 log.cc:1196] T ec05c92c1bf34dee9ce6a4579f3bb363 P 69661914a4314a529a8cb2afb06ed89a: Deleting WAL directory at /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786435400844580-15507-0/minicluster-data/ts-2/wal/wals/ec05c92c1bf34dee9ce6a4579f3bb363
I20260811 08:07:50.681989 3287 ts_tablet_manager.cc:1939] T ec05c92c1bf34dee9ce6a4579f3bb363 P 69661914a4314a529a8cb2afb06ed89a: Deleting consensus metadata
I20260811 08:07:50.682581 2720 catalog_manager.cc:4841] TS 69661914a4314a529a8cb2afb06ed89a (127.15.36.195:33227): tablet ec05c92c1bf34dee9ce6a4579f3bb363 (table test-table [id=2f872849ba6a4876a7d5e6d1af23f6a8]) successfully deleted
I20260811 08:07:50.688243 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 3107
I20260811 08:07:50.695647 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 2703
2026-08-11T08:07:50Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (720 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:07:50 dist-test-slave-2w3w krb5kdc[3293](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:07:50 dist-test-slave-2w3w krb5kdc[3293](info): set up 2 sockets
Aug 11 08:07:50 dist-test-slave-2w3w krb5kdc[3293](info): commencing operation
krb5kdc: starting...
W20260811 08:07:51.825862 15507 mini_kdc.cc:121] Time spent starting KDC: real 1.108s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Aug 11 08:07:51 dist-test-slave-2w3w krb5kdc[3293](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435671, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:07:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:07:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.36.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab.
Entry for principal kudu/127.15.36.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab.
I20260811 08:07:51.962199 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:39271
--webserver_interface=127.15.36.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=kudu/127.15.36.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:34539
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.36.254:39271
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:07:52.045388 3309 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:07:52.045657 3309 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:07:52.045701 3309 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:07:52.046911 3309 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:07:52.047004 3309 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:07:52.047039 3309 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:07:52.047071 3309 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:07:52.047096 3309 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:07:52.048641 3309 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:34539
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.36.254:39271
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=kudu/127.15.36.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:39271
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.36.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3309
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:07:52.048930 3309 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:07:52.049177 3309 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:07:52.054359 3318 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:07:52.054329 3320 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:07:52.054379 3317 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:07:52.054557 3309 server_base.cc:1034] running on GCE node
I20260811 08:07:52.054842 3309 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:07:52.055171 3309 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:07:52.056334 3309 hybrid_clock.cc:648] HybridClock initialized: now 1786435672056317 us; error 29 us; skew 500 ppm
Aug 11 08:07:52 dist-test-slave-2w3w krb5kdc[3293](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435672, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:07:52.059079 3309 init.cc:377] Logged in from keytab as kudu/127.15.36.254@KRBTEST.COM (short username kudu)
I20260811 08:07:52.059581 3309 webserver.cc:460] Webserver started at http://127.15.36.254:42531/ using document root <none> and password file <none>
I20260811 08:07:52.059818 3309 fs_manager.cc:359] Metadata directory not provided
I20260811 08:07:52.059890 3309 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:07:52.060051 3309 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:07:52.061154 3309 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/minicluster-data/master-0/data/instance:
uuid: "98757de289024db39f92fb08aaa8d2c8"
format_stamp: "Formatted at 2026-08-11 08:07:52 on dist-test-slave-2w3w"
server_key: "f9bde6c08c59baa607f852c53979ad5c"
server_key_iv: "17cf8044283c57086bb30f2d81067ecf"
server_key_version: "encryptionkey@0"
I20260811 08:07:52.061574 3309 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/minicluster-data/master-0/wal/instance:
uuid: "98757de289024db39f92fb08aaa8d2c8"
format_stamp: "Formatted at 2026-08-11 08:07:52 on dist-test-slave-2w3w"
server_key: "f9bde6c08c59baa607f852c53979ad5c"
server_key_iv: "17cf8044283c57086bb30f2d81067ecf"
server_key_version: "encryptionkey@0"
I20260811 08:07:52.063090 3309 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 08:07:52.063968 3327 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:52.064158 3309 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:07:52.064270 3309 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/minicluster-data/master-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/minicluster-data/master-0/wal
uuid: "98757de289024db39f92fb08aaa8d2c8"
format_stamp: "Formatted at 2026-08-11 08:07:52 on dist-test-slave-2w3w"
server_key: "f9bde6c08c59baa607f852c53979ad5c"
server_key_iv: "17cf8044283c57086bb30f2d81067ecf"
server_key_version: "encryptionkey@0"
I20260811 08:07:52.064383 3309 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:07:52.084100 3309 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:07:52.086516 3309 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:07:52.086674 3309 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:07:52.090785 3309 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.254:39271
I20260811 08:07:52.090844 3383 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.254:39271 every 8 connection(s)
I20260811 08:07:52.091228 3309 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
I20260811 08:07:52.092231 3384 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:07:52.094733 3384 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 98757de289024db39f92fb08aaa8d2c8: Bootstrap starting.
I20260811 08:07:52.095403 3384 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 98757de289024db39f92fb08aaa8d2c8: Neither blocks nor log segments found. Creating new log.
I20260811 08:07:52.095650 3384 log.cc:824] T 00000000000000000000000000000000 P 98757de289024db39f92fb08aaa8d2c8: Log is configured to *not* fsync() on all Append() calls
I20260811 08:07:52.096431 3384 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 98757de289024db39f92fb08aaa8d2c8: No bootstrap required, opened a new log
I20260811 08:07:52.098038 3384 raft_consensus.cc:348] T 00000000000000000000000000000000 P 98757de289024db39f92fb08aaa8d2c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98757de289024db39f92fb08aaa8d2c8" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 39271 } }
I20260811 08:07:52.098210 3384 raft_consensus.cc:374] T 00000000000000000000000000000000 P 98757de289024db39f92fb08aaa8d2c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:07:52.098232 3384 raft_consensus.cc:729] T 00000000000000000000000000000000 P 98757de289024db39f92fb08aaa8d2c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98757de289024db39f92fb08aaa8d2c8, State: Initialized, Role: FOLLOWER
I20260811 08:07:52.098320 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 3309
I20260811 08:07:52.098388 3384 consensus_queue.cc:260] T 00000000000000000000000000000000 P 98757de289024db39f92fb08aaa8d2c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98757de289024db39f92fb08aaa8d2c8" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 39271 } }
I20260811 08:07:52.098490 3384 raft_consensus.cc:388] T 00000000000000000000000000000000 P 98757de289024db39f92fb08aaa8d2c8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:07:52.098489 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/minicluster-data/master-0/wal/instance
I20260811 08:07:52.098536 3384 raft_consensus.cc:482] T 00000000000000000000000000000000 P 98757de289024db39f92fb08aaa8d2c8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:07:52.098587 3384 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 98757de289024db39f92fb08aaa8d2c8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:07:52.098738 15507 external_mini_cluster.cc:1428] Setting key d397cceaa673908c2dd278ef13538776
I20260811 08:07:52.099494 3384 raft_consensus.cc:504] T 00000000000000000000000000000000 P 98757de289024db39f92fb08aaa8d2c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98757de289024db39f92fb08aaa8d2c8" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 39271 } }
I20260811 08:07:52.099611 3384 leader_election.cc:302] T 00000000000000000000000000000000 P 98757de289024db39f92fb08aaa8d2c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 98757de289024db39f92fb08aaa8d2c8; no voters:
I20260811 08:07:52.099776 3384 leader_election.cc:288] T 00000000000000000000000000000000 P 98757de289024db39f92fb08aaa8d2c8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:07:52.099848 3389 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 98757de289024db39f92fb08aaa8d2c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:07:52.100039 3389 raft_consensus.cc:686] T 00000000000000000000000000000000 P 98757de289024db39f92fb08aaa8d2c8 [term 1 LEADER]: Becoming Leader. State: Replica: 98757de289024db39f92fb08aaa8d2c8, State: Running, Role: LEADER
I20260811 08:07:52.100062 3384 sys_catalog.cc:564] T 00000000000000000000000000000000 P 98757de289024db39f92fb08aaa8d2c8 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:07:52.100129 3389 consensus_queue.cc:237] T 00000000000000000000000000000000 P 98757de289024db39f92fb08aaa8d2c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98757de289024db39f92fb08aaa8d2c8" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 39271 } }
I20260811 08:07:52.100466 3389 sys_catalog.cc:455] T 00000000000000000000000000000000 P 98757de289024db39f92fb08aaa8d2c8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 98757de289024db39f92fb08aaa8d2c8. Latest consensus state: current_term: 1 leader_uuid: "98757de289024db39f92fb08aaa8d2c8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98757de289024db39f92fb08aaa8d2c8" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 39271 } } }
I20260811 08:07:52.100555 3389 sys_catalog.cc:458] T 00000000000000000000000000000000 P 98757de289024db39f92fb08aaa8d2c8 [sys.catalog]: This master's current role is: LEADER
I20260811 08:07:52.100731 3391 sys_catalog.cc:455] T 00000000000000000000000000000000 P 98757de289024db39f92fb08aaa8d2c8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "98757de289024db39f92fb08aaa8d2c8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98757de289024db39f92fb08aaa8d2c8" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 39271 } } }
I20260811 08:07:52.100888 3391 sys_catalog.cc:458] T 00000000000000000000000000000000 P 98757de289024db39f92fb08aaa8d2c8 [sys.catalog]: This master's current role is: LEADER
W20260811 08:07:52.101966 3407 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 98757de289024db39f92fb08aaa8d2c8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 08:07:52.102036 3407 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 08:07:52.102097 3397 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:07:52.102267 3397 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:07:52.103893 3397 catalog_manager.cc:1347] Generated new cluster ID: e5d358c90dea46fbb0d26b77d8fd2049
I20260811 08:07:52.103945 3397 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 08:07:52 dist-test-slave-2w3w krb5kdc[3293](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435671, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:07:52.111954 3388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:52.099322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46658 (local address 127.15.36.254:39271)
0811 08:07:52.099564 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:52.099575 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:52.099614 (+ 39us) server_negotiation.cc:407] Connection header received
0811 08:07:52.099743 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:52.099750 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:52.099815 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:52.100900 (+ 1085us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:07:52.101014 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:52.102603 (+ 1589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:52.103737 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:52.104367 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:52.106984 (+ 2617us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:52.107283 (+ 299us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:07:52.107289 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:07:52.107289 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:07:52.107303 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:07:52.110084 (+ 2781us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:07:52.110544 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:07:52.110548 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:07:52.110548 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:07:52.110680 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:07:52.110899 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:07:52.110900 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:07:52.110900 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:07:52.111291 (+ 391us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:07:52.111462 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:52.111563 (+ 101us) server_negotiation.cc:299] Negotiation successful
0811 08:07:52.111714 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":182,"thread_start_us":126,"threads_started":1}
I20260811 08:07:52.117480 3397 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:07:52.118165 3397 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:07:52.121222 3397 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 98757de289024db39f92fb08aaa8d2c8: Generated new TSK 0
I20260811 08:07:52.121436 3397 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.36.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab.
Entry for principal kudu/127.15.36.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab.
I20260811 08:07:52.154362 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.193:0
--local_ip_for_outbound_sockets=127.15.36.193
--webserver_interface=127.15.36.193
--webserver_port=0
--tserver_master_addrs=127.15.36.254:39271
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab
--principal=kudu/127.15.36.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:34539
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:07:52.239244 3417 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:07:52.239521 3417 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:07:52.239548 3417 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:07:52.240842 3417 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:07:52.240900 3417 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:07:52.240928 3417 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.193
I20260811 08:07:52.242558 3417 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:34539
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab
--principal=kudu/127.15.36.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.36.193
--webserver_port=0
--tserver_master_addrs=127.15.36.254:39271
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3417
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.193
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:07:52.242839 3417 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:07:52.243130 3417 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:07:52.248385 3422 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:07:52.248385 3425 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:07:52.248404 3423 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:07:52.248750 3417 server_base.cc:1034] running on GCE node
I20260811 08:07:52.248981 3417 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:07:52.249192 3417 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:07:52.250340 3417 hybrid_clock.cc:648] HybridClock initialized: now 1786435672250322 us; error 44 us; skew 500 ppm
Aug 11 08:07:52 dist-test-slave-2w3w krb5kdc[3293](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435672, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:07:52.253002 3417 init.cc:377] Logged in from keytab as kudu/127.15.36.193@KRBTEST.COM (short username kudu)
I20260811 08:07:52.253506 3417 webserver.cc:460] Webserver started at http://127.15.36.193:36149/ using document root <none> and password file <none>
I20260811 08:07:52.253758 3417 fs_manager.cc:359] Metadata directory not provided
I20260811 08:07:52.253808 3417 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:07:52.253952 3417 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:07:52.255095 3417 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/minicluster-data/ts-0/data/instance:
uuid: "29a8482bd7c34ce48067b265b493af68"
format_stamp: "Formatted at 2026-08-11 08:07:52 on dist-test-slave-2w3w"
server_key: "e91cefd1628a819e0d59aa6e9be4dbf6"
server_key_iv: "42993a6b292c70109d55c48d4a5e4a36"
server_key_version: "encryptionkey@0"
I20260811 08:07:52.255478 3417 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/minicluster-data/ts-0/wal/instance:
uuid: "29a8482bd7c34ce48067b265b493af68"
format_stamp: "Formatted at 2026-08-11 08:07:52 on dist-test-slave-2w3w"
server_key: "e91cefd1628a819e0d59aa6e9be4dbf6"
server_key_iv: "42993a6b292c70109d55c48d4a5e4a36"
server_key_version: "encryptionkey@0"
I20260811 08:07:52.256910 3417 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 08:07:52.257771 3433 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:52.257979 3417 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:07:52.258100 3417 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/minicluster-data/ts-0/wal
uuid: "29a8482bd7c34ce48067b265b493af68"
format_stamp: "Formatted at 2026-08-11 08:07:52 on dist-test-slave-2w3w"
server_key: "e91cefd1628a819e0d59aa6e9be4dbf6"
server_key_iv: "42993a6b292c70109d55c48d4a5e4a36"
server_key_version: "encryptionkey@0"
I20260811 08:07:52.258181 3417 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:07:52.297843 3417 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:07:52.300487 3417 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:07:52.300693 3417 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:07:52.301018 3417 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:07:52.301411 3417 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:07:52.301476 3417 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:52.301515 3417 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:07:52.301541 3417 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:52.308118 3417 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.193:44141
I20260811 08:07:52.308171 3567 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.193:44141 every 8 connection(s)
I20260811 08:07:52.308537 3417 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
I20260811 08:07:52.310580 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 3417
I20260811 08:07:52.310719 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/minicluster-data/ts-0/wal/instance
I20260811 08:07:52.310922 15507 external_mini_cluster.cc:1428] Setting key c336c5fb48a0abb427738044b1cef1dc
Aug 11 08:07:52 dist-test-slave-2w3w krb5kdc[3293](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435672, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.193@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.15.36.194@KRBTEST.COM; defaulting to no policy
I20260811 08:07:52.319844 3388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:52.309381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:47611 (local address 127.15.36.254:39271)
0811 08:07:52.309453 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:52.309456 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:52.309691 (+ 235us) server_negotiation.cc:407] Connection header received
0811 08:07:52.310272 (+ 581us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:52.310273 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:52.310286 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:52.310342 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:07:52.311603 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:52.312149 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:52.313753 (+ 1604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:52.314105 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:52.314197 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:52.316656 (+ 2459us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:07:52.316657 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:07:52.316658 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:07:52.316666 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:07:52.318211 (+ 1545us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:07:52.318667 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:07:52.318668 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:07:52.318669 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:07:52.318774 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:07:52.319143 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:07:52.319144 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:07:52.319144 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:07:52.319272 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:07:52.319361 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:52.319657 (+ 296us) server_negotiation.cc:299] Negotiation successful
0811 08:07:52.319747 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 08:07:52.320052 3570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:52.309351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:39271 (local address 127.15.36.193:47611)
0811 08:07:52.309524 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:52.309598 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0811 08:07:52.310147 (+ 549us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:07:52.310421 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:07:52.310425 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:07:52.311183 (+ 758us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:07:52.311466 (+ 283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:52.311472 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:52.312257 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:52.312258 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:52.313634 (+ 1376us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:52.313638 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:52.314213 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:52.314214 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:52.314331 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:52.314956 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:07:52.315013 (+ 57us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:07:52.316536 (+ 1523us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:07:52.318306 (+ 1770us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:07:52.318315 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:07:52.318318 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:07:52.318582 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:07:52.318854 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:07:52.318855 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:07:52.318855 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:07:52.319057 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:07:52.319349 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:07:52.319357 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:07:52.319512 (+ 155us) client_negotiation.cc:769] Sending connection context
0811 08:07:52.319623 (+ 111us) client_negotiation.cc:240] Negotiation successful
0811 08:07:52.319802 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":77,"threads_started":1}
I20260811 08:07:52.320631 3568 heartbeater.cc:347] Connected to a master server at 127.15.36.254:39271
I20260811 08:07:52.320751 3568 heartbeater.cc:464] Registering TS with master...
I20260811 08:07:52.320962 3568 heartbeater.cc:511] Master 127.15.36.254:39271 requested a full tablet report, sending...
I20260811 08:07:52.321520 3345 ts_manager.cc:194] Registered new tserver with Master: 29a8482bd7c34ce48067b265b493af68 (127.15.36.193:44141)
I20260811 08:07:52.322152 3345 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.36.193@KRBTEST.COM'} at 127.15.36.193:47611
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab.
Entry for principal kudu/127.15.36.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab.
I20260811 08:07:52.345993 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.194:0
--local_ip_for_outbound_sockets=127.15.36.194
--webserver_interface=127.15.36.194
--webserver_port=0
--tserver_master_addrs=127.15.36.254:39271
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab
--principal=kudu/127.15.36.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:34539
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:07:52.448016 3573 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:07:52.448266 3573 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:07:52.448294 3573 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:07:52.449517 3573 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:07:52.449565 3573 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:07:52.449594 3573 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.194
I20260811 08:07:52.451200 3573 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:34539
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab
--principal=kudu/127.15.36.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.36.194
--webserver_port=0
--tserver_master_addrs=127.15.36.254:39271
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3573
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.194
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:07:52.451453 3573 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:07:52.451695 3573 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:07:52.457027 3582 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:07:52.457049 3580 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:07:52.457049 3584 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:07:52.457262 3573 server_base.cc:1034] running on GCE node
I20260811 08:07:52.457504 3573 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:07:52.457798 3573 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:07:52.459014 3573 hybrid_clock.cc:648] HybridClock initialized: now 1786435672459005 us; error 43 us; skew 500 ppm
Aug 11 08:07:52 dist-test-slave-2w3w krb5kdc[3293](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435672, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:07:52.461707 3573 init.cc:377] Logged in from keytab as kudu/127.15.36.194@KRBTEST.COM (short username kudu)
I20260811 08:07:52.462219 3573 webserver.cc:460] Webserver started at http://127.15.36.194:45479/ using document root <none> and password file <none>
I20260811 08:07:52.462474 3573 fs_manager.cc:359] Metadata directory not provided
I20260811 08:07:52.462520 3573 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:07:52.462666 3573 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:07:52.463888 3573 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/minicluster-data/ts-1/data/instance:
uuid: "a2e2df94f2e5478297e6bbb9741e443d"
format_stamp: "Formatted at 2026-08-11 08:07:52 on dist-test-slave-2w3w"
server_key: "797f5ce5673a6d71a4bf5212b649f0ba"
server_key_iv: "6759017f541334c323c341ce3f47afed"
server_key_version: "encryptionkey@0"
I20260811 08:07:52.464262 3573 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/minicluster-data/ts-1/wal/instance:
uuid: "a2e2df94f2e5478297e6bbb9741e443d"
format_stamp: "Formatted at 2026-08-11 08:07:52 on dist-test-slave-2w3w"
server_key: "797f5ce5673a6d71a4bf5212b649f0ba"
server_key_iv: "6759017f541334c323c341ce3f47afed"
server_key_version: "encryptionkey@0"
I20260811 08:07:52.465687 3573 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 08:07:52.466555 3593 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:52.466885 3573 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 08:07:52.467010 3573 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/minicluster-data/ts-1/wal
uuid: "a2e2df94f2e5478297e6bbb9741e443d"
format_stamp: "Formatted at 2026-08-11 08:07:52 on dist-test-slave-2w3w"
server_key: "797f5ce5673a6d71a4bf5212b649f0ba"
server_key_iv: "6759017f541334c323c341ce3f47afed"
server_key_version: "encryptionkey@0"
I20260811 08:07:52.467108 3573 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:07:52.496146 3573 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:07:52.498543 3573 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:07:52.498726 3573 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:07:52.499043 3573 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:07:52.499461 3573 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:07:52.499531 3573 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:52.499575 3573 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:07:52.499604 3573 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:52.505944 3573 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.194:37237
I20260811 08:07:52.506032 3723 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.194:37237 every 8 connection(s)
I20260811 08:07:52.506382 3573 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
I20260811 08:07:52.512624 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 3573
I20260811 08:07:52.512725 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/minicluster-data/ts-1/wal/instance
Aug 11 08:07:52 dist-test-slave-2w3w krb5kdc[3293](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435672, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.194@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:07:52.512992 15507 external_mini_cluster.cc:1428] Setting key 535576cf4d10475b8e9578389c63da90
I20260811 08:07:52.517081 3388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:52.507242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:46651 (local address 127.15.36.254:39271)
0811 08:07:52.507306 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:52.507308 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:52.507547 (+ 239us) server_negotiation.cc:407] Connection header received
0811 08:07:52.508002 (+ 455us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:52.508003 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:52.508014 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:52.508070 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:07:52.509034 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:52.509559 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:52.510597 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:52.510800 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:52.510869 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:52.513308 (+ 2439us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:07:52.513310 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:07:52.513310 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:07:52.513320 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:07:52.515347 (+ 2027us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:07:52.515851 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:07:52.515853 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:07:52.515853 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:07:52.515930 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:07:52.516338 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:07:52.516339 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:07:52.516340 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:07:52.516470 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:07:52.516540 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:52.516914 (+ 374us) server_negotiation.cc:299] Negotiation successful
0811 08:07:52.517011 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 08:07:52.517409 3728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:52.507231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:39271 (local address 127.15.36.194:46651)
0811 08:07:52.507392 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:52.507432 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 08:07:52.507906 (+ 474us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:07:52.508133 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:07:52.508136 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:07:52.508721 (+ 585us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:07:52.508939 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:52.508943 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:52.509645 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:52.509646 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:52.510502 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:52.510505 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:52.510887 (+ 382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:52.510888 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:52.511093 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:52.511636 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:07:52.511645 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:07:52.513170 (+ 1525us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:07:52.515455 (+ 2285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:07:52.515464 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:07:52.515467 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:07:52.515715 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:07:52.516039 (+ 324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:07:52.516040 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:07:52.516041 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:07:52.516223 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:07:52.516551 (+ 328us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:07:52.516558 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:07:52.516749 (+ 191us) client_negotiation.cc:769] Sending connection context
0811 08:07:52.516887 (+ 138us) client_negotiation.cc:240] Negotiation successful
0811 08:07:52.517104 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":84,"threads_started":1}
I20260811 08:07:52.518057 3725 heartbeater.cc:347] Connected to a master server at 127.15.36.254:39271
I20260811 08:07:52.518162 3725 heartbeater.cc:464] Registering TS with master...
I20260811 08:07:52.518371 3725 heartbeater.cc:511] Master 127.15.36.254:39271 requested a full tablet report, sending...
I20260811 08:07:52.518833 3345 ts_manager.cc:194] Registered new tserver with Master: a2e2df94f2e5478297e6bbb9741e443d (127.15.36.194:37237)
I20260811 08:07:52.519264 3345 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.36.194@KRBTEST.COM'} at 127.15.36.194:46651
WARNING: no policy specified for kudu/127.15.36.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab.
Entry for principal kudu/127.15.36.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab.
I20260811 08:07:52.546377 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.195:0
--local_ip_for_outbound_sockets=127.15.36.195
--webserver_interface=127.15.36.195
--webserver_port=0
--tserver_master_addrs=127.15.36.254:39271
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab
--principal=kudu/127.15.36.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:34539
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:07:52.632591 3731 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:07:52.632822 3731 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:07:52.632848 3731 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:07:52.634030 3731 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:07:52.634075 3731 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:07:52.634104 3731 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.195
I20260811 08:07:52.635707 3731 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:34539
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab
--principal=kudu/127.15.36.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.36.195
--webserver_port=0
--tserver_master_addrs=127.15.36.254:39271
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3731
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.195
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:07:52.635983 3731 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:07:52.636227 3731 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:07:52.641885 3737 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:07:52.641897 3739 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:07:52.641954 3731 server_base.cc:1034] running on GCE node
W20260811 08:07:52.642184 3736 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:07:52.642423 3731 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:07:52.642717 3731 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:07:52.643899 3731 hybrid_clock.cc:648] HybridClock initialized: now 1786435672643865 us; error 54 us; skew 500 ppm
Aug 11 08:07:52 dist-test-slave-2w3w krb5kdc[3293](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435672, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:07:52.646615 3731 init.cc:377] Logged in from keytab as kudu/127.15.36.195@KRBTEST.COM (short username kudu)
I20260811 08:07:52.647151 3731 webserver.cc:460] Webserver started at http://127.15.36.195:33289/ using document root <none> and password file <none>
I20260811 08:07:52.647409 3731 fs_manager.cc:359] Metadata directory not provided
I20260811 08:07:52.647480 3731 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:07:52.647624 3731 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:07:52.648742 3731 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/minicluster-data/ts-2/data/instance:
uuid: "55e3512c427d4bf1a0f4beda7bbaa072"
format_stamp: "Formatted at 2026-08-11 08:07:52 on dist-test-slave-2w3w"
server_key: "a7e5674db8976ca28550b2947e1ddc90"
server_key_iv: "edaa356d622840a7582f82203810f672"
server_key_version: "encryptionkey@0"
I20260811 08:07:52.649129 3731 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/minicluster-data/ts-2/wal/instance:
uuid: "55e3512c427d4bf1a0f4beda7bbaa072"
format_stamp: "Formatted at 2026-08-11 08:07:52 on dist-test-slave-2w3w"
server_key: "a7e5674db8976ca28550b2947e1ddc90"
server_key_iv: "edaa356d622840a7582f82203810f672"
server_key_version: "encryptionkey@0"
I20260811 08:07:52.650624 3731 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 08:07:52.651675 3747 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:52.652004 3731 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:07:52.652110 3731 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/minicluster-data/ts-2/wal
uuid: "55e3512c427d4bf1a0f4beda7bbaa072"
format_stamp: "Formatted at 2026-08-11 08:07:52 on dist-test-slave-2w3w"
server_key: "a7e5674db8976ca28550b2947e1ddc90"
server_key_iv: "edaa356d622840a7582f82203810f672"
server_key_version: "encryptionkey@0"
I20260811 08:07:52.652212 3731 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:07:52.667214 3731 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:07:52.669728 3731 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:07:52.669940 3731 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:07:52.670284 3731 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:07:52.670845 3731 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:07:52.670917 3731 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:52.670958 3731 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:07:52.671111 3731 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:52.678064 3731 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.195:36337
I20260811 08:07:52.678164 3876 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.195:36337 every 8 connection(s)
I20260811 08:07:52.678539 3731 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
I20260811 08:07:52.682628 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 3731
I20260811 08:07:52.682749 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/minicluster-data/ts-2/wal/instance
I20260811 08:07:52.682933 15507 external_mini_cluster.cc:1428] Setting key 8dcf4d6792bd4688af7a98be5437f6ba
Aug 11 08:07:52 dist-test-slave-2w3w krb5kdc[3293](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435672, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.195@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:07:52.689689 3388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:52.679704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:48947 (local address 127.15.36.254:39271)
0811 08:07:52.679787 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:52.679789 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:52.679966 (+ 177us) server_negotiation.cc:407] Connection header received
0811 08:07:52.680496 (+ 530us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:52.680497 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:52.680509 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:52.680582 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:07:52.681575 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:52.682141 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:52.683790 (+ 1649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:52.684058 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:52.684144 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:52.686628 (+ 2484us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:07:52.686629 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:07:52.686630 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:07:52.686638 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:07:52.688163 (+ 1525us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:07:52.688634 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:07:52.688635 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:07:52.688636 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:07:52.688691 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:07:52.688969 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:07:52.688970 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:07:52.688970 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:07:52.689120 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:07:52.689207 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:52.689537 (+ 330us) server_negotiation.cc:299] Negotiation successful
0811 08:07:52.689619 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 08:07:52.689921 3879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:52.679618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:39271 (local address 127.15.36.195:48947)
0811 08:07:52.679816 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:52.679861 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 08:07:52.680367 (+ 506us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:07:52.680639 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:07:52.680643 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:07:52.681245 (+ 602us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:07:52.681468 (+ 223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:52.681473 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:52.682238 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:52.682239 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:52.683682 (+ 1443us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:52.683686 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:52.684155 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:52.684156 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:52.684311 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:52.684852 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:07:52.684861 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:07:52.686510 (+ 1649us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:07:52.688265 (+ 1755us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:07:52.688273 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:07:52.688275 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:07:52.688559 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:07:52.688753 (+ 194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:07:52.688754 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:07:52.688754 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:07:52.688881 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:07:52.689225 (+ 344us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:07:52.689232 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:07:52.689376 (+ 144us) client_negotiation.cc:769] Sending connection context
0811 08:07:52.689483 (+ 107us) client_negotiation.cc:240] Negotiation successful
0811 08:07:52.689628 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":97,"threads_started":1}
I20260811 08:07:52.690603 3877 heartbeater.cc:347] Connected to a master server at 127.15.36.254:39271
I20260811 08:07:52.690725 3877 heartbeater.cc:464] Registering TS with master...
I20260811 08:07:52.690918 3877 heartbeater.cc:511] Master 127.15.36.254:39271 requested a full tablet report, sending...
I20260811 08:07:52.691391 3345 ts_manager.cc:194] Registered new tserver with Master: 55e3512c427d4bf1a0f4beda7bbaa072 (127.15.36.195:36337)
I20260811 08:07:52.691747 3345 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.36.195@KRBTEST.COM'} at 127.15.36.195:48947
I20260811 08:07:52.695025 15507 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 08:07:52.703756 3388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:52.696392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46674 (local address 127.15.36.254:39271)
0811 08:07:52.696477 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:52.696480 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:52.696632 (+ 152us) server_negotiation.cc:407] Connection header received
0811 08:07:52.696661 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:52.696662 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:52.696671 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:52.696726 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:07:52.697283 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:52.697824 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:52.698581 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:52.698814 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:52.698876 (+ 62us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:52.700460 (+ 1584us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:07:52.700462 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:07:52.700462 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:07:52.700469 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:07:52.702337 (+ 1868us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:07:52.702797 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:07:52.702798 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:07:52.702798 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:07:52.702893 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:07:52.703175 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:07:52.703176 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:07:52.703176 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:07:52.703331 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:07:52.703419 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:52.703574 (+ 155us) server_negotiation.cc:299] Negotiation successful
0811 08:07:52.703629 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 08:07:52.705780 3345 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46674:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:07:52.707535 3345 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:07:52.714929 3894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:52.710750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54650 (local address 127.15.36.195:36337)
0811 08:07:52.710927 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:52.710930 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:52.711109 (+ 179us) server_negotiation.cc:407] Connection header received
0811 08:07:52.711154 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:52.711156 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:52.711173 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:52.711284 (+ 111us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:07:52.711514 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:52.712537 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:52.713647 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:52.714393 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:52.714477 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:52.714542 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:52.714789 (+ 247us) server_negotiation.cc:299] Negotiation successful
0811 08:07:52.714835 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":93,"threads_started":1}
I20260811 08:07:52.714932 3891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:52.710348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.194:37237 (local address 127.0.0.1:43254)
0811 08:07:52.710623 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:52.710668 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 08:07:52.710738 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:07:52.711050 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:07:52.711053 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:07:52.711055 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:07:52.711137 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:52.711160 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:52.712562 (+ 1402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:52.712563 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:52.713737 (+ 1174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:52.713741 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:52.714618 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:52.714619 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:52.714673 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:52.714676 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:07:52.714805 (+ 129us) client_negotiation.cc:240] Negotiation successful
0811 08:07:52.714838 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":57,"threads_started":1}
I20260811 08:07:52.715065 3892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:52.710553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43254 (local address 127.15.36.194:37237)
0811 08:07:52.710823 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:52.710828 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:52.710837 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:07:52.710883 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:52.710885 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:52.710902 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:52.711041 (+ 139us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:07:52.711258 (+ 217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:52.712449 (+ 1191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:52.713833 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:52.714515 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:52.714586 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:52.714632 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:52.714895 (+ 263us) server_negotiation.cc:299] Negotiation successful
0811 08:07:52.714944 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":221,"thread_start_us":86,"threads_started":1}
I20260811 08:07:52.715255 3890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:52.710368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.195:36337 (local address 127.0.0.1:54650)
0811 08:07:52.710940 (+ 572us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:52.710948 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 08:07:52.711052 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:07:52.711371 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:07:52.711373 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:07:52.711375 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:07:52.711433 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:52.711434 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:52.712621 (+ 1187us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:52.712622 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:52.713557 (+ 935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:52.713560 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:52.714501 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:52.714502 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:52.714627 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:52.714645 (+ 18us) client_negotiation.cc:769] Sending connection context
0811 08:07:52.714747 (+ 102us) client_negotiation.cc:240] Negotiation successful
0811 08:07:52.714823 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":555,"thread_start_us":139,"threads_started":1}
I20260811 08:07:52.715896 3801 tablet_service.cc:1467] Processing CreateTablet for tablet 31c099a1ebf9422eb7b235bd99dc7aea (DEFAULT_TABLE table=test-table [id=5673fe89246f4bc0988e93b654b919ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:07:52.715858 3646 tablet_service.cc:1467] Processing CreateTablet for tablet 31c099a1ebf9422eb7b235bd99dc7aea (DEFAULT_TABLE table=test-table [id=5673fe89246f4bc0988e93b654b919ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:07:52.716253 3801 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31c099a1ebf9422eb7b235bd99dc7aea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:07:52.716272 3646 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31c099a1ebf9422eb7b235bd99dc7aea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:07:52.716568 3889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:52.710348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.193:44141 (local address 127.0.0.1:52694)
0811 08:07:52.710622 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:52.710668 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 08:07:52.710738 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:07:52.711327 (+ 589us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:07:52.711329 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:07:52.711331 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:07:52.711392 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:52.711394 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:52.712370 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:52.712371 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:52.713747 (+ 1376us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:52.713749 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:52.716322 (+ 2573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:52.716323 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:52.716393 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:52.716397 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:07:52.716452 (+ 55us) client_negotiation.cc:240] Negotiation successful
0811 08:07:52.716499 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":245,"mutex_wait_us":36,"thread_start_us":210,"threads_started":1}
I20260811 08:07:52.716890 3893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:52.710576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52694 (local address 127.15.36.193:44141)
0811 08:07:52.711070 (+ 494us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:52.711073 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:52.711083 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:07:52.711123 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:52.711125 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:52.711139 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:52.711226 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:07:52.711477 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:52.712236 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:52.714669 (+ 2433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:52.716149 (+ 1480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:52.716226 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:52.716281 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:52.716738 (+ 457us) server_negotiation.cc:299] Negotiation successful
0811 08:07:52.716812 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":450,"thread_start_us":100,"threads_started":1}
I20260811 08:07:52.717504 3492 tablet_service.cc:1467] Processing CreateTablet for tablet 31c099a1ebf9422eb7b235bd99dc7aea (DEFAULT_TABLE table=test-table [id=5673fe89246f4bc0988e93b654b919ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:07:52.717854 3492 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31c099a1ebf9422eb7b235bd99dc7aea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:07:52.719687 3896 tablet_bootstrap.cc:492] T 31c099a1ebf9422eb7b235bd99dc7aea P a2e2df94f2e5478297e6bbb9741e443d: Bootstrap starting.
I20260811 08:07:52.719744 3895 tablet_bootstrap.cc:492] T 31c099a1ebf9422eb7b235bd99dc7aea P 55e3512c427d4bf1a0f4beda7bbaa072: Bootstrap starting.
I20260811 08:07:52.720448 3896 tablet_bootstrap.cc:654] T 31c099a1ebf9422eb7b235bd99dc7aea P a2e2df94f2e5478297e6bbb9741e443d: Neither blocks nor log segments found. Creating new log.
I20260811 08:07:52.720471 3895 tablet_bootstrap.cc:654] T 31c099a1ebf9422eb7b235bd99dc7aea P 55e3512c427d4bf1a0f4beda7bbaa072: Neither blocks nor log segments found. Creating new log.
I20260811 08:07:52.721025 3897 tablet_bootstrap.cc:492] T 31c099a1ebf9422eb7b235bd99dc7aea P 29a8482bd7c34ce48067b265b493af68: Bootstrap starting.
I20260811 08:07:52.721082 3895 log.cc:824] T 31c099a1ebf9422eb7b235bd99dc7aea P 55e3512c427d4bf1a0f4beda7bbaa072: Log is configured to *not* fsync() on all Append() calls
I20260811 08:07:52.721082 3896 log.cc:824] T 31c099a1ebf9422eb7b235bd99dc7aea P a2e2df94f2e5478297e6bbb9741e443d: Log is configured to *not* fsync() on all Append() calls
I20260811 08:07:52.721824 3897 tablet_bootstrap.cc:654] T 31c099a1ebf9422eb7b235bd99dc7aea P 29a8482bd7c34ce48067b265b493af68: Neither blocks nor log segments found. Creating new log.
I20260811 08:07:52.722133 3896 tablet_bootstrap.cc:492] T 31c099a1ebf9422eb7b235bd99dc7aea P a2e2df94f2e5478297e6bbb9741e443d: No bootstrap required, opened a new log
I20260811 08:07:52.722210 3896 ts_tablet_manager.cc:1397] T 31c099a1ebf9422eb7b235bd99dc7aea P a2e2df94f2e5478297e6bbb9741e443d: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 08:07:52.722327 3895 tablet_bootstrap.cc:492] T 31c099a1ebf9422eb7b235bd99dc7aea P 55e3512c427d4bf1a0f4beda7bbaa072: No bootstrap required, opened a new log
I20260811 08:07:52.722393 3895 ts_tablet_manager.cc:1397] T 31c099a1ebf9422eb7b235bd99dc7aea P 55e3512c427d4bf1a0f4beda7bbaa072: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 08:07:52.722430 3897 log.cc:824] T 31c099a1ebf9422eb7b235bd99dc7aea P 29a8482bd7c34ce48067b265b493af68: Log is configured to *not* fsync() on all Append() calls
I20260811 08:07:52.723176 3897 tablet_bootstrap.cc:492] T 31c099a1ebf9422eb7b235bd99dc7aea P 29a8482bd7c34ce48067b265b493af68: No bootstrap required, opened a new log
I20260811 08:07:52.723264 3897 ts_tablet_manager.cc:1397] T 31c099a1ebf9422eb7b235bd99dc7aea P 29a8482bd7c34ce48067b265b493af68: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 08:07:52.724308 3896 raft_consensus.cc:348] T 31c099a1ebf9422eb7b235bd99dc7aea P a2e2df94f2e5478297e6bbb9741e443d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29a8482bd7c34ce48067b265b493af68" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 44141 } } peers { permanent_uuid: "a2e2df94f2e5478297e6bbb9741e443d" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 37237 } } peers { permanent_uuid: "55e3512c427d4bf1a0f4beda7bbaa072" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 36337 } }
I20260811 08:07:52.724354 3895 raft_consensus.cc:348] T 31c099a1ebf9422eb7b235bd99dc7aea P 55e3512c427d4bf1a0f4beda7bbaa072 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29a8482bd7c34ce48067b265b493af68" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 44141 } } peers { permanent_uuid: "a2e2df94f2e5478297e6bbb9741e443d" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 37237 } } peers { permanent_uuid: "55e3512c427d4bf1a0f4beda7bbaa072" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 36337 } }
I20260811 08:07:52.724504 3896 raft_consensus.cc:374] T 31c099a1ebf9422eb7b235bd99dc7aea P a2e2df94f2e5478297e6bbb9741e443d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:07:52.724504 3895 raft_consensus.cc:374] T 31c099a1ebf9422eb7b235bd99dc7aea P 55e3512c427d4bf1a0f4beda7bbaa072 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:07:52.724545 3895 raft_consensus.cc:729] T 31c099a1ebf9422eb7b235bd99dc7aea P 55e3512c427d4bf1a0f4beda7bbaa072 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55e3512c427d4bf1a0f4beda7bbaa072, State: Initialized, Role: FOLLOWER
I20260811 08:07:52.724545 3896 raft_consensus.cc:729] T 31c099a1ebf9422eb7b235bd99dc7aea P a2e2df94f2e5478297e6bbb9741e443d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2e2df94f2e5478297e6bbb9741e443d, State: Initialized, Role: FOLLOWER
I20260811 08:07:52.724684 3895 consensus_queue.cc:260] T 31c099a1ebf9422eb7b235bd99dc7aea P 55e3512c427d4bf1a0f4beda7bbaa072 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29a8482bd7c34ce48067b265b493af68" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 44141 } } peers { permanent_uuid: "a2e2df94f2e5478297e6bbb9741e443d" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 37237 } } peers { permanent_uuid: "55e3512c427d4bf1a0f4beda7bbaa072" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 36337 } }
I20260811 08:07:52.724674 3896 consensus_queue.cc:260] T 31c099a1ebf9422eb7b235bd99dc7aea P a2e2df94f2e5478297e6bbb9741e443d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29a8482bd7c34ce48067b265b493af68" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 44141 } } peers { permanent_uuid: "a2e2df94f2e5478297e6bbb9741e443d" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 37237 } } peers { permanent_uuid: "55e3512c427d4bf1a0f4beda7bbaa072" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 36337 } }
I20260811 08:07:52.724696 3897 raft_consensus.cc:348] T 31c099a1ebf9422eb7b235bd99dc7aea P 29a8482bd7c34ce48067b265b493af68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29a8482bd7c34ce48067b265b493af68" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 44141 } } peers { permanent_uuid: "a2e2df94f2e5478297e6bbb9741e443d" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 37237 } } peers { permanent_uuid: "55e3512c427d4bf1a0f4beda7bbaa072" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 36337 } }
I20260811 08:07:52.724879 3897 raft_consensus.cc:374] T 31c099a1ebf9422eb7b235bd99dc7aea P 29a8482bd7c34ce48067b265b493af68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:07:52.724927 3897 raft_consensus.cc:729] T 31c099a1ebf9422eb7b235bd99dc7aea P 29a8482bd7c34ce48067b265b493af68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29a8482bd7c34ce48067b265b493af68, State: Initialized, Role: FOLLOWER
I20260811 08:07:52.724974 3895 ts_tablet_manager.cc:1428] T 31c099a1ebf9422eb7b235bd99dc7aea P 55e3512c427d4bf1a0f4beda7bbaa072: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 08:07:52.724974 3896 ts_tablet_manager.cc:1428] T 31c099a1ebf9422eb7b235bd99dc7aea P a2e2df94f2e5478297e6bbb9741e443d: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 08:07:52.725042 3897 consensus_queue.cc:260] T 31c099a1ebf9422eb7b235bd99dc7aea P 29a8482bd7c34ce48067b265b493af68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29a8482bd7c34ce48067b265b493af68" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 44141 } } peers { permanent_uuid: "a2e2df94f2e5478297e6bbb9741e443d" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 37237 } } peers { permanent_uuid: "55e3512c427d4bf1a0f4beda7bbaa072" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 36337 } }
I20260811 08:07:52.725108 3725 heartbeater.cc:503] Master 127.15.36.254:39271 was elected leader, sending a full tablet report...
I20260811 08:07:52.725349 3897 ts_tablet_manager.cc:1428] T 31c099a1ebf9422eb7b235bd99dc7aea P 29a8482bd7c34ce48067b265b493af68: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 08:07:52.725436 3877 heartbeater.cc:503] Master 127.15.36.254:39271 was elected leader, sending a full tablet report...
I20260811 08:07:52.725406 3568 heartbeater.cc:503] Master 127.15.36.254:39271 was elected leader, sending a full tablet report...
W20260811 08:07:52.756968 3727 tablet.cc:2369] T 31c099a1ebf9422eb7b235bd99dc7aea P a2e2df94f2e5478297e6bbb9741e443d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 08:07:52.809489 3569 tablet.cc:2369] T 31c099a1ebf9422eb7b235bd99dc7aea P 29a8482bd7c34ce48067b265b493af68: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:07:52.919662 3901 raft_consensus.cc:482] T 31c099a1ebf9422eb7b235bd99dc7aea P a2e2df94f2e5478297e6bbb9741e443d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:07:52.919821 3901 raft_consensus.cc:504] T 31c099a1ebf9422eb7b235bd99dc7aea P a2e2df94f2e5478297e6bbb9741e443d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29a8482bd7c34ce48067b265b493af68" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 44141 } } peers { permanent_uuid: "a2e2df94f2e5478297e6bbb9741e443d" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 37237 } } peers { permanent_uuid: "55e3512c427d4bf1a0f4beda7bbaa072" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 36337 } }
I20260811 08:07:52.920174 3901 leader_election.cc:288] T 31c099a1ebf9422eb7b235bd99dc7aea P a2e2df94f2e5478297e6bbb9741e443d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29a8482bd7c34ce48067b265b493af68 (127.15.36.193:44141), 55e3512c427d4bf1a0f4beda7bbaa072 (127.15.36.195:36337)
I20260811 08:07:52.923557 3728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:52.920429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.195:36337 (local address 127.15.36.194:59863)
0811 08:07:52.920509 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:52.920522 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 08:07:52.920575 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:07:52.920768 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:07:52.920770 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:07:52.920772 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:07:52.920865 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:52.920868 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:52.921673 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:52.921674 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:52.922482 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:52.922485 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:52.923253 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:52.923254 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:52.923340 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:52.923351 (+ 11us) client_negotiation.cc:769] Sending connection context
0811 08:07:52.923393 (+ 42us) client_negotiation.cc:240] Negotiation successful
0811 08:07:52.923445 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":57,"mutex_wait_us":27}
I20260811 08:07:52.923595 3893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:52.920512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:44903 (local address 127.15.36.193:44141)
0811 08:07:52.920583 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:52.920585 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:52.920846 (+ 261us) server_negotiation.cc:407] Connection header received
0811 08:07:52.920909 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:52.920910 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:52.920925 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:52.920977 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:07:52.921138 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:52.921609 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:52.922738 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:52.923184 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:52.923275 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:52.923284 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:52.923481 (+ 197us) server_negotiation.cc:299] Negotiation successful
0811 08:07:52.923524 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 08:07:52.923556 3894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:52.920556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:59863 (local address 127.15.36.195:36337)
0811 08:07:52.920615 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:52.920618 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:52.920626 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:07:52.920662 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:52.920663 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:52.920671 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:52.920761 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:07:52.920975 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:52.921584 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:52.922592 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:52.923155 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:52.923225 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:52.923233 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:52.923420 (+ 187us) server_negotiation.cc:299] Negotiation successful
0811 08:07:52.923470 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 08:07:52.923674 3905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:52.920429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.193:44141 (local address 127.15.36.194:44903)
0811 08:07:52.920770 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:52.920783 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 08:07:52.920858 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:07:52.920983 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:07:52.920983 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:07:52.920985 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:07:52.921061 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:52.921064 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:52.921727 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:52.921728 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:52.922637 (+ 909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:52.922640 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:52.923306 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:52.923307 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:52.923366 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:52.923370 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:07:52.923454 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 08:07:52.923493 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":322,"mutex_wait_us":120,"thread_start_us":163,"threads_started":1}
I20260811 08:07:52.923991 3825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31c099a1ebf9422eb7b235bd99dc7aea" candidate_uuid: "a2e2df94f2e5478297e6bbb9741e443d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55e3512c427d4bf1a0f4beda7bbaa072" is_pre_election: true
I20260811 08:07:52.924037 3514 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31c099a1ebf9422eb7b235bd99dc7aea" candidate_uuid: "a2e2df94f2e5478297e6bbb9741e443d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29a8482bd7c34ce48067b265b493af68" is_pre_election: true
I20260811 08:07:52.924175 3825 raft_consensus.cc:2454] T 31c099a1ebf9422eb7b235bd99dc7aea P 55e3512c427d4bf1a0f4beda7bbaa072 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2e2df94f2e5478297e6bbb9741e443d in term 0.
I20260811 08:07:52.924197 3514 raft_consensus.cc:2454] T 31c099a1ebf9422eb7b235bd99dc7aea P 29a8482bd7c34ce48067b265b493af68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2e2df94f2e5478297e6bbb9741e443d in term 0.
I20260811 08:07:52.924606 3597 leader_election.cc:302] T 31c099a1ebf9422eb7b235bd99dc7aea P a2e2df94f2e5478297e6bbb9741e443d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29a8482bd7c34ce48067b265b493af68, a2e2df94f2e5478297e6bbb9741e443d; no voters:
I20260811 08:07:52.924854 3901 raft_consensus.cc:2781] T 31c099a1ebf9422eb7b235bd99dc7aea P a2e2df94f2e5478297e6bbb9741e443d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:07:52.924932 3901 raft_consensus.cc:482] T 31c099a1ebf9422eb7b235bd99dc7aea P a2e2df94f2e5478297e6bbb9741e443d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:07:52.924962 3901 raft_consensus.cc:3037] T 31c099a1ebf9422eb7b235bd99dc7aea P a2e2df94f2e5478297e6bbb9741e443d [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:07:52.925724 3901 raft_consensus.cc:504] T 31c099a1ebf9422eb7b235bd99dc7aea P a2e2df94f2e5478297e6bbb9741e443d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29a8482bd7c34ce48067b265b493af68" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 44141 } } peers { permanent_uuid: "a2e2df94f2e5478297e6bbb9741e443d" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 37237 } } peers { permanent_uuid: "55e3512c427d4bf1a0f4beda7bbaa072" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 36337 } }
I20260811 08:07:52.925896 3901 leader_election.cc:288] T 31c099a1ebf9422eb7b235bd99dc7aea P a2e2df94f2e5478297e6bbb9741e443d [CANDIDATE]: Term 1 election: Requested vote from peers 29a8482bd7c34ce48067b265b493af68 (127.15.36.193:44141), 55e3512c427d4bf1a0f4beda7bbaa072 (127.15.36.195:36337)
I20260811 08:07:52.926095 3825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31c099a1ebf9422eb7b235bd99dc7aea" candidate_uuid: "a2e2df94f2e5478297e6bbb9741e443d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55e3512c427d4bf1a0f4beda7bbaa072"
I20260811 08:07:52.926120 3514 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31c099a1ebf9422eb7b235bd99dc7aea" candidate_uuid: "a2e2df94f2e5478297e6bbb9741e443d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29a8482bd7c34ce48067b265b493af68"
I20260811 08:07:52.926208 3825 raft_consensus.cc:3037] T 31c099a1ebf9422eb7b235bd99dc7aea P 55e3512c427d4bf1a0f4beda7bbaa072 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:07:52.926203 3514 raft_consensus.cc:3037] T 31c099a1ebf9422eb7b235bd99dc7aea P 29a8482bd7c34ce48067b265b493af68 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:07:52.927158 3514 raft_consensus.cc:2454] T 31c099a1ebf9422eb7b235bd99dc7aea P 29a8482bd7c34ce48067b265b493af68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2e2df94f2e5478297e6bbb9741e443d in term 1.
I20260811 08:07:52.927170 3825 raft_consensus.cc:2454] T 31c099a1ebf9422eb7b235bd99dc7aea P 55e3512c427d4bf1a0f4beda7bbaa072 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2e2df94f2e5478297e6bbb9741e443d in term 1.
I20260811 08:07:52.927345 3597 leader_election.cc:302] T 31c099a1ebf9422eb7b235bd99dc7aea P a2e2df94f2e5478297e6bbb9741e443d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29a8482bd7c34ce48067b265b493af68, a2e2df94f2e5478297e6bbb9741e443d; no voters:
I20260811 08:07:52.927495 3901 raft_consensus.cc:2781] T 31c099a1ebf9422eb7b235bd99dc7aea P a2e2df94f2e5478297e6bbb9741e443d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:07:52.927663 3901 raft_consensus.cc:686] T 31c099a1ebf9422eb7b235bd99dc7aea P a2e2df94f2e5478297e6bbb9741e443d [term 1 LEADER]: Becoming Leader. State: Replica: a2e2df94f2e5478297e6bbb9741e443d, State: Running, Role: LEADER
I20260811 08:07:52.927801 3901 consensus_queue.cc:237] T 31c099a1ebf9422eb7b235bd99dc7aea P a2e2df94f2e5478297e6bbb9741e443d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29a8482bd7c34ce48067b265b493af68" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 44141 } } peers { permanent_uuid: "a2e2df94f2e5478297e6bbb9741e443d" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 37237 } } peers { permanent_uuid: "55e3512c427d4bf1a0f4beda7bbaa072" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 36337 } }
I20260811 08:07:52.928890 3343 catalog_manager.cc:5495] T 31c099a1ebf9422eb7b235bd99dc7aea P a2e2df94f2e5478297e6bbb9741e443d reported cstate change: term changed from 0 to 1, leader changed from <none> to a2e2df94f2e5478297e6bbb9741e443d (127.15.36.194). New cstate: current_term: 1 leader_uuid: "a2e2df94f2e5478297e6bbb9741e443d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29a8482bd7c34ce48067b265b493af68" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 44141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2e2df94f2e5478297e6bbb9741e443d" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 37237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55e3512c427d4bf1a0f4beda7bbaa072" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 36337 } health_report { overall_health: UNKNOWN } } }
W20260811 08:07:52.929085 3878 tablet.cc:2369] T 31c099a1ebf9422eb7b235bd99dc7aea P 55e3512c427d4bf1a0f4beda7bbaa072: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:07:52.948423 3892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:52.945785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43268 (local address 127.15.36.194:37237)
0811 08:07:52.945882 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:52.945884 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:52.945893 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:07:52.945942 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:52.945943 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:52.945973 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:52.946058 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:07:52.946228 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:52.946722 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:52.947565 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:52.947771 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:52.947866 (+ 95us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:52.948023 (+ 157us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:07:52.948128 (+ 105us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:07:52.948261 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:52.948305 (+ 44us) server_negotiation.cc:299] Negotiation successful
0811 08:07:52.948318 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 08:07:52.950485 3825 raft_consensus.cc:1261] T 31c099a1ebf9422eb7b235bd99dc7aea P 55e3512c427d4bf1a0f4beda7bbaa072 [term 1 FOLLOWER]: Refusing update from remote peer a2e2df94f2e5478297e6bbb9741e443d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:07:52.950484 3514 raft_consensus.cc:1261] T 31c099a1ebf9422eb7b235bd99dc7aea P 29a8482bd7c34ce48067b265b493af68 [term 1 FOLLOWER]: Refusing update from remote peer a2e2df94f2e5478297e6bbb9741e443d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:07:52.950939 3906 consensus_queue.cc:1035] T 31c099a1ebf9422eb7b235bd99dc7aea P a2e2df94f2e5478297e6bbb9741e443d [LEADER]: Connected to new peer: Peer: permanent_uuid: "29a8482bd7c34ce48067b265b493af68" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 44141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:07:52.951174 3901 consensus_queue.cc:1035] T 31c099a1ebf9422eb7b235bd99dc7aea P a2e2df94f2e5478297e6bbb9741e443d [LEADER]: Connected to new peer: Peer: permanent_uuid: "55e3512c427d4bf1a0f4beda7bbaa072" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 36337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:07:52.954027 3911 mvcc.cc:205] Tried to move back new op lower bound from 7317240516402216960 to 7317240516313227264. Current Snapshot: MvccSnapshot[applied={T|T < 7317240516402216960}]
I20260811 08:07:52.954701 3910 mvcc.cc:205] Tried to move back new op lower bound from 7317240516402216960 to 7317240516313227264. Current Snapshot: MvccSnapshot[applied={T|T < 7317240516402216960 or (T in {7317240516402216960})}]
I20260811 08:07:52.956635 3345 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46674:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:07:52.956758 3345 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46674:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:07:52.957574 3345 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 98757de289024db39f92fb08aaa8d2c8: Sending DeleteTablet for 3 replicas of tablet 31c099a1ebf9422eb7b235bd99dc7aea
I20260811 08:07:52.957924 3801 tablet_service.cc:1514] Processing DeleteTablet for tablet 31c099a1ebf9422eb7b235bd99dc7aea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:07:52 UTC) from {username='kudu', principal='kudu/127.15.36.254@KRBTEST.COM'} at 127.0.0.1:54650
I20260811 08:07:52.958065 3646 tablet_service.cc:1514] Processing DeleteTablet for tablet 31c099a1ebf9422eb7b235bd99dc7aea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:07:52 UTC) from {username='kudu', principal='kudu/127.15.36.254@KRBTEST.COM'} at 127.0.0.1:43254
I20260811 08:07:52.958148 3492 tablet_service.cc:1514] Processing DeleteTablet for tablet 31c099a1ebf9422eb7b235bd99dc7aea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:07:52 UTC) from {username='kudu', principal='kudu/127.15.36.254@KRBTEST.COM'} at 127.0.0.1:52694
I20260811 08:07:52.958370 3920 tablet_replica.cc:330] T 31c099a1ebf9422eb7b235bd99dc7aea P a2e2df94f2e5478297e6bbb9741e443d: stopping tablet replica
I20260811 08:07:52.958420 3921 tablet_replica.cc:330] T 31c099a1ebf9422eb7b235bd99dc7aea P 29a8482bd7c34ce48067b265b493af68: stopping tablet replica
I20260811 08:07:52.958473 3920 raft_consensus.cc:2229] T 31c099a1ebf9422eb7b235bd99dc7aea P a2e2df94f2e5478297e6bbb9741e443d [term 1 LEADER]: Raft consensus shutting down.
I20260811 08:07:52.958541 3921 raft_consensus.cc:2229] T 31c099a1ebf9422eb7b235bd99dc7aea P 29a8482bd7c34ce48067b265b493af68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:07:52.958570 3920 raft_consensus.cc:2258] T 31c099a1ebf9422eb7b235bd99dc7aea P a2e2df94f2e5478297e6bbb9741e443d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:07:52.958654 3921 raft_consensus.cc:2258] T 31c099a1ebf9422eb7b235bd99dc7aea P 29a8482bd7c34ce48067b265b493af68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:07:52.958873 3919 tablet_replica.cc:330] T 31c099a1ebf9422eb7b235bd99dc7aea P 55e3512c427d4bf1a0f4beda7bbaa072: stopping tablet replica
I20260811 08:07:52.958899 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 3417
I20260811 08:07:52.959172 3921 ts_tablet_manager.cc:1905] T 31c099a1ebf9422eb7b235bd99dc7aea P 29a8482bd7c34ce48067b265b493af68: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:07:52.960765 3919 raft_consensus.cc:2229] T 31c099a1ebf9422eb7b235bd99dc7aea P 55e3512c427d4bf1a0f4beda7bbaa072 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:07:52.961009 3919 raft_consensus.cc:2258] T 31c099a1ebf9422eb7b235bd99dc7aea P 55e3512c427d4bf1a0f4beda7bbaa072 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:07:52.961593 3919 ts_tablet_manager.cc:1905] T 31c099a1ebf9422eb7b235bd99dc7aea P 55e3512c427d4bf1a0f4beda7bbaa072: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:07:52.964037 3920 ts_tablet_manager.cc:1905] T 31c099a1ebf9422eb7b235bd99dc7aea P a2e2df94f2e5478297e6bbb9741e443d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:07:52.964345 3919 ts_tablet_manager.cc:1918] T 31c099a1ebf9422eb7b235bd99dc7aea P 55e3512c427d4bf1a0f4beda7bbaa072: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:07:52.964496 3919 log.cc:1196] T 31c099a1ebf9422eb7b235bd99dc7aea P 55e3512c427d4bf1a0f4beda7bbaa072: Deleting WAL directory at /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/minicluster-data/ts-2/wal/wals/31c099a1ebf9422eb7b235bd99dc7aea
I20260811 08:07:52.965005 3919 ts_tablet_manager.cc:1939] T 31c099a1ebf9422eb7b235bd99dc7aea P 55e3512c427d4bf1a0f4beda7bbaa072: Deleting consensus metadata
I20260811 08:07:52.965677 3329 catalog_manager.cc:4841] TS 55e3512c427d4bf1a0f4beda7bbaa072 (127.15.36.195:36337): tablet 31c099a1ebf9422eb7b235bd99dc7aea (table test-table [id=5673fe89246f4bc0988e93b654b919ce]) successfully deleted
I20260811 08:07:52.965759 3920 ts_tablet_manager.cc:1918] T 31c099a1ebf9422eb7b235bd99dc7aea P a2e2df94f2e5478297e6bbb9741e443d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:07:52.965831 3920 log.cc:1196] T 31c099a1ebf9422eb7b235bd99dc7aea P a2e2df94f2e5478297e6bbb9741e443d: Deleting WAL directory at /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786435400844580-15507-0/minicluster-data/ts-1/wal/wals/31c099a1ebf9422eb7b235bd99dc7aea
I20260811 08:07:52.966122 3920 ts_tablet_manager.cc:1939] T 31c099a1ebf9422eb7b235bd99dc7aea P a2e2df94f2e5478297e6bbb9741e443d: Deleting consensus metadata
I20260811 08:07:52.966995 3332 catalog_manager.cc:4841] TS a2e2df94f2e5478297e6bbb9741e443d (127.15.36.194:37237): tablet 31c099a1ebf9422eb7b235bd99dc7aea (table test-table [id=5673fe89246f4bc0988e93b654b919ce]) successfully deleted
W20260811 08:07:52.967604 3330 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.36.193:44141 (error 108)
I20260811 08:07:52.967908 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 3573
I20260811 08:07:52.972170 3889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:52.971980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.193:44141 (local address 127.0.0.1:52698)
0811 08:07:52.972060 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:52.972118 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.193:44141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260811 08:07:52.972393 3330 catalog_manager.cc:4584] TS 29a8482bd7c34ce48067b265b493af68 (127.15.36.193:44141): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 31c099a1ebf9422eb7b235bd99dc7aea: Network error: Client connection negotiation failed: client connection to 127.15.36.193:44141: connect: Connection refused (error 111)
I20260811 08:07:52.975685 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 3731
I20260811 08:07:52.984489 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 3309
2026-08-11T08:07:52Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2288 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-11T08:07:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:07:53Z Disabled control of system clock
I20260811 08:07:53.016510 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435400844580-15507-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435400844580-15507-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435400844580-15507-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:32947
--webserver_interface=127.15.36.254
--webserver_port=0
--builtin_ntp_servers=127.15.36.212:43395
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.36.254:32947
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 08:07:53.105546 3927 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:07:53.105799 3927 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:07:53.105822 3927 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:07:53.107077 3927 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:07:53.107124 3927 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:07:53.107137 3927 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:07:53.107151 3927 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:07:53.107162 3927 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:07:53.108569 3927 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:43395
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435400844580-15507-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435400844580-15507-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.36.254:32947
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:32947
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.36.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3927
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435400844580-15507-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:07:53.108811 3927 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:07:53.109088 3927 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:07:53.114445 3932 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:07:53.114462 3933 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:07:53.114602 3927 server_base.cc:1034] running on GCE node
W20260811 08:07:53.114502 3935 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:07:53.115228 3927 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:07:53.115614 3927 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:07:53.116804 3927 hybrid_clock.cc:648] HybridClock initialized: now 1786435673116798 us; error 49 us; skew 500 ppm
I20260811 08:07:53.123634 3927 webserver.cc:460] Webserver started at http://127.15.36.254:34629/ using document root <none> and password file <none>
I20260811 08:07:53.123963 3927 fs_manager.cc:359] Metadata directory not provided
I20260811 08:07:53.124050 3927 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:07:53.124238 3927 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:07:53.125531 3927 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435400844580-15507-0/minicluster-data/master-0/data/instance:
uuid: "53b1f4d5d0de4ec4b297eb04dbea4dc2"
format_stamp: "Formatted at 2026-08-11 08:07:53 on dist-test-slave-2w3w"
server_key: "1db047d8821890eb75dcbb2bfb7da43c"
server_key_iv: "24b3a1a36d155dce4906cf25b5ab5e7c"
server_key_version: "encryptionkey@0"
I20260811 08:07:53.125946 3927 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435400844580-15507-0/minicluster-data/master-0/wal/instance:
uuid: "53b1f4d5d0de4ec4b297eb04dbea4dc2"
format_stamp: "Formatted at 2026-08-11 08:07:53 on dist-test-slave-2w3w"
server_key: "1db047d8821890eb75dcbb2bfb7da43c"
server_key_iv: "24b3a1a36d155dce4906cf25b5ab5e7c"
server_key_version: "encryptionkey@0"
I20260811 08:07:53.127609 3927 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.002s
I20260811 08:07:53.128477 3941 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:53.128718 3927 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:07:53.128836 3927 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435400844580-15507-0/minicluster-data/master-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435400844580-15507-0/minicluster-data/master-0/wal
uuid: "53b1f4d5d0de4ec4b297eb04dbea4dc2"
format_stamp: "Formatted at 2026-08-11 08:07:53 on dist-test-slave-2w3w"
server_key: "1db047d8821890eb75dcbb2bfb7da43c"
server_key_iv: "24b3a1a36d155dce4906cf25b5ab5e7c"
server_key_version: "encryptionkey@0"
I20260811 08:07:53.128930 3927 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435400844580-15507-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435400844580-15507-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435400844580-15507-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:07:53.149001 3927 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:07:53.149462 3927 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:07:53.149632 3927 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:07:53.154238 3927 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.254:32947
I20260811 08:07:53.154316 4002 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.254:32947 every 8 connection(s)
I20260811 08:07:53.154699 3927 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
I20260811 08:07:53.155531 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 3927
I20260811 08:07:53.155654 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435400844580-15507-0/minicluster-data/master-0/wal/instance
I20260811 08:07:53.155931 15507 external_mini_cluster.cc:1428] Setting key 379a6df2a832bac15ff69101d1578e16
I20260811 08:07:53.155918 4003 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:07:53.159937 4003 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 53b1f4d5d0de4ec4b297eb04dbea4dc2: Bootstrap starting.
I20260811 08:07:53.160620 4003 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 53b1f4d5d0de4ec4b297eb04dbea4dc2: Neither blocks nor log segments found. Creating new log.
I20260811 08:07:53.160944 4003 log.cc:824] T 00000000000000000000000000000000 P 53b1f4d5d0de4ec4b297eb04dbea4dc2: Log is configured to *not* fsync() on all Append() calls
I20260811 08:07:53.161723 4003 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 53b1f4d5d0de4ec4b297eb04dbea4dc2: No bootstrap required, opened a new log
I20260811 08:07:53.162452 4006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:53.156536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52576 (local address 127.15.36.254:32947)
0811 08:07:53.157009 (+ 473us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:53.157016 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:53.157087 (+ 71us) server_negotiation.cc:407] Connection header received
0811 08:07:53.157681 (+ 594us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:53.157687 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:53.157749 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:53.157911 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:07:53.158170 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:53.159116 (+ 946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:53.160259 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:53.160722 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:53.160952 (+ 230us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:53.161731 (+ 779us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:07:53.161736 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:07:53.161736 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:07:53.161967 (+ 231us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:07:53.162003 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:07:53.162015 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:07:53.162091 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:53.162169 (+ 78us) server_negotiation.cc:299] Negotiation successful
0811 08:07:53.162255 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":388,"thread_start_us":338,"threads_started":1}
I20260811 08:07:53.164178 4003 raft_consensus.cc:348] T 00000000000000000000000000000000 P 53b1f4d5d0de4ec4b297eb04dbea4dc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53b1f4d5d0de4ec4b297eb04dbea4dc2" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 32947 } }
I20260811 08:07:53.164371 4003 raft_consensus.cc:374] T 00000000000000000000000000000000 P 53b1f4d5d0de4ec4b297eb04dbea4dc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:07:53.164424 4003 raft_consensus.cc:729] T 00000000000000000000000000000000 P 53b1f4d5d0de4ec4b297eb04dbea4dc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53b1f4d5d0de4ec4b297eb04dbea4dc2, State: Initialized, Role: FOLLOWER
I20260811 08:07:53.164580 4003 consensus_queue.cc:260] T 00000000000000000000000000000000 P 53b1f4d5d0de4ec4b297eb04dbea4dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53b1f4d5d0de4ec4b297eb04dbea4dc2" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 32947 } }
I20260811 08:07:53.164664 4003 raft_consensus.cc:388] T 00000000000000000000000000000000 P 53b1f4d5d0de4ec4b297eb04dbea4dc2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:07:53.164707 4003 raft_consensus.cc:482] T 00000000000000000000000000000000 P 53b1f4d5d0de4ec4b297eb04dbea4dc2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:07:53.164757 4003 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 53b1f4d5d0de4ec4b297eb04dbea4dc2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:07:53.165402 4003 raft_consensus.cc:504] T 00000000000000000000000000000000 P 53b1f4d5d0de4ec4b297eb04dbea4dc2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53b1f4d5d0de4ec4b297eb04dbea4dc2" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 32947 } }
I20260811 08:07:53.165534 4003 leader_election.cc:302] T 00000000000000000000000000000000 P 53b1f4d5d0de4ec4b297eb04dbea4dc2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 53b1f4d5d0de4ec4b297eb04dbea4dc2; no voters:
I20260811 08:07:53.165786 4003 leader_election.cc:288] T 00000000000000000000000000000000 P 53b1f4d5d0de4ec4b297eb04dbea4dc2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:07:53.165892 4009 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 53b1f4d5d0de4ec4b297eb04dbea4dc2 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:07:53.166216 4003 sys_catalog.cc:564] T 00000000000000000000000000000000 P 53b1f4d5d0de4ec4b297eb04dbea4dc2 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:07:53.166244 4009 raft_consensus.cc:686] T 00000000000000000000000000000000 P 53b1f4d5d0de4ec4b297eb04dbea4dc2 [term 1 LEADER]: Becoming Leader. State: Replica: 53b1f4d5d0de4ec4b297eb04dbea4dc2, State: Running, Role: LEADER
I20260811 08:07:53.166363 4009 consensus_queue.cc:237] T 00000000000000000000000000000000 P 53b1f4d5d0de4ec4b297eb04dbea4dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53b1f4d5d0de4ec4b297eb04dbea4dc2" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 32947 } }
I20260811 08:07:53.166741 4010 sys_catalog.cc:455] T 00000000000000000000000000000000 P 53b1f4d5d0de4ec4b297eb04dbea4dc2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "53b1f4d5d0de4ec4b297eb04dbea4dc2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53b1f4d5d0de4ec4b297eb04dbea4dc2" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 32947 } } }
I20260811 08:07:53.166746 4011 sys_catalog.cc:455] T 00000000000000000000000000000000 P 53b1f4d5d0de4ec4b297eb04dbea4dc2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 53b1f4d5d0de4ec4b297eb04dbea4dc2. Latest consensus state: current_term: 1 leader_uuid: "53b1f4d5d0de4ec4b297eb04dbea4dc2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53b1f4d5d0de4ec4b297eb04dbea4dc2" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 32947 } } }
I20260811 08:07:53.166981 4011 sys_catalog.cc:458] T 00000000000000000000000000000000 P 53b1f4d5d0de4ec4b297eb04dbea4dc2 [sys.catalog]: This master's current role is: LEADER
I20260811 08:07:53.166934 4010 sys_catalog.cc:458] T 00000000000000000000000000000000 P 53b1f4d5d0de4ec4b297eb04dbea4dc2 [sys.catalog]: This master's current role is: LEADER
W20260811 08:07:53.168151 4026 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 53b1f4d5d0de4ec4b297eb04dbea4dc2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 08:07:53.168221 4026 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 08:07:53.168272 4018 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:07:53.168457 4018 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:07:53.169956 4018 catalog_manager.cc:1347] Generated new cluster ID: ac7449580e454642aefc216c68920c2d
I20260811 08:07:53.170037 4018 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:07:53.196427 4018 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:07:53.197072 4018 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:07:53.207655 4018 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 53b1f4d5d0de4ec4b297eb04dbea4dc2: Generated new TSK 0
I20260811 08:07:53.207914 4018 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:07:53.209386 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435400844580-15507-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435400844580-15507-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435400844580-15507-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.193:0
--local_ip_for_outbound_sockets=127.15.36.193
--webserver_interface=127.15.36.193
--webserver_port=0
--tserver_master_addrs=127.15.36.254:32947
--builtin_ntp_servers=127.15.36.212:43395
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 08:07:53.294870 4029 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:07:53.295131 4029 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:07:53.295158 4029 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:07:53.296518 4029 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:07:53.296579 4029 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:07:53.296608 4029 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.193
I20260811 08:07:53.298401 4029 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:43395
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435400844580-15507-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435400844580-15507-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.36.193
--webserver_port=0
--tserver_master_addrs=127.15.36.254:32947
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4029
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.193
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435400844580-15507-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:07:53.298735 4029 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:07:53.299141 4029 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:07:53.305275 4035 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:07:53.305435 4029 server_base.cc:1034] running on GCE node
W20260811 08:07:53.305287 4037 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:07:53.305550 4034 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:07:53.305928 4029 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:07:53.306236 4029 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:07:53.307433 4029 hybrid_clock.cc:648] HybridClock initialized: now 1786435673307409 us; error 48 us; skew 500 ppm
I20260811 08:07:53.308904 4029 webserver.cc:460] Webserver started at http://127.15.36.193:37363/ using document root <none> and password file <none>
I20260811 08:07:53.309190 4029 fs_manager.cc:359] Metadata directory not provided
I20260811 08:07:53.309263 4029 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:07:53.309439 4029 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:07:53.310673 4029 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435400844580-15507-0/minicluster-data/ts-0/data/instance:
uuid: "552d1cec1ca443d480f585386aac954e"
format_stamp: "Formatted at 2026-08-11 08:07:53 on dist-test-slave-2w3w"
server_key: "de350ce1eb492c74ad95e68a97d77074"
server_key_iv: "e57f958bfcb742585d5ecc8946d1c8c5"
server_key_version: "encryptionkey@0"
I20260811 08:07:53.311127 4029 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435400844580-15507-0/minicluster-data/ts-0/wal/instance:
uuid: "552d1cec1ca443d480f585386aac954e"
format_stamp: "Formatted at 2026-08-11 08:07:53 on dist-test-slave-2w3w"
server_key: "de350ce1eb492c74ad95e68a97d77074"
server_key_iv: "e57f958bfcb742585d5ecc8946d1c8c5"
server_key_version: "encryptionkey@0"
I20260811 08:07:53.312562 4029 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:07:53.313407 4045 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:53.313670 4029 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:07:53.313797 4029 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435400844580-15507-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435400844580-15507-0/minicluster-data/ts-0/wal
uuid: "552d1cec1ca443d480f585386aac954e"
format_stamp: "Formatted at 2026-08-11 08:07:53 on dist-test-slave-2w3w"
server_key: "de350ce1eb492c74ad95e68a97d77074"
server_key_iv: "e57f958bfcb742585d5ecc8946d1c8c5"
server_key_version: "encryptionkey@0"
I20260811 08:07:53.313982 4029 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435400844580-15507-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435400844580-15507-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435400844580-15507-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:07:53.332012 4029 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:07:53.332399 4029 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:07:53.332567 4029 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:07:53.332839 4029 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:07:53.333271 4029 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:07:53.333340 4029 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:53.333382 4029 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:07:53.333431 4029 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:53.340747 4029 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.193:32969
I20260811 08:07:53.340804 4176 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.193:32969 every 8 connection(s)
I20260811 08:07:53.341197 4029 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
I20260811 08:07:53.345775 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 4029
I20260811 08:07:53.345920 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435400844580-15507-0/minicluster-data/ts-0/wal/instance
I20260811 08:07:53.346161 15507 external_mini_cluster.cc:1428] Setting key f41f26cbc163065e87bfcca0bdfd5a5e
I20260811 08:07:53.347342 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435400844580-15507-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435400844580-15507-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435400844580-15507-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.194:0
--local_ip_for_outbound_sockets=127.15.36.194
--webserver_interface=127.15.36.194
--webserver_port=0
--tserver_master_addrs=127.15.36.254:32947
--builtin_ntp_servers=127.15.36.212:43395
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 08:07:53.347771 4006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:53.342095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:46113 (local address 127.15.36.254:32947)
0811 08:07:53.342148 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:53.342151 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:53.342399 (+ 248us) server_negotiation.cc:407] Connection header received
0811 08:07:53.343107 (+ 708us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:53.343109 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:53.343122 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:53.343188 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:07:53.343985 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:53.344646 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:53.345942 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:53.346274 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:53.346326 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:53.347434 (+ 1108us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:07:53.347435 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:07:53.347436 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:07:53.347442 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:07:53.347460 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:07:53.347465 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:07:53.347518 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:53.347633 (+ 115us) server_negotiation.cc:299] Negotiation successful
0811 08:07:53.347680 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 08:07:53.348023 4179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:53.342054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32947 (local address 127.15.36.193:46113)
0811 08:07:53.342254 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:53.342298 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 08:07:53.342938 (+ 640us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:07:53.343272 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:07:53.343279 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:07:53.343292 (+ 13us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:07:53.343872 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:53.343877 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:53.344755 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:53.344756 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:53.345808 (+ 1052us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:53.345811 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:53.346440 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:53.346441 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:53.346577 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:53.347247 (+ 670us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 08:07:53.347248 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:07:53.347283 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 08:07:53.347309 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:07:53.347548 (+ 239us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:07:53.347556 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:07:53.347560 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:07:53.347635 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 08:07:53.347756 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":78,"threads_started":1}
I20260811 08:07:53.348646 4177 heartbeater.cc:347] Connected to a master server at 127.15.36.254:32947
I20260811 08:07:53.348829 4177 heartbeater.cc:464] Registering TS with master...
I20260811 08:07:53.349076 4177 heartbeater.cc:511] Master 127.15.36.254:32947 requested a full tablet report, sending...
I20260811 08:07:53.349720 3962 ts_manager.cc:194] Registered new tserver with Master: 552d1cec1ca443d480f585386aac954e (127.15.36.193:32969)
I20260811 08:07:53.350641 3962 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.36.193:46113
W20260811 08:07:53.437398 4180 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:07:53.437630 4180 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:07:53.437655 4180 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:07:53.438798 4180 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:07:53.438839 4180 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:07:53.438864 4180 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.194
I20260811 08:07:53.440243 4180 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:43395
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435400844580-15507-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435400844580-15507-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.36.194
--webserver_port=0
--tserver_master_addrs=127.15.36.254:32947
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4180
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.194
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435400844580-15507-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:07:53.440464 4180 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:07:53.440726 4180 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:07:53.446403 4187 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:07:53.446411 4188 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:07:53.446530 4190 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:07:53.446673 4180 server_base.cc:1034] running on GCE node
I20260811 08:07:53.446940 4180 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:07:53.447254 4180 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:07:53.448426 4180 hybrid_clock.cc:648] HybridClock initialized: now 1786435673448404 us; error 38 us; skew 500 ppm
I20260811 08:07:53.449925 4180 webserver.cc:460] Webserver started at http://127.15.36.194:33039/ using document root <none> and password file <none>
I20260811 08:07:53.450223 4180 fs_manager.cc:359] Metadata directory not provided
I20260811 08:07:53.450278 4180 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:07:53.450459 4180 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:07:53.451762 4180 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435400844580-15507-0/minicluster-data/ts-1/data/instance:
uuid: "a69c4908f33140aba76bf80aa836ebcd"
format_stamp: "Formatted at 2026-08-11 08:07:53 on dist-test-slave-2w3w"
server_key: "1a99a4b4cc7ea681950509b7023c5240"
server_key_iv: "2fa85fc375d3f67a968c4f88b761baea"
server_key_version: "encryptionkey@0"
I20260811 08:07:53.452164 4180 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435400844580-15507-0/minicluster-data/ts-1/wal/instance:
uuid: "a69c4908f33140aba76bf80aa836ebcd"
format_stamp: "Formatted at 2026-08-11 08:07:53 on dist-test-slave-2w3w"
server_key: "1a99a4b4cc7ea681950509b7023c5240"
server_key_iv: "2fa85fc375d3f67a968c4f88b761baea"
server_key_version: "encryptionkey@0"
I20260811 08:07:53.453837 4180 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 08:07:53.454751 4197 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:53.455163 4180 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:07:53.455552 4180 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435400844580-15507-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435400844580-15507-0/minicluster-data/ts-1/wal
uuid: "a69c4908f33140aba76bf80aa836ebcd"
format_stamp: "Formatted at 2026-08-11 08:07:53 on dist-test-slave-2w3w"
server_key: "1a99a4b4cc7ea681950509b7023c5240"
server_key_iv: "2fa85fc375d3f67a968c4f88b761baea"
server_key_version: "encryptionkey@0"
I20260811 08:07:53.455660 4180 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435400844580-15507-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435400844580-15507-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435400844580-15507-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:07:53.472397 4180 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:07:53.472711 4180 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:07:53.472838 4180 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:07:53.473063 4180 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:07:53.473479 4180 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:07:53.473524 4180 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:53.473548 4180 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:07:53.473601 4180 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:53.480126 4180 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.194:33109
I20260811 08:07:53.480219 4325 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.194:33109 every 8 connection(s)
I20260811 08:07:53.480573 4180 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
I20260811 08:07:53.484310 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 4180
I20260811 08:07:53.484409 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435400844580-15507-0/minicluster-data/ts-1/wal/instance
I20260811 08:07:53.484642 15507 external_mini_cluster.cc:1428] Setting key 30b38e9ee6548cabbf2f239d2816786a
I20260811 08:07:53.485762 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435400844580-15507-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435400844580-15507-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435400844580-15507-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.195:0
--local_ip_for_outbound_sockets=127.15.36.195
--webserver_interface=127.15.36.195
--webserver_port=0
--tserver_master_addrs=127.15.36.254:32947
--builtin_ntp_servers=127.15.36.212:43395
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 08:07:53.486709 4006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:53.481426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:55973 (local address 127.15.36.254:32947)
0811 08:07:53.481533 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:53.481536 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:53.481735 (+ 199us) server_negotiation.cc:407] Connection header received
0811 08:07:53.482248 (+ 513us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:53.482250 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:53.482262 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:53.482350 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:07:53.483203 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:53.483751 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:53.484977 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:53.485218 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:53.485323 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:53.486359 (+ 1036us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:07:53.486361 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:07:53.486361 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:07:53.486367 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:07:53.486387 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:07:53.486392 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:07:53.486460 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:53.486549 (+ 89us) server_negotiation.cc:299] Negotiation successful
0811 08:07:53.486582 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260811 08:07:53.486815 4328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:53.481329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32947 (local address 127.15.36.194:55973)
0811 08:07:53.481573 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:53.481617 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 08:07:53.482148 (+ 531us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:07:53.482423 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:07:53.482427 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:07:53.482435 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:07:53.483108 (+ 673us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:53.483113 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:53.483878 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:53.483879 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:53.484858 (+ 979us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:53.484861 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:53.485356 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:53.485357 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:53.485524 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:53.486202 (+ 678us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 08:07:53.486202 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:07:53.486234 (+ 32us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 08:07:53.486259 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:07:53.486467 (+ 208us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:07:53.486472 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:07:53.486474 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 08:07:53.486529 (+ 55us) client_negotiation.cc:240] Negotiation successful
0811 08:07:53.486616 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":97,"threads_started":1}
I20260811 08:07:53.487567 4326 heartbeater.cc:347] Connected to a master server at 127.15.36.254:32947
I20260811 08:07:53.487682 4326 heartbeater.cc:464] Registering TS with master...
I20260811 08:07:53.487922 4326 heartbeater.cc:511] Master 127.15.36.254:32947 requested a full tablet report, sending...
I20260811 08:07:53.488375 3962 ts_manager.cc:194] Registered new tserver with Master: a69c4908f33140aba76bf80aa836ebcd (127.15.36.194:33109)
I20260811 08:07:53.488911 3962 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.36.194:55973
W20260811 08:07:53.574436 4329 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:07:53.574656 4329 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:07:53.574681 4329 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:07:53.575951 4329 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:07:53.576007 4329 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:07:53.576038 4329 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.195
I20260811 08:07:53.577523 4329 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:43395
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435400844580-15507-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435400844580-15507-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.36.195
--webserver_port=0
--tserver_master_addrs=127.15.36.254:32947
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4329
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.195
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435400844580-15507-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:07:53.577826 4329 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:07:53.578173 4329 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:07:53.583676 4335 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:07:53.583662 4336 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:07:53.583647 4338 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:07:53.584082 4329 server_base.cc:1034] running on GCE node
I20260811 08:07:53.584359 4329 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:07:53.584621 4329 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:07:53.585824 4329 hybrid_clock.cc:648] HybridClock initialized: now 1786435673585798 us; error 57 us; skew 500 ppm
I20260811 08:07:53.587420 4329 webserver.cc:460] Webserver started at http://127.15.36.195:39787/ using document root <none> and password file <none>
I20260811 08:07:53.587687 4329 fs_manager.cc:359] Metadata directory not provided
I20260811 08:07:53.587785 4329 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:07:53.587966 4329 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:07:53.589260 4329 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435400844580-15507-0/minicluster-data/ts-2/data/instance:
uuid: "3ec4af1c2da04ba48624fd05349fe791"
format_stamp: "Formatted at 2026-08-11 08:07:53 on dist-test-slave-2w3w"
server_key: "aeab992e91ad90e2c880acc2c35d41b1"
server_key_iv: "4065502e09e09b3309cc86ceae845569"
server_key_version: "encryptionkey@0"
I20260811 08:07:53.589663 4329 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435400844580-15507-0/minicluster-data/ts-2/wal/instance:
uuid: "3ec4af1c2da04ba48624fd05349fe791"
format_stamp: "Formatted at 2026-08-11 08:07:53 on dist-test-slave-2w3w"
server_key: "aeab992e91ad90e2c880acc2c35d41b1"
server_key_iv: "4065502e09e09b3309cc86ceae845569"
server_key_version: "encryptionkey@0"
I20260811 08:07:53.591218 4329 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 08:07:53.592168 4344 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:53.592382 4329 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:07:53.592504 4329 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435400844580-15507-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435400844580-15507-0/minicluster-data/ts-2/wal
uuid: "3ec4af1c2da04ba48624fd05349fe791"
format_stamp: "Formatted at 2026-08-11 08:07:53 on dist-test-slave-2w3w"
server_key: "aeab992e91ad90e2c880acc2c35d41b1"
server_key_iv: "4065502e09e09b3309cc86ceae845569"
server_key_version: "encryptionkey@0"
I20260811 08:07:53.592588 4329 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435400844580-15507-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435400844580-15507-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435400844580-15507-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:07:53.620769 4329 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:07:53.621160 4329 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:07:53.621338 4329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:07:53.621601 4329 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:07:53.621986 4329 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:07:53.622047 4329 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:53.622090 4329 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:07:53.622119 4329 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:53.628621 4329 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.195:35683
I20260811 08:07:53.628726 4480 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.195:35683 every 8 connection(s)
I20260811 08:07:53.629115 4329 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
I20260811 08:07:53.633858 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 4329
I20260811 08:07:53.634016 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435400844580-15507-0/minicluster-data/ts-2/wal/instance
I20260811 08:07:53.634310 15507 external_mini_cluster.cc:1428] Setting key 8481b304bb87bac8e2aa86e8e9776b9b
I20260811 08:07:53.635782 4006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:53.629973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:35377 (local address 127.15.36.254:32947)
0811 08:07:53.630106 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:53.630108 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:53.630267 (+ 159us) server_negotiation.cc:407] Connection header received
0811 08:07:53.630856 (+ 589us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:53.630858 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:53.630869 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:53.630938 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:07:53.631821 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:53.632346 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:53.633443 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:53.633919 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:53.634028 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:53.635463 (+ 1435us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:07:53.635465 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:07:53.635466 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:07:53.635471 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:07:53.635491 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:07:53.635496 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:07:53.635558 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:53.635673 (+ 115us) server_negotiation.cc:299] Negotiation successful
0811 08:07:53.635703 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
I20260811 08:07:53.636050 4483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:53.629922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:32947 (local address 127.15.36.195:35377)
0811 08:07:53.630122 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:53.630167 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 08:07:53.630692 (+ 525us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:07:53.631091 (+ 399us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:07:53.631095 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:07:53.631104 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:07:53.631662 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:53.631667 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:53.632459 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:53.632460 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:53.633355 (+ 895us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:53.633358 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:53.634143 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:53.634144 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:53.634280 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:53.635275 (+ 995us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 08:07:53.635275 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:07:53.635319 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 08:07:53.635352 (+ 33us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:07:53.635572 (+ 220us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:07:53.635579 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:07:53.635582 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:07:53.635659 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 08:07:53.635775 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":98,"threads_started":1}
I20260811 08:07:53.636606 4481 heartbeater.cc:347] Connected to a master server at 127.15.36.254:32947
I20260811 08:07:53.636718 4481 heartbeater.cc:464] Registering TS with master...
I20260811 08:07:53.636969 4481 heartbeater.cc:511] Master 127.15.36.254:32947 requested a full tablet report, sending...
I20260811 08:07:53.637451 3962 ts_manager.cc:194] Registered new tserver with Master: 3ec4af1c2da04ba48624fd05349fe791 (127.15.36.195:35683)
I20260811 08:07:53.637902 3962 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.36.195:35377
I20260811 08:07:53.647066 15507 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 08:07:53.652030 4006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:53.648589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52580 (local address 127.15.36.254:32947)
0811 08:07:53.648677 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:53.648679 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:53.648741 (+ 62us) server_negotiation.cc:407] Connection header received
0811 08:07:53.648798 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:53.648799 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:53.648808 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:53.648864 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:07:53.649081 (+ 217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:53.649628 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:53.650510 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:53.650729 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:53.650795 (+ 66us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:53.651605 (+ 810us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:07:53.651607 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:07:53.651607 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:07:53.651612 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:07:53.651627 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:07:53.651632 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:07:53.651718 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:53.651791 (+ 73us) server_negotiation.cc:299] Negotiation successful
0811 08:07:53.651802 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 08:07:53.653868 3962 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52580:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:07:53.655756 3962 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:07:53.663600 4493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:53.658373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.195:35683 (local address 127.0.0.1:33782)
0811 08:07:53.658791 (+ 418us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:53.658801 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:07:53.658842 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:07:53.659658 (+ 816us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:07:53.659659 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:07:53.659661 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:07:53.659696 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:53.659698 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:53.661221 (+ 1523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:53.661223 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:53.662178 (+ 955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:53.662181 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:53.663160 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:53.663161 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:53.663266 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:53.663312 (+ 46us) client_negotiation.cc:769] Sending connection context
0811 08:07:53.663431 (+ 119us) client_negotiation.cc:240] Negotiation successful
0811 08:07:53.663506 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":395,"mutex_wait_us":5,"thread_start_us":78,"threads_started":1}
I20260811 08:07:53.663611 4495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:53.658668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33782 (local address 127.15.36.195:35683)
0811 08:07:53.659119 (+ 451us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:53.659126 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:53.659139 (+ 13us) server_negotiation.cc:407] Connection header received
0811 08:07:53.659188 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:53.659191 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:53.659215 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:53.659786 (+ 571us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:07:53.659919 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:53.661152 (+ 1233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:53.662298 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:53.663063 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:53.663159 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:53.663313 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:53.663453 (+ 140us) server_negotiation.cc:299] Negotiation successful
0811 08:07:53.663501 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":307,"thread_start_us":138,"threads_started":1}
I20260811 08:07:53.663889 4492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:53.658373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.194:33109 (local address 127.0.0.1:33116)
0811 08:07:53.658520 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:53.658573 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 08:07:53.658674 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:07:53.659393 (+ 719us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:07:53.659396 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:07:53.659399 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:07:53.659492 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:53.659494 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:53.660680 (+ 1186us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:53.660681 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:53.662123 (+ 1442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:53.662127 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:53.663626 (+ 1499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:53.663627 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:53.663685 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:53.663690 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 08:07:53.663724 (+ 34us) client_negotiation.cc:240] Negotiation successful
0811 08:07:53.663774 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"mutex_wait_us":1,"thread_start_us":73,"threads_started":1}
I20260811 08:07:53.663897 4491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:53.658386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.193:32969 (local address 127.0.0.1:55114)
0811 08:07:53.658985 (+ 599us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:53.659064 (+ 79us) client_negotiation.cc:174] Beginning negotiation
0811 08:07:53.659137 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:07:53.659548 (+ 411us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:07:53.659549 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:07:53.659551 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:07:53.659608 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:53.659610 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:53.661156 (+ 1546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:53.661157 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:53.662341 (+ 1184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:53.662343 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:53.663589 (+ 1246us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:53.663590 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:53.663662 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:53.663667 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 08:07:53.663724 (+ 57us) client_negotiation.cc:240] Negotiation successful
0811 08:07:53.663776 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":562,"mutex_wait_us":4,"thread_start_us":109,"threads_started":1}
I20260811 08:07:53.664080 4494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:53.658668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55114 (local address 127.15.36.193:32969)
0811 08:07:53.659362 (+ 694us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:53.659366 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:53.659377 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:07:53.659422 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:53.659425 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:53.659447 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:53.659551 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:07:53.659697 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:53.661048 (+ 1351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:53.662454 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:53.663353 (+ 899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:53.663443 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:53.663546 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:53.663943 (+ 397us) server_negotiation.cc:299] Negotiation successful
0811 08:07:53.663996 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":206,"thread_start_us":133,"threads_started":1}
I20260811 08:07:53.664317 4496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:53.659005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33116 (local address 127.15.36.194:33109)
0811 08:07:53.659176 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:53.659181 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:53.659193 (+ 12us) server_negotiation.cc:407] Connection header received
0811 08:07:53.659249 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:53.659251 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:53.659269 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:53.659375 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:07:53.659591 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:53.660584 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:53.662493 (+ 1909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:53.663353 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:53.664022 (+ 669us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:53.664143 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:53.664174 (+ 31us) server_negotiation.cc:299] Negotiation successful
0811 08:07:53.664225 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":99,"threads_started":1}
I20260811 08:07:53.665050 4402 tablet_service.cc:1467] Processing CreateTablet for tablet 41862e9dcdfd467f92fc17e0e924944e (DEFAULT_TABLE table=test-table [id=d8755bcba22045789c2d6e0eaa9ede71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:07:53.665009 4252 tablet_service.cc:1467] Processing CreateTablet for tablet 41862e9dcdfd467f92fc17e0e924944e (DEFAULT_TABLE table=test-table [id=d8755bcba22045789c2d6e0eaa9ede71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:07:53.665010 4098 tablet_service.cc:1467] Processing CreateTablet for tablet 41862e9dcdfd467f92fc17e0e924944e (DEFAULT_TABLE table=test-table [id=d8755bcba22045789c2d6e0eaa9ede71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:07:53.665453 4402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 41862e9dcdfd467f92fc17e0e924944e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:07:53.665457 4098 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 41862e9dcdfd467f92fc17e0e924944e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:07:53.665457 4252 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 41862e9dcdfd467f92fc17e0e924944e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:07:53.669126 4498 tablet_bootstrap.cc:492] T 41862e9dcdfd467f92fc17e0e924944e P 3ec4af1c2da04ba48624fd05349fe791: Bootstrap starting.
I20260811 08:07:53.669575 4499 tablet_bootstrap.cc:492] T 41862e9dcdfd467f92fc17e0e924944e P a69c4908f33140aba76bf80aa836ebcd: Bootstrap starting.
I20260811 08:07:53.670133 4498 tablet_bootstrap.cc:654] T 41862e9dcdfd467f92fc17e0e924944e P 3ec4af1c2da04ba48624fd05349fe791: Neither blocks nor log segments found. Creating new log.
I20260811 08:07:53.670464 4499 tablet_bootstrap.cc:654] T 41862e9dcdfd467f92fc17e0e924944e P a69c4908f33140aba76bf80aa836ebcd: Neither blocks nor log segments found. Creating new log.
I20260811 08:07:53.670529 4498 log.cc:824] T 41862e9dcdfd467f92fc17e0e924944e P 3ec4af1c2da04ba48624fd05349fe791: Log is configured to *not* fsync() on all Append() calls
I20260811 08:07:53.670830 4499 log.cc:824] T 41862e9dcdfd467f92fc17e0e924944e P a69c4908f33140aba76bf80aa836ebcd: Log is configured to *not* fsync() on all Append() calls
I20260811 08:07:53.671228 4500 tablet_bootstrap.cc:492] T 41862e9dcdfd467f92fc17e0e924944e P 552d1cec1ca443d480f585386aac954e: Bootstrap starting.
I20260811 08:07:53.671479 4498 tablet_bootstrap.cc:492] T 41862e9dcdfd467f92fc17e0e924944e P 3ec4af1c2da04ba48624fd05349fe791: No bootstrap required, opened a new log
I20260811 08:07:53.671571 4498 ts_tablet_manager.cc:1397] T 41862e9dcdfd467f92fc17e0e924944e P 3ec4af1c2da04ba48624fd05349fe791: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 08:07:53.671645 4499 tablet_bootstrap.cc:492] T 41862e9dcdfd467f92fc17e0e924944e P a69c4908f33140aba76bf80aa836ebcd: No bootstrap required, opened a new log
I20260811 08:07:53.671720 4499 ts_tablet_manager.cc:1397] T 41862e9dcdfd467f92fc17e0e924944e P a69c4908f33140aba76bf80aa836ebcd: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 08:07:53.673843 4498 raft_consensus.cc:348] T 41862e9dcdfd467f92fc17e0e924944e P 3ec4af1c2da04ba48624fd05349fe791 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a69c4908f33140aba76bf80aa836ebcd" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 33109 } } peers { permanent_uuid: "3ec4af1c2da04ba48624fd05349fe791" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 35683 } } peers { permanent_uuid: "552d1cec1ca443d480f585386aac954e" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 32969 } }
I20260811 08:07:53.673846 4499 raft_consensus.cc:348] T 41862e9dcdfd467f92fc17e0e924944e P a69c4908f33140aba76bf80aa836ebcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a69c4908f33140aba76bf80aa836ebcd" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 33109 } } peers { permanent_uuid: "3ec4af1c2da04ba48624fd05349fe791" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 35683 } } peers { permanent_uuid: "552d1cec1ca443d480f585386aac954e" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 32969 } }
I20260811 08:07:53.674027 4499 raft_consensus.cc:374] T 41862e9dcdfd467f92fc17e0e924944e P a69c4908f33140aba76bf80aa836ebcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:07:53.674031 4498 raft_consensus.cc:374] T 41862e9dcdfd467f92fc17e0e924944e P 3ec4af1c2da04ba48624fd05349fe791 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:07:53.674050 4499 raft_consensus.cc:729] T 41862e9dcdfd467f92fc17e0e924944e P a69c4908f33140aba76bf80aa836ebcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a69c4908f33140aba76bf80aa836ebcd, State: Initialized, Role: FOLLOWER
I20260811 08:07:53.674090 4498 raft_consensus.cc:729] T 41862e9dcdfd467f92fc17e0e924944e P 3ec4af1c2da04ba48624fd05349fe791 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ec4af1c2da04ba48624fd05349fe791, State: Initialized, Role: FOLLOWER
I20260811 08:07:53.674228 4498 consensus_queue.cc:260] T 41862e9dcdfd467f92fc17e0e924944e P 3ec4af1c2da04ba48624fd05349fe791 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a69c4908f33140aba76bf80aa836ebcd" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 33109 } } peers { permanent_uuid: "3ec4af1c2da04ba48624fd05349fe791" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 35683 } } peers { permanent_uuid: "552d1cec1ca443d480f585386aac954e" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 32969 } }
I20260811 08:07:53.674247 4499 consensus_queue.cc:260] T 41862e9dcdfd467f92fc17e0e924944e P a69c4908f33140aba76bf80aa836ebcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a69c4908f33140aba76bf80aa836ebcd" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 33109 } } peers { permanent_uuid: "3ec4af1c2da04ba48624fd05349fe791" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 35683 } } peers { permanent_uuid: "552d1cec1ca443d480f585386aac954e" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 32969 } }
I20260811 08:07:53.674582 4499 ts_tablet_manager.cc:1428] T 41862e9dcdfd467f92fc17e0e924944e P a69c4908f33140aba76bf80aa836ebcd: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 08:07:53.674583 4498 ts_tablet_manager.cc:1428] T 41862e9dcdfd467f92fc17e0e924944e P 3ec4af1c2da04ba48624fd05349fe791: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 08:07:53.674614 4481 heartbeater.cc:503] Master 127.15.36.254:32947 was elected leader, sending a full tablet report...
I20260811 08:07:53.675007 4326 heartbeater.cc:503] Master 127.15.36.254:32947 was elected leader, sending a full tablet report...
I20260811 08:07:53.675520 4500 tablet_bootstrap.cc:654] T 41862e9dcdfd467f92fc17e0e924944e P 552d1cec1ca443d480f585386aac954e: Neither blocks nor log segments found. Creating new log.
I20260811 08:07:53.675860 4500 log.cc:824] T 41862e9dcdfd467f92fc17e0e924944e P 552d1cec1ca443d480f585386aac954e: Log is configured to *not* fsync() on all Append() calls
I20260811 08:07:53.676851 4500 tablet_bootstrap.cc:492] T 41862e9dcdfd467f92fc17e0e924944e P 552d1cec1ca443d480f585386aac954e: No bootstrap required, opened a new log
I20260811 08:07:53.676951 4500 ts_tablet_manager.cc:1397] T 41862e9dcdfd467f92fc17e0e924944e P 552d1cec1ca443d480f585386aac954e: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.002s
I20260811 08:07:53.679162 4500 raft_consensus.cc:348] T 41862e9dcdfd467f92fc17e0e924944e P 552d1cec1ca443d480f585386aac954e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a69c4908f33140aba76bf80aa836ebcd" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 33109 } } peers { permanent_uuid: "3ec4af1c2da04ba48624fd05349fe791" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 35683 } } peers { permanent_uuid: "552d1cec1ca443d480f585386aac954e" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 32969 } }
I20260811 08:07:53.679401 4500 raft_consensus.cc:374] T 41862e9dcdfd467f92fc17e0e924944e P 552d1cec1ca443d480f585386aac954e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:07:53.679445 4500 raft_consensus.cc:729] T 41862e9dcdfd467f92fc17e0e924944e P 552d1cec1ca443d480f585386aac954e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 552d1cec1ca443d480f585386aac954e, State: Initialized, Role: FOLLOWER
I20260811 08:07:53.679610 4500 consensus_queue.cc:260] T 41862e9dcdfd467f92fc17e0e924944e P 552d1cec1ca443d480f585386aac954e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a69c4908f33140aba76bf80aa836ebcd" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 33109 } } peers { permanent_uuid: "3ec4af1c2da04ba48624fd05349fe791" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 35683 } } peers { permanent_uuid: "552d1cec1ca443d480f585386aac954e" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 32969 } }
I20260811 08:07:53.679929 4500 ts_tablet_manager.cc:1428] T 41862e9dcdfd467f92fc17e0e924944e P 552d1cec1ca443d480f585386aac954e: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260811 08:07:53.679971 4177 heartbeater.cc:503] Master 127.15.36.254:32947 was elected leader, sending a full tablet report...
W20260811 08:07:53.731246 4327 tablet.cc:2369] T 41862e9dcdfd467f92fc17e0e924944e P a69c4908f33140aba76bf80aa836ebcd: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 08:07:53.842172 4178 tablet.cc:2369] T 41862e9dcdfd467f92fc17e0e924944e P 552d1cec1ca443d480f585386aac954e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 08:07:53.879779 4482 tablet.cc:2369] T 41862e9dcdfd467f92fc17e0e924944e P 3ec4af1c2da04ba48624fd05349fe791: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:07:54.082710 4504 raft_consensus.cc:482] T 41862e9dcdfd467f92fc17e0e924944e P a69c4908f33140aba76bf80aa836ebcd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:07:54.082885 4504 raft_consensus.cc:504] T 41862e9dcdfd467f92fc17e0e924944e P a69c4908f33140aba76bf80aa836ebcd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a69c4908f33140aba76bf80aa836ebcd" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 33109 } } peers { permanent_uuid: "3ec4af1c2da04ba48624fd05349fe791" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 35683 } } peers { permanent_uuid: "552d1cec1ca443d480f585386aac954e" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 32969 } }
I20260811 08:07:54.083402 4504 leader_election.cc:288] T 41862e9dcdfd467f92fc17e0e924944e P a69c4908f33140aba76bf80aa836ebcd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ec4af1c2da04ba48624fd05349fe791 (127.15.36.195:35683), 552d1cec1ca443d480f585386aac954e (127.15.36.193:32969)
I20260811 08:07:54.083892 4506 raft_consensus.cc:482] T 41862e9dcdfd467f92fc17e0e924944e P 552d1cec1ca443d480f585386aac954e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:07:54.084062 4506 raft_consensus.cc:504] T 41862e9dcdfd467f92fc17e0e924944e P 552d1cec1ca443d480f585386aac954e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a69c4908f33140aba76bf80aa836ebcd" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 33109 } } peers { permanent_uuid: "3ec4af1c2da04ba48624fd05349fe791" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 35683 } } peers { permanent_uuid: "552d1cec1ca443d480f585386aac954e" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 32969 } }
I20260811 08:07:54.084743 4506 leader_election.cc:288] T 41862e9dcdfd467f92fc17e0e924944e P 552d1cec1ca443d480f585386aac954e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a69c4908f33140aba76bf80aa836ebcd (127.15.36.194:33109), 3ec4af1c2da04ba48624fd05349fe791 (127.15.36.195:35683)
I20260811 08:07:54.087381 4508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:54.083582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.195:35683 (local address 127.15.36.194:46109)
0811 08:07:54.083727 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:54.083740 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 08:07:54.083849 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:07:54.084033 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:07:54.084034 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:07:54.084036 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:07:54.084112 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:54.084114 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:54.085060 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:54.085061 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:54.086356 (+ 1295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:54.086359 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:54.087105 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:54.087106 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:54.087180 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:54.087184 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:07:54.087231 (+ 47us) client_negotiation.cc:240] Negotiation successful
0811 08:07:54.087289 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":76,"threads_started":1}
I20260811 08:07:54.087721 4494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:54.083701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:33493 (local address 127.15.36.193:32969)
0811 08:07:54.083754 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:54.083756 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:54.083858 (+ 102us) server_negotiation.cc:407] Connection header received
0811 08:07:54.084083 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:54.084084 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:54.084097 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:54.084156 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:07:54.084411 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:54.085297 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:54.086584 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:54.087140 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:54.087208 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:54.087217 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:54.087597 (+ 380us) server_negotiation.cc:299] Negotiation successful
0811 08:07:54.087636 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 08:07:54.087764 4495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:54.083648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:46109 (local address 127.15.36.195:35683)
0811 08:07:54.083700 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:54.083702 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:54.083797 (+ 95us) server_negotiation.cc:407] Connection header received
0811 08:07:54.083927 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:54.083928 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:54.083939 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:54.084016 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:07:54.084201 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:54.084962 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:54.086435 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:54.086983 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:54.087060 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:54.087068 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:54.087634 (+ 566us) server_negotiation.cc:299] Negotiation successful
0811 08:07:54.087686 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 08:07:54.087538 4507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:54.083608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.193:32969 (local address 127.15.36.194:33493)
0811 08:07:54.083769 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:54.083781 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:07:54.083857 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:07:54.084184 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:07:54.084185 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:07:54.084187 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:07:54.084306 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:54.084309 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:54.085399 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:54.085399 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:54.086497 (+ 1098us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:54.086499 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:54.087251 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:54.087252 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:54.087338 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:54.087342 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:07:54.087405 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 08:07:54.087445 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":64,"threads_started":1}
I20260811 08:07:54.088387 4427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41862e9dcdfd467f92fc17e0e924944e" candidate_uuid: "a69c4908f33140aba76bf80aa836ebcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ec4af1c2da04ba48624fd05349fe791" is_pre_election: true
I20260811 08:07:54.088578 4427 raft_consensus.cc:2454] T 41862e9dcdfd467f92fc17e0e924944e P 3ec4af1c2da04ba48624fd05349fe791 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a69c4908f33140aba76bf80aa836ebcd in term 0.
I20260811 08:07:54.088657 4127 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41862e9dcdfd467f92fc17e0e924944e" candidate_uuid: "a69c4908f33140aba76bf80aa836ebcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "552d1cec1ca443d480f585386aac954e" is_pre_election: true
I20260811 08:07:54.088775 4127 raft_consensus.cc:2454] T 41862e9dcdfd467f92fc17e0e924944e P 552d1cec1ca443d480f585386aac954e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a69c4908f33140aba76bf80aa836ebcd in term 0.
I20260811 08:07:54.088837 4512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:54.084699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:41355 (local address 127.15.36.195:35683)
0811 08:07:54.084912 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:54.084914 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:54.085084 (+ 170us) server_negotiation.cc:407] Connection header received
0811 08:07:54.085109 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:54.085110 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:54.085119 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:54.085182 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:07:54.085400 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:54.086168 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:54.087742 (+ 1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:54.088439 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:54.088534 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:54.088543 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:54.088711 (+ 168us) server_negotiation.cc:299] Negotiation successful
0811 08:07:54.088749 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":188,"thread_start_us":107,"threads_started":1}
I20260811 08:07:54.088864 4511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:54.084650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.195:35683 (local address 127.15.36.193:41355)
0811 08:07:54.084956 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:54.084967 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:07:54.085028 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:07:54.085227 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:07:54.085228 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:07:54.085230 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:07:54.085321 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:54.085322 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:54.086266 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:54.086267 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:54.087647 (+ 1380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:54.087650 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:54.088549 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:54.088550 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:54.088625 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:54.088628 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:07:54.088705 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 08:07:54.088748 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":296,"mutex_wait_us":113,"thread_start_us":51,"threads_started":1}
I20260811 08:07:54.088953 4200 leader_election.cc:302] T 41862e9dcdfd467f92fc17e0e924944e P a69c4908f33140aba76bf80aa836ebcd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ec4af1c2da04ba48624fd05349fe791, a69c4908f33140aba76bf80aa836ebcd; no voters:
I20260811 08:07:54.089150 4427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41862e9dcdfd467f92fc17e0e924944e" candidate_uuid: "552d1cec1ca443d480f585386aac954e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ec4af1c2da04ba48624fd05349fe791" is_pre_election: true
I20260811 08:07:54.089146 4504 raft_consensus.cc:2781] T 41862e9dcdfd467f92fc17e0e924944e P a69c4908f33140aba76bf80aa836ebcd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:07:54.089229 4504 raft_consensus.cc:482] T 41862e9dcdfd467f92fc17e0e924944e P a69c4908f33140aba76bf80aa836ebcd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:07:54.089228 4427 raft_consensus.cc:2454] T 41862e9dcdfd467f92fc17e0e924944e P 3ec4af1c2da04ba48624fd05349fe791 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 552d1cec1ca443d480f585386aac954e in term 0.
I20260811 08:07:54.089264 4504 raft_consensus.cc:3037] T 41862e9dcdfd467f92fc17e0e924944e P a69c4908f33140aba76bf80aa836ebcd [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:07:54.089373 4496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:54.084785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:49459 (local address 127.15.36.194:33109)
0811 08:07:54.084824 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:54.084826 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:54.085022 (+ 196us) server_negotiation.cc:407] Connection header received
0811 08:07:54.085115 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:54.085117 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:54.085127 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:54.085158 (+ 31us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:07:54.085404 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:54.086159 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:54.087754 (+ 1595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:54.088325 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:54.088392 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:54.088401 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:54.089260 (+ 859us) server_negotiation.cc:299] Negotiation successful
0811 08:07:54.089307 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":39,"server-negotiator.queue_time_us":21}
I20260811 08:07:54.089612 4509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:54.084644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.194:33109 (local address 127.15.36.193:49459)
0811 08:07:54.084955 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:54.084967 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:07:54.085042 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:07:54.085237 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:07:54.085238 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:07:54.085239 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:07:54.085320 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:54.085322 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:54.086267 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:54.086267 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:54.087640 (+ 1373us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:54.087643 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:54.089090 (+ 1447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:54.089091 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:54.089165 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:54.089169 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:07:54.089485 (+ 316us) client_negotiation.cc:240] Negotiation successful
0811 08:07:54.089539 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":297,"mutex_wait_us":61,"thread_start_us":57,"threads_started":1}
I20260811 08:07:54.089849 4049 leader_election.cc:302] T 41862e9dcdfd467f92fc17e0e924944e P 552d1cec1ca443d480f585386aac954e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ec4af1c2da04ba48624fd05349fe791, 552d1cec1ca443d480f585386aac954e; no voters:
I20260811 08:07:54.090025 4506 raft_consensus.cc:2781] T 41862e9dcdfd467f92fc17e0e924944e P 552d1cec1ca443d480f585386aac954e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:07:54.090087 4506 raft_consensus.cc:482] T 41862e9dcdfd467f92fc17e0e924944e P 552d1cec1ca443d480f585386aac954e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:07:54.090109 4506 raft_consensus.cc:3037] T 41862e9dcdfd467f92fc17e0e924944e P 552d1cec1ca443d480f585386aac954e [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:07:54.090123 4274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41862e9dcdfd467f92fc17e0e924944e" candidate_uuid: "552d1cec1ca443d480f585386aac954e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a69c4908f33140aba76bf80aa836ebcd" is_pre_election: true
I20260811 08:07:54.090345 4504 raft_consensus.cc:504] T 41862e9dcdfd467f92fc17e0e924944e P a69c4908f33140aba76bf80aa836ebcd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a69c4908f33140aba76bf80aa836ebcd" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 33109 } } peers { permanent_uuid: "3ec4af1c2da04ba48624fd05349fe791" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 35683 } } peers { permanent_uuid: "552d1cec1ca443d480f585386aac954e" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 32969 } }
I20260811 08:07:54.090495 4504 leader_election.cc:288] T 41862e9dcdfd467f92fc17e0e924944e P a69c4908f33140aba76bf80aa836ebcd [CANDIDATE]: Term 1 election: Requested vote from peers 3ec4af1c2da04ba48624fd05349fe791 (127.15.36.195:35683), 552d1cec1ca443d480f585386aac954e (127.15.36.193:32969)
I20260811 08:07:54.090703 4274 raft_consensus.cc:2379] T 41862e9dcdfd467f92fc17e0e924944e P a69c4908f33140aba76bf80aa836ebcd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 552d1cec1ca443d480f585386aac954e in current term 1: Already voted for candidate a69c4908f33140aba76bf80aa836ebcd in this term.
I20260811 08:07:54.090703 4427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41862e9dcdfd467f92fc17e0e924944e" candidate_uuid: "a69c4908f33140aba76bf80aa836ebcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ec4af1c2da04ba48624fd05349fe791"
I20260811 08:07:54.090706 4127 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41862e9dcdfd467f92fc17e0e924944e" candidate_uuid: "a69c4908f33140aba76bf80aa836ebcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "552d1cec1ca443d480f585386aac954e"
I20260811 08:07:54.090780 4427 raft_consensus.cc:3037] T 41862e9dcdfd467f92fc17e0e924944e P 3ec4af1c2da04ba48624fd05349fe791 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:07:54.091084 4506 raft_consensus.cc:504] T 41862e9dcdfd467f92fc17e0e924944e P 552d1cec1ca443d480f585386aac954e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a69c4908f33140aba76bf80aa836ebcd" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 33109 } } peers { permanent_uuid: "3ec4af1c2da04ba48624fd05349fe791" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 35683 } } peers { permanent_uuid: "552d1cec1ca443d480f585386aac954e" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 32969 } }
I20260811 08:07:54.091226 4506 leader_election.cc:288] T 41862e9dcdfd467f92fc17e0e924944e P 552d1cec1ca443d480f585386aac954e [CANDIDATE]: Term 1 election: Requested vote from peers a69c4908f33140aba76bf80aa836ebcd (127.15.36.194:33109), 3ec4af1c2da04ba48624fd05349fe791 (127.15.36.195:35683)
I20260811 08:07:54.091231 4127 raft_consensus.cc:2379] T 41862e9dcdfd467f92fc17e0e924944e P 552d1cec1ca443d480f585386aac954e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a69c4908f33140aba76bf80aa836ebcd in current term 1: Already voted for candidate 552d1cec1ca443d480f585386aac954e in this term.
I20260811 08:07:54.091418 4274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41862e9dcdfd467f92fc17e0e924944e" candidate_uuid: "552d1cec1ca443d480f585386aac954e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a69c4908f33140aba76bf80aa836ebcd"
I20260811 08:07:54.091440 4426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41862e9dcdfd467f92fc17e0e924944e" candidate_uuid: "552d1cec1ca443d480f585386aac954e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ec4af1c2da04ba48624fd05349fe791"
I20260811 08:07:54.091493 4274 raft_consensus.cc:2379] T 41862e9dcdfd467f92fc17e0e924944e P a69c4908f33140aba76bf80aa836ebcd [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 552d1cec1ca443d480f585386aac954e in current term 1: Already voted for candidate a69c4908f33140aba76bf80aa836ebcd in this term.
I20260811 08:07:54.091691 4049 leader_election.cc:302] T 41862e9dcdfd467f92fc17e0e924944e P 552d1cec1ca443d480f585386aac954e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 552d1cec1ca443d480f585386aac954e; no voters: 3ec4af1c2da04ba48624fd05349fe791, a69c4908f33140aba76bf80aa836ebcd
I20260811 08:07:54.091797 4506 raft_consensus.cc:2726] T 41862e9dcdfd467f92fc17e0e924944e P 552d1cec1ca443d480f585386aac954e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260811 08:07:54.091930 4427 raft_consensus.cc:2454] T 41862e9dcdfd467f92fc17e0e924944e P 3ec4af1c2da04ba48624fd05349fe791 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a69c4908f33140aba76bf80aa836ebcd in term 1.
I20260811 08:07:54.092127 4200 leader_election.cc:302] T 41862e9dcdfd467f92fc17e0e924944e P a69c4908f33140aba76bf80aa836ebcd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ec4af1c2da04ba48624fd05349fe791, a69c4908f33140aba76bf80aa836ebcd; no voters: 552d1cec1ca443d480f585386aac954e
I20260811 08:07:54.092240 4504 raft_consensus.cc:2781] T 41862e9dcdfd467f92fc17e0e924944e P a69c4908f33140aba76bf80aa836ebcd [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:07:54.092605 4504 raft_consensus.cc:686] T 41862e9dcdfd467f92fc17e0e924944e P a69c4908f33140aba76bf80aa836ebcd [term 1 LEADER]: Becoming Leader. State: Replica: a69c4908f33140aba76bf80aa836ebcd, State: Running, Role: LEADER
I20260811 08:07:54.092746 4504 consensus_queue.cc:237] T 41862e9dcdfd467f92fc17e0e924944e P a69c4908f33140aba76bf80aa836ebcd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a69c4908f33140aba76bf80aa836ebcd" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 33109 } } peers { permanent_uuid: "3ec4af1c2da04ba48624fd05349fe791" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 35683 } } peers { permanent_uuid: "552d1cec1ca443d480f585386aac954e" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 32969 } }
I20260811 08:07:54.093748 3962 catalog_manager.cc:5495] T 41862e9dcdfd467f92fc17e0e924944e P a69c4908f33140aba76bf80aa836ebcd reported cstate change: term changed from 0 to 1, leader changed from <none> to a69c4908f33140aba76bf80aa836ebcd (127.15.36.194). New cstate: current_term: 1 leader_uuid: "a69c4908f33140aba76bf80aa836ebcd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a69c4908f33140aba76bf80aa836ebcd" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 33109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3ec4af1c2da04ba48624fd05349fe791" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 35683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "552d1cec1ca443d480f585386aac954e" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 32969 } health_report { overall_health: UNKNOWN } } }
I20260811 08:07:54.115034 4496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:54.112428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33130 (local address 127.15.36.194:33109)
0811 08:07:54.112507 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:54.112510 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:54.112520 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:07:54.112567 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:54.112568 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:54.112587 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:54.112663 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:07:54.112842 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:54.113364 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:54.114171 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:54.114369 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:54.114451 (+ 82us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:54.114610 (+ 159us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:07:54.114703 (+ 93us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:07:54.114841 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:54.114873 (+ 32us) server_negotiation.cc:299] Negotiation successful
0811 08:07:54.114885 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 08:07:54.117146 4127 raft_consensus.cc:1261] T 41862e9dcdfd467f92fc17e0e924944e P 552d1cec1ca443d480f585386aac954e [term 1 FOLLOWER]: Refusing update from remote peer a69c4908f33140aba76bf80aa836ebcd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:07:54.117146 4427 raft_consensus.cc:1261] T 41862e9dcdfd467f92fc17e0e924944e P 3ec4af1c2da04ba48624fd05349fe791 [term 1 FOLLOWER]: Refusing update from remote peer a69c4908f33140aba76bf80aa836ebcd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:07:54.117513 4513 consensus_queue.cc:1035] T 41862e9dcdfd467f92fc17e0e924944e P a69c4908f33140aba76bf80aa836ebcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ec4af1c2da04ba48624fd05349fe791" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 35683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:07:54.117686 4504 consensus_queue.cc:1035] T 41862e9dcdfd467f92fc17e0e924944e P a69c4908f33140aba76bf80aa836ebcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "552d1cec1ca443d480f585386aac954e" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 32969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:07:54.120814 4517 mvcc.cc:205] Tried to move back new op lower bound from 7317240521180499968 to 7317240521084964864. Current Snapshot: MvccSnapshot[applied={T|T < 7317240521180499968}]
I20260811 08:07:54.121483 4518 mvcc.cc:205] Tried to move back new op lower bound from 7317240521180499968 to 7317240521084964864. Current Snapshot: MvccSnapshot[applied={T|T < 7317240521180499968}]
I20260811 08:07:54.122836 3961 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52580:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:07:54.122979 3961 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52580:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:07:54.123878 3961 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 53b1f4d5d0de4ec4b297eb04dbea4dc2: Sending DeleteTablet for 3 replicas of tablet 41862e9dcdfd467f92fc17e0e924944e
I20260811 08:07:54.124272 4098 tablet_service.cc:1514] Processing DeleteTablet for tablet 41862e9dcdfd467f92fc17e0e924944e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:07:54 UTC) from {username='slave'} at 127.0.0.1:55114
I20260811 08:07:54.124317 4252 tablet_service.cc:1514] Processing DeleteTablet for tablet 41862e9dcdfd467f92fc17e0e924944e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:07:54 UTC) from {username='slave'} at 127.0.0.1:33116
I20260811 08:07:54.124382 4402 tablet_service.cc:1514] Processing DeleteTablet for tablet 41862e9dcdfd467f92fc17e0e924944e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:07:54 UTC) from {username='slave'} at 127.0.0.1:33782
I20260811 08:07:54.124631 4528 tablet_replica.cc:330] T 41862e9dcdfd467f92fc17e0e924944e P 552d1cec1ca443d480f585386aac954e: stopping tablet replica
I20260811 08:07:54.124817 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 4029
I20260811 08:07:54.126125 4529 tablet_replica.cc:330] T 41862e9dcdfd467f92fc17e0e924944e P 3ec4af1c2da04ba48624fd05349fe791: stopping tablet replica
I20260811 08:07:54.126235 4529 raft_consensus.cc:2229] T 41862e9dcdfd467f92fc17e0e924944e P 3ec4af1c2da04ba48624fd05349fe791 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:07:54.126341 4529 raft_consensus.cc:2258] T 41862e9dcdfd467f92fc17e0e924944e P 3ec4af1c2da04ba48624fd05349fe791 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:07:54.126735 4527 tablet_replica.cc:330] T 41862e9dcdfd467f92fc17e0e924944e P a69c4908f33140aba76bf80aa836ebcd: stopping tablet replica
I20260811 08:07:54.126812 4527 raft_consensus.cc:2229] T 41862e9dcdfd467f92fc17e0e924944e P a69c4908f33140aba76bf80aa836ebcd [term 1 LEADER]: Raft consensus shutting down.
I20260811 08:07:54.126894 4527 raft_consensus.cc:2258] T 41862e9dcdfd467f92fc17e0e924944e P a69c4908f33140aba76bf80aa836ebcd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:07:54.127419 4529 ts_tablet_manager.cc:1905] T 41862e9dcdfd467f92fc17e0e924944e P 3ec4af1c2da04ba48624fd05349fe791: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:07:54.129439 4529 ts_tablet_manager.cc:1918] T 41862e9dcdfd467f92fc17e0e924944e P 3ec4af1c2da04ba48624fd05349fe791: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:07:54.129484 4527 ts_tablet_manager.cc:1905] T 41862e9dcdfd467f92fc17e0e924944e P a69c4908f33140aba76bf80aa836ebcd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:07:54.129591 4529 log.cc:1196] T 41862e9dcdfd467f92fc17e0e924944e P 3ec4af1c2da04ba48624fd05349fe791: Deleting WAL directory at /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435400844580-15507-0/minicluster-data/ts-2/wal/wals/41862e9dcdfd467f92fc17e0e924944e
I20260811 08:07:54.129997 4529 ts_tablet_manager.cc:1939] T 41862e9dcdfd467f92fc17e0e924944e P 3ec4af1c2da04ba48624fd05349fe791: Deleting consensus metadata
I20260811 08:07:54.130607 3945 catalog_manager.cc:4841] TS 3ec4af1c2da04ba48624fd05349fe791 (127.15.36.195:35683): tablet 41862e9dcdfd467f92fc17e0e924944e (table test-table [id=d8755bcba22045789c2d6e0eaa9ede71]) successfully deleted
I20260811 08:07:54.131364 4527 ts_tablet_manager.cc:1918] T 41862e9dcdfd467f92fc17e0e924944e P a69c4908f33140aba76bf80aa836ebcd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:07:54.131453 4527 log.cc:1196] T 41862e9dcdfd467f92fc17e0e924944e P a69c4908f33140aba76bf80aa836ebcd: Deleting WAL directory at /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786435400844580-15507-0/minicluster-data/ts-1/wal/wals/41862e9dcdfd467f92fc17e0e924944e
I20260811 08:07:54.131759 4527 ts_tablet_manager.cc:1939] T 41862e9dcdfd467f92fc17e0e924944e P a69c4908f33140aba76bf80aa836ebcd: Deleting consensus metadata
I20260811 08:07:54.132400 3943 catalog_manager.cc:4841] TS a69c4908f33140aba76bf80aa836ebcd (127.15.36.194:33109): tablet 41862e9dcdfd467f92fc17e0e924944e (table test-table [id=d8755bcba22045789c2d6e0eaa9ede71]) successfully deleted
W20260811 08:07:54.133911 3946 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.36.193:32969 (error 108)
W20260811 08:07:54.134665 4491 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:07:54.134487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.193:32969 (local address 127.0.0.1:55116)
0811 08:07:54.134563 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:54.134616 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.193:32969: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":50}
I20260811 08:07:54.134994 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 4180
W20260811 08:07:54.134878 3946 catalog_manager.cc:4584] TS 552d1cec1ca443d480f585386aac954e (127.15.36.193:32969): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 41862e9dcdfd467f92fc17e0e924944e: Network error: Client connection negotiation failed: client connection to 127.15.36.193:32969: connect: Connection reset by peer (error 104)
I20260811 08:07:54.142303 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 4329
I20260811 08:07:54.149745 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 3927
2026-08-11T08:07:54Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (1164 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:07:54 dist-test-slave-2w3w krb5kdc[4535](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:07:54 dist-test-slave-2w3w krb5kdc[4535](info): set up 2 sockets
Aug 11 08:07:54 dist-test-slave-2w3w krb5kdc[4535](info): commencing operation
krb5kdc: starting...
W20260811 08:07:55.288014 15507 mini_kdc.cc:121] Time spent starting KDC: real 1.116s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Aug 11 08:07:55 dist-test-slave-2w3w krb5kdc[4535](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435675, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:07:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:07:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.36.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab.
Entry for principal kudu/127.15.36.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab.
I20260811 08:07:55.427577 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:43721
--webserver_interface=127.15.36.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=kudu/127.15.36.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:37371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.36.254:43721
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:07:55.513288 4549 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:07:55.513546 4549 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:07:55.513586 4549 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:07:55.515092 4549 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:07:55.515172 4549 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:07:55.515197 4549 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:07:55.515231 4549 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:07:55.515259 4549 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:07:55.516940 4549 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:37371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.36.254:43721
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=kudu/127.15.36.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:43721
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.36.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4549
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:07:55.517261 4549 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:07:55.517520 4549 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:07:55.523013 4558 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:07:55.523177 4549 server_base.cc:1034] running on GCE node
W20260811 08:07:55.523166 4555 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:07:55.523013 4556 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:07:55.523645 4549 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:07:55.523978 4549 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:07:55.525277 4549 hybrid_clock.cc:648] HybridClock initialized: now 1786435675525267 us; error 46 us; skew 500 ppm
Aug 11 08:07:55 dist-test-slave-2w3w krb5kdc[4535](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435675, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:07:55.528018 4549 init.cc:377] Logged in from keytab as kudu/127.15.36.254@KRBTEST.COM (short username kudu)
I20260811 08:07:55.528513 4549 webserver.cc:460] Webserver started at http://127.15.36.254:34507/ using document root <none> and password file <none>
I20260811 08:07:55.528769 4549 fs_manager.cc:359] Metadata directory not provided
I20260811 08:07:55.528818 4549 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:07:55.528964 4549 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:07:55.530110 4549 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/minicluster-data/master-0/data/instance:
uuid: "db7edc64645b499ea894599c74cf336d"
format_stamp: "Formatted at 2026-08-11 08:07:55 on dist-test-slave-2w3w"
server_key: "5849774f68ca4f49b08bf617d3e1de88"
server_key_iv: "cfc77c27fdfe7c77804fdfc0e56caaa3"
server_key_version: "encryptionkey@0"
I20260811 08:07:55.530505 4549 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/minicluster-data/master-0/wal/instance:
uuid: "db7edc64645b499ea894599c74cf336d"
format_stamp: "Formatted at 2026-08-11 08:07:55 on dist-test-slave-2w3w"
server_key: "5849774f68ca4f49b08bf617d3e1de88"
server_key_iv: "cfc77c27fdfe7c77804fdfc0e56caaa3"
server_key_version: "encryptionkey@0"
I20260811 08:07:55.532174 4549 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 08:07:55.533165 4565 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:55.533499 4549 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:07:55.533614 4549 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/minicluster-data/master-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/minicluster-data/master-0/wal
uuid: "db7edc64645b499ea894599c74cf336d"
format_stamp: "Formatted at 2026-08-11 08:07:55 on dist-test-slave-2w3w"
server_key: "5849774f68ca4f49b08bf617d3e1de88"
server_key_iv: "cfc77c27fdfe7c77804fdfc0e56caaa3"
server_key_version: "encryptionkey@0"
I20260811 08:07:55.533717 4549 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:07:55.545306 4549 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:07:55.547813 4549 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:07:55.548007 4549 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:07:55.552484 4549 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.254:43721
I20260811 08:07:55.552517 4628 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.254:43721 every 8 connection(s)
I20260811 08:07:55.552917 4549 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
I20260811 08:07:55.553762 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 4549
I20260811 08:07:55.553866 4629 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:07:55.553941 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/minicluster-data/master-0/wal/instance
I20260811 08:07:55.554193 15507 external_mini_cluster.cc:1428] Setting key 72635d6542e065639aa1dc3df9cbf4a2
I20260811 08:07:55.557621 4629 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db7edc64645b499ea894599c74cf336d: Bootstrap starting.
I20260811 08:07:55.558441 4629 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P db7edc64645b499ea894599c74cf336d: Neither blocks nor log segments found. Creating new log.
I20260811 08:07:55.558768 4629 log.cc:824] T 00000000000000000000000000000000 P db7edc64645b499ea894599c74cf336d: Log is configured to *not* fsync() on all Append() calls
I20260811 08:07:55.559707 4629 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db7edc64645b499ea894599c74cf336d: No bootstrap required, opened a new log
Aug 11 08:07:55 dist-test-slave-2w3w krb5kdc[4535](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435675, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:07:55.562587 4629 raft_consensus.cc:348] T 00000000000000000000000000000000 P db7edc64645b499ea894599c74cf336d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db7edc64645b499ea894599c74cf336d" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 43721 } }
I20260811 08:07:55.562884 4629 raft_consensus.cc:374] T 00000000000000000000000000000000 P db7edc64645b499ea894599c74cf336d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:07:55.562932 4629 raft_consensus.cc:729] T 00000000000000000000000000000000 P db7edc64645b499ea894599c74cf336d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db7edc64645b499ea894599c74cf336d, State: Initialized, Role: FOLLOWER
I20260811 08:07:55.563108 4629 consensus_queue.cc:260] T 00000000000000000000000000000000 P db7edc64645b499ea894599c74cf336d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db7edc64645b499ea894599c74cf336d" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 43721 } }
I20260811 08:07:55.563187 4629 raft_consensus.cc:388] T 00000000000000000000000000000000 P db7edc64645b499ea894599c74cf336d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:07:55.563303 4629 raft_consensus.cc:482] T 00000000000000000000000000000000 P db7edc64645b499ea894599c74cf336d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:07:55.563345 4629 raft_consensus.cc:3037] T 00000000000000000000000000000000 P db7edc64645b499ea894599c74cf336d [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:07:55.564028 4629 raft_consensus.cc:504] T 00000000000000000000000000000000 P db7edc64645b499ea894599c74cf336d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db7edc64645b499ea894599c74cf336d" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 43721 } }
I20260811 08:07:55.564123 4629 leader_election.cc:302] T 00000000000000000000000000000000 P db7edc64645b499ea894599c74cf336d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: db7edc64645b499ea894599c74cf336d; no voters:
I20260811 08:07:55.564320 4629 leader_election.cc:288] T 00000000000000000000000000000000 P db7edc64645b499ea894599c74cf336d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:07:55.564355 4634 raft_consensus.cc:2781] T 00000000000000000000000000000000 P db7edc64645b499ea894599c74cf336d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:07:55.564477 4634 raft_consensus.cc:686] T 00000000000000000000000000000000 P db7edc64645b499ea894599c74cf336d [term 1 LEADER]: Becoming Leader. State: Replica: db7edc64645b499ea894599c74cf336d, State: Running, Role: LEADER
I20260811 08:07:55.564633 4629 sys_catalog.cc:564] T 00000000000000000000000000000000 P db7edc64645b499ea894599c74cf336d [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:07:55.564644 4634 consensus_queue.cc:237] T 00000000000000000000000000000000 P db7edc64645b499ea894599c74cf336d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db7edc64645b499ea894599c74cf336d" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 43721 } }
I20260811 08:07:55.565119 4636 sys_catalog.cc:455] T 00000000000000000000000000000000 P db7edc64645b499ea894599c74cf336d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "db7edc64645b499ea894599c74cf336d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db7edc64645b499ea894599c74cf336d" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 43721 } } }
I20260811 08:07:55.565419 4636 sys_catalog.cc:458] T 00000000000000000000000000000000 P db7edc64645b499ea894599c74cf336d [sys.catalog]: This master's current role is: LEADER
I20260811 08:07:55.565320 4635 sys_catalog.cc:455] T 00000000000000000000000000000000 P db7edc64645b499ea894599c74cf336d [sys.catalog]: SysCatalogTable state changed. Reason: New leader db7edc64645b499ea894599c74cf336d. Latest consensus state: current_term: 1 leader_uuid: "db7edc64645b499ea894599c74cf336d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db7edc64645b499ea894599c74cf336d" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 43721 } } }
I20260811 08:07:55.565699 4635 sys_catalog.cc:458] T 00000000000000000000000000000000 P db7edc64645b499ea894599c74cf336d [sys.catalog]: This master's current role is: LEADER
I20260811 08:07:55.566462 4632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:55.554799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37992 (local address 127.15.36.254:43721)
0811 08:07:55.555019 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:55.555027 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:55.555059 (+ 32us) server_negotiation.cc:407] Connection header received
0811 08:07:55.555655 (+ 596us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:55.555663 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:55.555712 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:55.555839 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:07:55.556795 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:55.557712 (+ 917us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:55.558909 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:55.559524 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:55.559614 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:55.562359 (+ 2745us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:07:55.562366 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:07:55.562366 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:07:55.562381 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:07:55.564394 (+ 2013us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:07:55.564807 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:07:55.564811 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:07:55.564811 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:07:55.564925 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:07:55.565171 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:07:55.565172 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:07:55.565172 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:07:55.565500 (+ 328us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:07:55.565641 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:55.565977 (+ 336us) server_negotiation.cc:299] Negotiation successful
0811 08:07:55.566156 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":97,"threads_started":1}
W20260811 08:07:55.566604 4653 catalog_manager.cc:1558] T 00000000000000000000000000000000 P db7edc64645b499ea894599c74cf336d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 08:07:55.566666 4653 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 08:07:55.566723 4644 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:07:55.566869 4644 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:07:55.568549 4644 catalog_manager.cc:1347] Generated new cluster ID: b08007787cb845338fc439d898c1b6cd
I20260811 08:07:55.568604 4644 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:07:55.574453 4644 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:07:55.575150 4644 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:07:55.583215 4644 catalog_manager.cc:5868] T 00000000000000000000000000000000 P db7edc64645b499ea894599c74cf336d: Generated new TSK 0
I20260811 08:07:55.583477 4644 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.36.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab.
Entry for principal kudu/127.15.36.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab.
I20260811 08:07:55.623160 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.193:0
--local_ip_for_outbound_sockets=127.15.36.193
--webserver_interface=127.15.36.193
--webserver_port=0
--tserver_master_addrs=127.15.36.254:43721
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab
--principal=kudu/127.15.36.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:37371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:07:55.710582 4659 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:07:55.710861 4659 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:07:55.710904 4659 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:07:55.712106 4659 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:07:55.712182 4659 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:07:55.712231 4659 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.193
I20260811 08:07:55.713759 4659 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:37371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.193.keytab
--principal=kudu/127.15.36.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.36.193
--webserver_port=0
--tserver_master_addrs=127.15.36.254:43721
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4659
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.193
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:07:55.714046 4659 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:07:55.714304 4659 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:07:55.719866 4666 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:07:55.719856 4665 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:07:55.719854 4668 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:07:55.720335 4659 server_base.cc:1034] running on GCE node
I20260811 08:07:55.720597 4659 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:07:55.720860 4659 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:07:55.722072 4659 hybrid_clock.cc:648] HybridClock initialized: now 1786435675722063 us; error 42 us; skew 500 ppm
Aug 11 08:07:55 dist-test-slave-2w3w krb5kdc[4535](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435675, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:07:55.725164 4659 init.cc:377] Logged in from keytab as kudu/127.15.36.193@KRBTEST.COM (short username kudu)
I20260811 08:07:55.725659 4659 webserver.cc:460] Webserver started at http://127.15.36.193:32917/ using document root <none> and password file <none>
I20260811 08:07:55.725941 4659 fs_manager.cc:359] Metadata directory not provided
I20260811 08:07:55.726109 4659 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:07:55.726282 4659 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:07:55.727500 4659 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/minicluster-data/ts-0/data/instance:
uuid: "c05b0536b8a84ae6b7771596da672734"
format_stamp: "Formatted at 2026-08-11 08:07:55 on dist-test-slave-2w3w"
server_key: "2ef934493c824c304fc17fc5fd9251da"
server_key_iv: "a1a7e23bb8aa060429c90154bd1c6507"
server_key_version: "encryptionkey@0"
I20260811 08:07:55.727885 4659 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/minicluster-data/ts-0/wal/instance:
uuid: "c05b0536b8a84ae6b7771596da672734"
format_stamp: "Formatted at 2026-08-11 08:07:55 on dist-test-slave-2w3w"
server_key: "2ef934493c824c304fc17fc5fd9251da"
server_key_iv: "a1a7e23bb8aa060429c90154bd1c6507"
server_key_version: "encryptionkey@0"
I20260811 08:07:55.729317 4659 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 08:07:55.730222 4675 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:55.730446 4659 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:07:55.730561 4659 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/minicluster-data/ts-0/wal
uuid: "c05b0536b8a84ae6b7771596da672734"
format_stamp: "Formatted at 2026-08-11 08:07:55 on dist-test-slave-2w3w"
server_key: "2ef934493c824c304fc17fc5fd9251da"
server_key_iv: "a1a7e23bb8aa060429c90154bd1c6507"
server_key_version: "encryptionkey@0"
I20260811 08:07:55.730639 4659 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:07:55.759819 4659 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:07:55.762328 4659 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:07:55.762511 4659 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:07:55.762781 4659 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:07:55.763156 4659 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:07:55.763216 4659 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:55.763262 4659 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:07:55.763293 4659 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:55.769559 4659 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.193:41173
I20260811 08:07:55.769615 4801 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.193:41173 every 8 connection(s)
I20260811 08:07:55.770002 4659 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
Aug 11 08:07:55 dist-test-slave-2w3w krb5kdc[4535](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435675, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.193@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:07:55.779861 4632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:55.770797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:58841 (local address 127.15.36.254:43721)
0811 08:07:55.770847 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:55.770849 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:55.771070 (+ 221us) server_negotiation.cc:407] Connection header received
0811 08:07:55.771616 (+ 546us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:55.771617 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:55.771638 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:55.771735 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:07:55.772831 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:55.773389 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:55.774426 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:55.774669 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:55.774749 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:55.777091 (+ 2342us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:07:55.777092 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:07:55.777092 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:07:55.777100 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:07:55.778492 (+ 1392us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:07:55.778883 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:07:55.778884 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:07:55.778884 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:07:55.778944 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:07:55.779231 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:07:55.779231 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:07:55.779232 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:07:55.779351 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:07:55.779406 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:55.779703 (+ 297us) server_negotiation.cc:299] Negotiation successful
0811 08:07:55.779787 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 08:07:55.780035 4804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:55.770739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:43721 (local address 127.15.36.193:58841)
0811 08:07:55.770909 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:55.770954 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 08:07:55.771496 (+ 542us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:07:55.771817 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:07:55.771820 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:07:55.772458 (+ 638us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:07:55.772663 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:55.772668 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:55.773487 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:55.773488 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:55.774303 (+ 815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:55.774305 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:55.774764 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:55.774765 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:55.774871 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:55.775473 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:07:55.775481 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:07:55.776944 (+ 1463us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:07:55.778579 (+ 1635us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:07:55.778587 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:07:55.778589 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:07:55.778812 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:07:55.779071 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:07:55.779071 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:07:55.779072 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:07:55.779173 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:07:55.779434 (+ 261us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:07:55.779441 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:07:55.779571 (+ 130us) client_negotiation.cc:769] Sending connection context
0811 08:07:55.779672 (+ 101us) client_negotiation.cc:240] Negotiation successful
0811 08:07:55.779817 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":105,"threads_started":1}
I20260811 08:07:55.780092 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 4659
I20260811 08:07:55.780201 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/minicluster-data/ts-0/wal/instance
I20260811 08:07:55.780419 15507 external_mini_cluster.cc:1428] Setting key 04d31e6316a8661a65eb55efd7b87bf0
I20260811 08:07:55.780731 4802 heartbeater.cc:347] Connected to a master server at 127.15.36.254:43721
I20260811 08:07:55.780853 4802 heartbeater.cc:464] Registering TS with master...
I20260811 08:07:55.781093 4802 heartbeater.cc:511] Master 127.15.36.254:43721 requested a full tablet report, sending...
I20260811 08:07:55.781706 4586 ts_manager.cc:194] Registered new tserver with Master: c05b0536b8a84ae6b7771596da672734 (127.15.36.193:41173)
I20260811 08:07:55.782608 4586 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.36.193@KRBTEST.COM'} at 127.15.36.193:58841
WARNING: no policy specified for kudu/127.15.36.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab.
Entry for principal kudu/127.15.36.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab.
I20260811 08:07:55.808306 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.194:0
--local_ip_for_outbound_sockets=127.15.36.194
--webserver_interface=127.15.36.194
--webserver_port=0
--tserver_master_addrs=127.15.36.254:43721
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab
--principal=kudu/127.15.36.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:37371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:07:55.893437 4808 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:07:55.893649 4808 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:07:55.893673 4808 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:07:55.894815 4808 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:07:55.894865 4808 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:07:55.894891 4808 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.194
I20260811 08:07:55.896420 4808 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:37371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.194.keytab
--principal=kudu/127.15.36.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.36.194
--webserver_port=0
--tserver_master_addrs=127.15.36.254:43721
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4808
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.194
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:07:55.896625 4808 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:07:55.896806 4808 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:07:55.902350 4813 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:07:55.902331 4814 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:07:55.902381 4816 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:07:55.902527 4808 server_base.cc:1034] running on GCE node
I20260811 08:07:55.902763 4808 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:07:55.903090 4808 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:07:55.904260 4808 hybrid_clock.cc:648] HybridClock initialized: now 1786435675904240 us; error 32 us; skew 500 ppm
Aug 11 08:07:55 dist-test-slave-2w3w krb5kdc[4535](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435675, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:07:55.907047 4808 init.cc:377] Logged in from keytab as kudu/127.15.36.194@KRBTEST.COM (short username kudu)
I20260811 08:07:55.907603 4808 webserver.cc:460] Webserver started at http://127.15.36.194:42399/ using document root <none> and password file <none>
I20260811 08:07:55.907883 4808 fs_manager.cc:359] Metadata directory not provided
I20260811 08:07:55.907960 4808 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:07:55.908105 4808 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:07:55.909191 4808 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/minicluster-data/ts-1/data/instance:
uuid: "0ea86714b8f14ae3b6fca6c538f7a321"
format_stamp: "Formatted at 2026-08-11 08:07:55 on dist-test-slave-2w3w"
server_key: "6abc911c2959cf1fecc991f926909485"
server_key_iv: "75787edd4c1989288e4e9a7efe3838b1"
server_key_version: "encryptionkey@0"
I20260811 08:07:55.909582 4808 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/minicluster-data/ts-1/wal/instance:
uuid: "0ea86714b8f14ae3b6fca6c538f7a321"
format_stamp: "Formatted at 2026-08-11 08:07:55 on dist-test-slave-2w3w"
server_key: "6abc911c2959cf1fecc991f926909485"
server_key_iv: "75787edd4c1989288e4e9a7efe3838b1"
server_key_version: "encryptionkey@0"
I20260811 08:07:55.911073 4808 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 08:07:55.911957 4824 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:55.912170 4808 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:07:55.912281 4808 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/minicluster-data/ts-1/wal
uuid: "0ea86714b8f14ae3b6fca6c538f7a321"
format_stamp: "Formatted at 2026-08-11 08:07:55 on dist-test-slave-2w3w"
server_key: "6abc911c2959cf1fecc991f926909485"
server_key_iv: "75787edd4c1989288e4e9a7efe3838b1"
server_key_version: "encryptionkey@0"
I20260811 08:07:55.912375 4808 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:07:55.924358 4808 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:07:55.926422 4808 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:07:55.926594 4808 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:07:55.926855 4808 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:07:55.927246 4808 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:07:55.927304 4808 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:55.927353 4808 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:07:55.927384 4808 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:55.933724 4808 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.194:39875
I20260811 08:07:55.933784 4952 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.194:39875 every 8 connection(s)
I20260811 08:07:55.934110 4808 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
I20260811 08:07:55.934327 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 4808
I20260811 08:07:55.934468 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/minicluster-data/ts-1/wal/instance
I20260811 08:07:55.934755 15507 external_mini_cluster.cc:1428] Setting key 4096bb360373e535c6e3bbd30cbabeaf
Aug 11 08:07:55 dist-test-slave-2w3w krb5kdc[4535](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435675, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.194@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.15.36.195@KRBTEST.COM; defaulting to no policy
I20260811 08:07:55.945212 4632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:55.935086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:54239 (local address 127.15.36.254:43721)
0811 08:07:55.935133 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:55.935135 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:55.935323 (+ 188us) server_negotiation.cc:407] Connection header received
0811 08:07:55.936047 (+ 724us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:55.936048 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:55.936058 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:55.936112 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:07:55.937516 (+ 1404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:55.938333 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:55.939465 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:55.939666 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:55.939743 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:55.942049 (+ 2306us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:07:55.942051 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:07:55.942052 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:07:55.942061 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:07:55.943802 (+ 1741us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:07:55.944223 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:07:55.944225 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:07:55.944225 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:07:55.944294 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:07:55.944622 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:07:55.944623 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:07:55.944623 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:07:55.944755 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:07:55.944814 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:55.945075 (+ 261us) server_negotiation.cc:299] Negotiation successful
0811 08:07:55.945143 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 08:07:55.945485 4955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:55.934958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:43721 (local address 127.15.36.194:54239)
0811 08:07:55.935190 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:55.935237 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 08:07:55.935940 (+ 703us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:07:55.936205 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:07:55.936209 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:07:55.937097 (+ 888us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:07:55.937394 (+ 297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:55.937402 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:55.938446 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:55.938447 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:55.939361 (+ 914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:55.939364 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:55.939751 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:55.939752 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:55.939924 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:55.940535 (+ 611us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:07:55.940544 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:07:55.941946 (+ 1402us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:07:55.943906 (+ 1960us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:07:55.943913 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:07:55.943916 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:07:55.944140 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:07:55.944437 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:07:55.944438 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:07:55.944438 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:07:55.944544 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:07:55.944819 (+ 275us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:07:55.944824 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:07:55.944953 (+ 129us) client_negotiation.cc:769] Sending connection context
0811 08:07:55.945040 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 08:07:55.945170 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":90,"threads_started":1}
I20260811 08:07:55.946046 4953 heartbeater.cc:347] Connected to a master server at 127.15.36.254:43721
I20260811 08:07:55.946178 4953 heartbeater.cc:464] Registering TS with master...
I20260811 08:07:55.946383 4953 heartbeater.cc:511] Master 127.15.36.254:43721 requested a full tablet report, sending...
I20260811 08:07:55.946903 4586 ts_manager.cc:194] Registered new tserver with Master: 0ea86714b8f14ae3b6fca6c538f7a321 (127.15.36.194:39875)
I20260811 08:07:55.947332 4586 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.36.194@KRBTEST.COM'} at 127.15.36.194:54239
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab.
Entry for principal kudu/127.15.36.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab.
I20260811 08:07:55.966006 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.195:0
--local_ip_for_outbound_sockets=127.15.36.195
--webserver_interface=127.15.36.195
--webserver_port=0
--tserver_master_addrs=127.15.36.254:43721
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab
--principal=kudu/127.15.36.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:37371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:07:56.053591 4959 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:07:56.053828 4959 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:07:56.053853 4959 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:07:56.055104 4959 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:07:56.055154 4959 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:07:56.055183 4959 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.195
I20260811 08:07:56.056715 4959 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:37371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.195.keytab
--principal=kudu/127.15.36.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.36.195
--webserver_port=0
--tserver_master_addrs=127.15.36.254:43721
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4959
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.195
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:07:56.056994 4959 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:07:56.057250 4959 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:07:56.062757 4967 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:07:56.062752 4969 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:07:56.062747 4965 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:07:56.063158 4959 server_base.cc:1034] running on GCE node
I20260811 08:07:56.063375 4959 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:07:56.063642 4959 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:07:56.064807 4959 hybrid_clock.cc:648] HybridClock initialized: now 1786435676064761 us; error 64 us; skew 500 ppm
Aug 11 08:07:56 dist-test-slave-2w3w krb5kdc[4535](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435676, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:07:56.067904 4959 init.cc:377] Logged in from keytab as kudu/127.15.36.195@KRBTEST.COM (short username kudu)
I20260811 08:07:56.068321 4959 webserver.cc:460] Webserver started at http://127.15.36.195:33373/ using document root <none> and password file <none>
I20260811 08:07:56.068567 4959 fs_manager.cc:359] Metadata directory not provided
I20260811 08:07:56.068617 4959 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:07:56.068787 4959 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:07:56.069922 4959 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/minicluster-data/ts-2/data/instance:
uuid: "f09172bcf6f54686b0094d1115d102d4"
format_stamp: "Formatted at 2026-08-11 08:07:56 on dist-test-slave-2w3w"
server_key: "942fa8d5c3ba8bc3d10764e0247b5513"
server_key_iv: "9f028b8cc51ecd910f8a4e26e40c1181"
server_key_version: "encryptionkey@0"
I20260811 08:07:56.070307 4959 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/minicluster-data/ts-2/wal/instance:
uuid: "f09172bcf6f54686b0094d1115d102d4"
format_stamp: "Formatted at 2026-08-11 08:07:56 on dist-test-slave-2w3w"
server_key: "942fa8d5c3ba8bc3d10764e0247b5513"
server_key_iv: "9f028b8cc51ecd910f8a4e26e40c1181"
server_key_version: "encryptionkey@0"
I20260811 08:07:56.072170 4959 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20260811 08:07:56.073153 4977 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:56.073370 4959 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:07:56.073501 4959 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/minicluster-data/ts-2/wal
uuid: "f09172bcf6f54686b0094d1115d102d4"
format_stamp: "Formatted at 2026-08-11 08:07:56 on dist-test-slave-2w3w"
server_key: "942fa8d5c3ba8bc3d10764e0247b5513"
server_key_iv: "9f028b8cc51ecd910f8a4e26e40c1181"
server_key_version: "encryptionkey@0"
I20260811 08:07:56.073582 4959 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:07:56.095198 4959 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:07:56.097831 4959 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:07:56.098016 4959 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:07:56.098325 4959 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:07:56.098691 4959 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:07:56.098748 4959 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:56.098794 4959 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:07:56.098820 4959 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:56.105232 4959 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.195:45509
I20260811 08:07:56.105278 5108 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.195:45509 every 8 connection(s)
I20260811 08:07:56.105628 4959 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
Aug 11 08:07:56 dist-test-slave-2w3w krb5kdc[4535](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435676, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.195@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:07:56.112599 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 4959
I20260811 08:07:56.112707 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/minicluster-data/ts-2/wal/instance
I20260811 08:07:56.112972 15507 external_mini_cluster.cc:1428] Setting key be0582ffe990a1e9fb2d4eca0e517f39
I20260811 08:07:56.116885 4632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:56.106386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:39951 (local address 127.15.36.254:43721)
0811 08:07:56.106460 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:56.106462 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:56.106676 (+ 214us) server_negotiation.cc:407] Connection header received
0811 08:07:56.107355 (+ 679us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:56.107357 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:56.107369 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:56.107433 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:07:56.108475 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:56.109003 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:56.110082 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:56.110278 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:56.110354 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:56.113177 (+ 2823us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:07:56.113179 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:07:56.113179 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:07:56.113190 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:07:56.115301 (+ 2111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:07:56.115784 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:07:56.115785 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:07:56.115786 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:07:56.115857 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:07:56.116140 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:07:56.116141 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:07:56.116141 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:07:56.116276 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:07:56.116387 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:56.116688 (+ 301us) server_negotiation.cc:299] Negotiation successful
0811 08:07:56.116783 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 08:07:56.117123 5111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:56.106339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:43721 (local address 127.15.36.195:39951)
0811 08:07:56.106538 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:56.106579 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 08:07:56.107213 (+ 634us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:07:56.107508 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:07:56.107511 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:07:56.108159 (+ 648us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:07:56.108367 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:56.108372 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:56.109116 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:56.109117 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:56.109970 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:56.109972 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:56.110378 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:56.110379 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:56.110489 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:56.111259 (+ 770us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:07:56.111268 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:07:56.113032 (+ 1764us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:07:56.115405 (+ 2373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:07:56.115416 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:07:56.115419 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:07:56.115684 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:07:56.115935 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:07:56.115935 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:07:56.115935 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:07:56.116060 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:07:56.116371 (+ 311us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:07:56.116379 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:07:56.116544 (+ 165us) client_negotiation.cc:769] Sending connection context
0811 08:07:56.116666 (+ 122us) client_negotiation.cc:240] Negotiation successful
0811 08:07:56.116852 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":98,"threads_started":1}
I20260811 08:07:56.117638 5109 heartbeater.cc:347] Connected to a master server at 127.15.36.254:43721
I20260811 08:07:56.117753 5109 heartbeater.cc:464] Registering TS with master...
I20260811 08:07:56.117987 5109 heartbeater.cc:511] Master 127.15.36.254:43721 requested a full tablet report, sending...
I20260811 08:07:56.118415 4586 ts_manager.cc:194] Registered new tserver with Master: f09172bcf6f54686b0094d1115d102d4 (127.15.36.195:45509)
I20260811 08:07:56.118800 4586 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.36.195@KRBTEST.COM'} at 127.15.36.195:39951
I20260811 08:07:56.125463 15507 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 08:07:56.133342 4632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:56.126910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38004 (local address 127.15.36.254:43721)
0811 08:07:56.127007 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:56.127010 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:56.127132 (+ 122us) server_negotiation.cc:407] Connection header received
0811 08:07:56.127175 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:56.127176 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:56.127184 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:56.127236 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:07:56.127819 (+ 583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:56.128318 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:56.129226 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:56.129415 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:56.129471 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:56.130698 (+ 1227us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:07:56.130700 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:07:56.130700 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:07:56.130707 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:07:56.132196 (+ 1489us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:07:56.132539 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:07:56.132540 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:07:56.132540 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:07:56.132595 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:07:56.132774 (+ 179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:07:56.132774 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:07:56.132775 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:07:56.132958 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:07:56.133077 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:56.133207 (+ 130us) server_negotiation.cc:299] Negotiation successful
0811 08:07:56.133272 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 08:07:56.135228 4586 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38004:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:07:56.136940 4586 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:07:56.143587 5122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:56.139559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45368 (local address 127.15.36.193:41173)
0811 08:07:56.139822 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:56.139827 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:56.139842 (+ 15us) server_negotiation.cc:407] Connection header received
0811 08:07:56.139889 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:56.139891 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:56.139910 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:56.139997 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:07:56.140202 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:56.141112 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:56.142345 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:56.143137 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:56.143178 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:56.143224 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:56.143447 (+ 223us) server_negotiation.cc:299] Negotiation successful
0811 08:07:56.143487 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":230,"thread_start_us":135,"threads_started":1}
I20260811 08:07:56.143571 5121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:56.139449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.193:41173 (local address 127.0.0.1:45368)
0811 08:07:56.139650 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:56.139695 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 08:07:56.139784 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:07:56.140002 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:07:56.140006 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:07:56.140008 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:07:56.140093 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:56.140095 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:56.141213 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:56.141214 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:56.142239 (+ 1025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:56.142242 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:56.143272 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:56.143273 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:56.143330 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:56.143340 (+ 10us) client_negotiation.cc:769] Sending connection context
0811 08:07:56.143425 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 08:07:56.143488 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":139,"threads_started":1}
I20260811 08:07:56.144189 5120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:56.139451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.194:39875 (local address 127.0.0.1:41168)
0811 08:07:56.139860 (+ 409us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:56.139881 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 08:07:56.139937 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:07:56.140327 (+ 390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:07:56.140328 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:07:56.140330 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:07:56.140407 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:56.140410 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:56.141830 (+ 1420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:56.141831 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:56.143008 (+ 1177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:56.143012 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:56.143922 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:56.143923 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:56.143986 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:56.143990 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:07:56.144043 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 08:07:56.144081 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":393,"mutex_wait_us":31,"thread_start_us":76,"threads_started":1}
I20260811 08:07:56.144182 5123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:56.139657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41168 (local address 127.15.36.194:39875)
0811 08:07:56.140149 (+ 492us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:56.140153 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:56.140165 (+ 12us) server_negotiation.cc:407] Connection header received
0811 08:07:56.140204 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:56.140206 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:56.140223 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:56.140492 (+ 269us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:07:56.140575 (+ 83us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:56.141690 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:56.143089 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:56.143826 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:56.143911 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:56.143967 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:56.144053 (+ 86us) server_negotiation.cc:299] Negotiation successful
0811 08:07:56.144093 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":447,"thread_start_us":104,"threads_started":1}
I20260811 08:07:56.144644 5125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:56.139965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45058 (local address 127.15.36.195:45509)
0811 08:07:56.140176 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:56.140385 (+ 209us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:56.140396 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:07:56.140440 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:56.140442 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:56.140459 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:56.140532 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:07:56.140669 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:56.141744 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:56.142904 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:56.143671 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:56.143746 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:56.143798 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:56.144393 (+ 595us) server_negotiation.cc:299] Negotiation successful
0811 08:07:56.144443 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":98,"threads_started":1}
I20260811 08:07:56.144098 5124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:56.139707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.195:45509 (local address 127.0.0.1:45058)
0811 08:07:56.140233 (+ 526us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:56.140245 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:07:56.140296 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:07:56.140547 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:07:56.140548 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:07:56.140550 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:07:56.140598 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:56.140599 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:56.141852 (+ 1253us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:56.141853 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:56.142793 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:56.142796 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:56.143838 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:56.143840 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:56.143910 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:56.143915 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 08:07:56.143968 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 08:07:56.144020 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":503,"mutex_wait_us":3,"thread_start_us":112,"threads_started":1}
I20260811 08:07:56.144887 4727 tablet_service.cc:1467] Processing CreateTablet for tablet 2c50c6cd78964322a61e36c487b29192 (DEFAULT_TABLE table=test-table [id=3d88c24721a54a0e8362459118a68a38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:07:56.144902 4878 tablet_service.cc:1467] Processing CreateTablet for tablet 2c50c6cd78964322a61e36c487b29192 (DEFAULT_TABLE table=test-table [id=3d88c24721a54a0e8362459118a68a38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:07:56.145287 4727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c50c6cd78964322a61e36c487b29192. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:07:56.145299 4878 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c50c6cd78964322a61e36c487b29192. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:07:56.147475 5033 tablet_service.cc:1467] Processing CreateTablet for tablet 2c50c6cd78964322a61e36c487b29192 (DEFAULT_TABLE table=test-table [id=3d88c24721a54a0e8362459118a68a38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:07:56.147861 5033 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c50c6cd78964322a61e36c487b29192. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:07:56.148113 5126 tablet_bootstrap.cc:492] T 2c50c6cd78964322a61e36c487b29192 P 0ea86714b8f14ae3b6fca6c538f7a321: Bootstrap starting.
I20260811 08:07:56.148501 5128 tablet_bootstrap.cc:492] T 2c50c6cd78964322a61e36c487b29192 P c05b0536b8a84ae6b7771596da672734: Bootstrap starting.
I20260811 08:07:56.148890 5126 tablet_bootstrap.cc:654] T 2c50c6cd78964322a61e36c487b29192 P 0ea86714b8f14ae3b6fca6c538f7a321: Neither blocks nor log segments found. Creating new log.
I20260811 08:07:56.149168 5128 tablet_bootstrap.cc:654] T 2c50c6cd78964322a61e36c487b29192 P c05b0536b8a84ae6b7771596da672734: Neither blocks nor log segments found. Creating new log.
I20260811 08:07:56.149564 5126 log.cc:824] T 2c50c6cd78964322a61e36c487b29192 P 0ea86714b8f14ae3b6fca6c538f7a321: Log is configured to *not* fsync() on all Append() calls
I20260811 08:07:56.149792 5128 log.cc:824] T 2c50c6cd78964322a61e36c487b29192 P c05b0536b8a84ae6b7771596da672734: Log is configured to *not* fsync() on all Append() calls
I20260811 08:07:56.150422 5126 tablet_bootstrap.cc:492] T 2c50c6cd78964322a61e36c487b29192 P 0ea86714b8f14ae3b6fca6c538f7a321: No bootstrap required, opened a new log
I20260811 08:07:56.150502 5126 ts_tablet_manager.cc:1397] T 2c50c6cd78964322a61e36c487b29192 P 0ea86714b8f14ae3b6fca6c538f7a321: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 08:07:56.150592 5128 tablet_bootstrap.cc:492] T 2c50c6cd78964322a61e36c487b29192 P c05b0536b8a84ae6b7771596da672734: No bootstrap required, opened a new log
I20260811 08:07:56.150665 5128 ts_tablet_manager.cc:1397] T 2c50c6cd78964322a61e36c487b29192 P c05b0536b8a84ae6b7771596da672734: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 08:07:56.151177 5131 tablet_bootstrap.cc:492] T 2c50c6cd78964322a61e36c487b29192 P f09172bcf6f54686b0094d1115d102d4: Bootstrap starting.
I20260811 08:07:56.151901 5131 tablet_bootstrap.cc:654] T 2c50c6cd78964322a61e36c487b29192 P f09172bcf6f54686b0094d1115d102d4: Neither blocks nor log segments found. Creating new log.
I20260811 08:07:56.152480 5131 log.cc:824] T 2c50c6cd78964322a61e36c487b29192 P f09172bcf6f54686b0094d1115d102d4: Log is configured to *not* fsync() on all Append() calls
I20260811 08:07:56.152525 5126 raft_consensus.cc:348] T 2c50c6cd78964322a61e36c487b29192 P 0ea86714b8f14ae3b6fca6c538f7a321 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c05b0536b8a84ae6b7771596da672734" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 41173 } } peers { permanent_uuid: "f09172bcf6f54686b0094d1115d102d4" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 45509 } } peers { permanent_uuid: "0ea86714b8f14ae3b6fca6c538f7a321" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39875 } }
I20260811 08:07:56.152767 5126 raft_consensus.cc:374] T 2c50c6cd78964322a61e36c487b29192 P 0ea86714b8f14ae3b6fca6c538f7a321 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:07:56.152849 5126 raft_consensus.cc:729] T 2c50c6cd78964322a61e36c487b29192 P 0ea86714b8f14ae3b6fca6c538f7a321 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ea86714b8f14ae3b6fca6c538f7a321, State: Initialized, Role: FOLLOWER
I20260811 08:07:56.153013 5126 consensus_queue.cc:260] T 2c50c6cd78964322a61e36c487b29192 P 0ea86714b8f14ae3b6fca6c538f7a321 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c05b0536b8a84ae6b7771596da672734" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 41173 } } peers { permanent_uuid: "f09172bcf6f54686b0094d1115d102d4" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 45509 } } peers { permanent_uuid: "0ea86714b8f14ae3b6fca6c538f7a321" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39875 } }
I20260811 08:07:56.152949 5128 raft_consensus.cc:348] T 2c50c6cd78964322a61e36c487b29192 P c05b0536b8a84ae6b7771596da672734 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c05b0536b8a84ae6b7771596da672734" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 41173 } } peers { permanent_uuid: "f09172bcf6f54686b0094d1115d102d4" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 45509 } } peers { permanent_uuid: "0ea86714b8f14ae3b6fca6c538f7a321" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39875 } }
I20260811 08:07:56.153138 5128 raft_consensus.cc:374] T 2c50c6cd78964322a61e36c487b29192 P c05b0536b8a84ae6b7771596da672734 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:07:56.153208 5128 raft_consensus.cc:729] T 2c50c6cd78964322a61e36c487b29192 P c05b0536b8a84ae6b7771596da672734 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c05b0536b8a84ae6b7771596da672734, State: Initialized, Role: FOLLOWER
I20260811 08:07:56.153285 5131 tablet_bootstrap.cc:492] T 2c50c6cd78964322a61e36c487b29192 P f09172bcf6f54686b0094d1115d102d4: No bootstrap required, opened a new log
I20260811 08:07:56.153330 5126 ts_tablet_manager.cc:1428] T 2c50c6cd78964322a61e36c487b29192 P 0ea86714b8f14ae3b6fca6c538f7a321: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 08:07:56.153326 5128 consensus_queue.cc:260] T 2c50c6cd78964322a61e36c487b29192 P c05b0536b8a84ae6b7771596da672734 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c05b0536b8a84ae6b7771596da672734" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 41173 } } peers { permanent_uuid: "f09172bcf6f54686b0094d1115d102d4" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 45509 } } peers { permanent_uuid: "0ea86714b8f14ae3b6fca6c538f7a321" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39875 } }
I20260811 08:07:56.153404 5131 ts_tablet_manager.cc:1397] T 2c50c6cd78964322a61e36c487b29192 P f09172bcf6f54686b0094d1115d102d4: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 08:07:56.153482 4953 heartbeater.cc:503] Master 127.15.36.254:43721 was elected leader, sending a full tablet report...
I20260811 08:07:56.153640 5128 ts_tablet_manager.cc:1428] T 2c50c6cd78964322a61e36c487b29192 P c05b0536b8a84ae6b7771596da672734: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 08:07:56.153771 4802 heartbeater.cc:503] Master 127.15.36.254:43721 was elected leader, sending a full tablet report...
I20260811 08:07:56.155413 5131 raft_consensus.cc:348] T 2c50c6cd78964322a61e36c487b29192 P f09172bcf6f54686b0094d1115d102d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c05b0536b8a84ae6b7771596da672734" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 41173 } } peers { permanent_uuid: "f09172bcf6f54686b0094d1115d102d4" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 45509 } } peers { permanent_uuid: "0ea86714b8f14ae3b6fca6c538f7a321" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39875 } }
I20260811 08:07:56.155548 5131 raft_consensus.cc:374] T 2c50c6cd78964322a61e36c487b29192 P f09172bcf6f54686b0094d1115d102d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:07:56.155570 5131 raft_consensus.cc:729] T 2c50c6cd78964322a61e36c487b29192 P f09172bcf6f54686b0094d1115d102d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f09172bcf6f54686b0094d1115d102d4, State: Initialized, Role: FOLLOWER
I20260811 08:07:56.155676 5131 consensus_queue.cc:260] T 2c50c6cd78964322a61e36c487b29192 P f09172bcf6f54686b0094d1115d102d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c05b0536b8a84ae6b7771596da672734" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 41173 } } peers { permanent_uuid: "f09172bcf6f54686b0094d1115d102d4" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 45509 } } peers { permanent_uuid: "0ea86714b8f14ae3b6fca6c538f7a321" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39875 } }
I20260811 08:07:56.155947 5131 ts_tablet_manager.cc:1428] T 2c50c6cd78964322a61e36c487b29192 P f09172bcf6f54686b0094d1115d102d4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 08:07:56.156026 5109 heartbeater.cc:503] Master 127.15.36.254:43721 was elected leader, sending a full tablet report...
I20260811 08:07:56.157984 5137 raft_consensus.cc:482] T 2c50c6cd78964322a61e36c487b29192 P f09172bcf6f54686b0094d1115d102d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:07:56.158057 5137 raft_consensus.cc:504] T 2c50c6cd78964322a61e36c487b29192 P f09172bcf6f54686b0094d1115d102d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c05b0536b8a84ae6b7771596da672734" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 41173 } } peers { permanent_uuid: "f09172bcf6f54686b0094d1115d102d4" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 45509 } } peers { permanent_uuid: "0ea86714b8f14ae3b6fca6c538f7a321" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39875 } }
I20260811 08:07:56.158452 5137 leader_election.cc:288] T 2c50c6cd78964322a61e36c487b29192 P f09172bcf6f54686b0094d1115d102d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c05b0536b8a84ae6b7771596da672734 (127.15.36.193:41173), 0ea86714b8f14ae3b6fca6c538f7a321 (127.15.36.194:39875)
I20260811 08:07:56.161446 5123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:56.158691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:48511 (local address 127.15.36.194:39875)
0811 08:07:56.158794 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:56.158796 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:56.158909 (+ 113us) server_negotiation.cc:407] Connection header received
0811 08:07:56.158936 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:56.158937 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:56.158949 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:56.159019 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:07:56.159245 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:56.159729 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:56.160680 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:56.161069 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:56.161157 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:56.161184 (+ 27us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:56.161327 (+ 143us) server_negotiation.cc:299] Negotiation successful
0811 08:07:56.161376 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260811 08:07:56.161445 5122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:56.158686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:44635 (local address 127.15.36.193:41173)
0811 08:07:56.158729 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:56.158731 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:56.158740 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:07:56.158830 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:56.158831 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:56.158900 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:56.159007 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:07:56.159185 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:56.159724 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:56.160677 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:56.161081 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:56.161168 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:56.161177 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:56.161329 (+ 152us) server_negotiation.cc:299] Negotiation successful
0811 08:07:56.161370 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 08:07:56.161453 5111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:56.158580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.193:41173 (local address 127.15.36.195:44635)
0811 08:07:56.158675 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:56.158687 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:07:56.158732 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:07:56.159042 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:07:56.159043 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:07:56.159045 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:07:56.159120 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:56.159122 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:56.159814 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:56.159816 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:56.160581 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:56.160583 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:56.161164 (+ 581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:56.161165 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:56.161248 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:56.161253 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 08:07:56.161325 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 08:07:56.161377 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":74}
I20260811 08:07:56.161459 5138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:56.158651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.194:39875 (local address 127.15.36.195:48511)
0811 08:07:56.158793 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:56.158804 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:07:56.158869 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:07:56.159067 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:07:56.159068 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:07:56.159070 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:07:56.159151 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:56.159153 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:56.159819 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:56.159820 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:56.160583 (+ 763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:56.160585 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:56.161154 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:56.161155 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:56.161235 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:56.161243 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 08:07:56.161309 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 08:07:56.161355 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":97,"threads_started":1}
I20260811 08:07:56.161804 4748 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c50c6cd78964322a61e36c487b29192" candidate_uuid: "f09172bcf6f54686b0094d1115d102d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c05b0536b8a84ae6b7771596da672734" is_pre_election: true
I20260811 08:07:56.162003 4748 raft_consensus.cc:2454] T 2c50c6cd78964322a61e36c487b29192 P c05b0536b8a84ae6b7771596da672734 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f09172bcf6f54686b0094d1115d102d4 in term 0.
I20260811 08:07:56.161983 4900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c50c6cd78964322a61e36c487b29192" candidate_uuid: "f09172bcf6f54686b0094d1115d102d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ea86714b8f14ae3b6fca6c538f7a321" is_pre_election: true
I20260811 08:07:56.162108 4900 raft_consensus.cc:2454] T 2c50c6cd78964322a61e36c487b29192 P 0ea86714b8f14ae3b6fca6c538f7a321 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f09172bcf6f54686b0094d1115d102d4 in term 0.
I20260811 08:07:56.162263 4980 leader_election.cc:302] T 2c50c6cd78964322a61e36c487b29192 P f09172bcf6f54686b0094d1115d102d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c05b0536b8a84ae6b7771596da672734, f09172bcf6f54686b0094d1115d102d4; no voters:
I20260811 08:07:56.162415 5137 raft_consensus.cc:2781] T 2c50c6cd78964322a61e36c487b29192 P f09172bcf6f54686b0094d1115d102d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:07:56.162536 5137 raft_consensus.cc:482] T 2c50c6cd78964322a61e36c487b29192 P f09172bcf6f54686b0094d1115d102d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:07:56.162571 5137 raft_consensus.cc:3037] T 2c50c6cd78964322a61e36c487b29192 P f09172bcf6f54686b0094d1115d102d4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:07:56.163390 5137 raft_consensus.cc:504] T 2c50c6cd78964322a61e36c487b29192 P f09172bcf6f54686b0094d1115d102d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c05b0536b8a84ae6b7771596da672734" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 41173 } } peers { permanent_uuid: "f09172bcf6f54686b0094d1115d102d4" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 45509 } } peers { permanent_uuid: "0ea86714b8f14ae3b6fca6c538f7a321" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39875 } }
I20260811 08:07:56.163571 5137 leader_election.cc:288] T 2c50c6cd78964322a61e36c487b29192 P f09172bcf6f54686b0094d1115d102d4 [CANDIDATE]: Term 1 election: Requested vote from peers c05b0536b8a84ae6b7771596da672734 (127.15.36.193:41173), 0ea86714b8f14ae3b6fca6c538f7a321 (127.15.36.194:39875)
I20260811 08:07:56.163759 4748 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c50c6cd78964322a61e36c487b29192" candidate_uuid: "f09172bcf6f54686b0094d1115d102d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c05b0536b8a84ae6b7771596da672734"
I20260811 08:07:56.163829 4748 raft_consensus.cc:3037] T 2c50c6cd78964322a61e36c487b29192 P c05b0536b8a84ae6b7771596da672734 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:07:56.163761 4900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c50c6cd78964322a61e36c487b29192" candidate_uuid: "f09172bcf6f54686b0094d1115d102d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ea86714b8f14ae3b6fca6c538f7a321"
I20260811 08:07:56.163937 4900 raft_consensus.cc:3037] T 2c50c6cd78964322a61e36c487b29192 P 0ea86714b8f14ae3b6fca6c538f7a321 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:07:56.164857 4748 raft_consensus.cc:2454] T 2c50c6cd78964322a61e36c487b29192 P c05b0536b8a84ae6b7771596da672734 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f09172bcf6f54686b0094d1115d102d4 in term 1.
I20260811 08:07:56.165027 4980 leader_election.cc:302] T 2c50c6cd78964322a61e36c487b29192 P f09172bcf6f54686b0094d1115d102d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c05b0536b8a84ae6b7771596da672734, f09172bcf6f54686b0094d1115d102d4; no voters:
I20260811 08:07:56.165066 4900 raft_consensus.cc:2454] T 2c50c6cd78964322a61e36c487b29192 P 0ea86714b8f14ae3b6fca6c538f7a321 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f09172bcf6f54686b0094d1115d102d4 in term 1.
I20260811 08:07:56.165181 5137 raft_consensus.cc:2781] T 2c50c6cd78964322a61e36c487b29192 P f09172bcf6f54686b0094d1115d102d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:07:56.165397 5137 raft_consensus.cc:686] T 2c50c6cd78964322a61e36c487b29192 P f09172bcf6f54686b0094d1115d102d4 [term 1 LEADER]: Becoming Leader. State: Replica: f09172bcf6f54686b0094d1115d102d4, State: Running, Role: LEADER
I20260811 08:07:56.165511 5137 consensus_queue.cc:237] T 2c50c6cd78964322a61e36c487b29192 P f09172bcf6f54686b0094d1115d102d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c05b0536b8a84ae6b7771596da672734" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 41173 } } peers { permanent_uuid: "f09172bcf6f54686b0094d1115d102d4" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 45509 } } peers { permanent_uuid: "0ea86714b8f14ae3b6fca6c538f7a321" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39875 } }
I20260811 08:07:56.166438 4585 catalog_manager.cc:5495] T 2c50c6cd78964322a61e36c487b29192 P f09172bcf6f54686b0094d1115d102d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f09172bcf6f54686b0094d1115d102d4 (127.15.36.195). New cstate: current_term: 1 leader_uuid: "f09172bcf6f54686b0094d1115d102d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c05b0536b8a84ae6b7771596da672734" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 41173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f09172bcf6f54686b0094d1115d102d4" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 45509 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ea86714b8f14ae3b6fca6c538f7a321" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39875 } health_report { overall_health: UNKNOWN } } }
I20260811 08:07:56.175648 5125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:56.173324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45060 (local address 127.15.36.195:45509)
0811 08:07:56.173389 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:56.173391 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:56.173400 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:07:56.173434 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:56.173435 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:56.173452 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:56.173513 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:07:56.173642 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:56.174109 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:56.174832 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:56.175112 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:56.175169 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:56.175308 (+ 139us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:07:56.175413 (+ 105us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:07:56.175476 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:56.175508 (+ 32us) server_negotiation.cc:299] Negotiation successful
0811 08:07:56.175526 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 08:07:56.177549 4900 raft_consensus.cc:1261] T 2c50c6cd78964322a61e36c487b29192 P 0ea86714b8f14ae3b6fca6c538f7a321 [term 1 FOLLOWER]: Refusing update from remote peer f09172bcf6f54686b0094d1115d102d4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:07:56.177618 4748 raft_consensus.cc:1261] T 2c50c6cd78964322a61e36c487b29192 P c05b0536b8a84ae6b7771596da672734 [term 1 FOLLOWER]: Refusing update from remote peer f09172bcf6f54686b0094d1115d102d4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:07:56.177925 5139 consensus_queue.cc:1035] T 2c50c6cd78964322a61e36c487b29192 P f09172bcf6f54686b0094d1115d102d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ea86714b8f14ae3b6fca6c538f7a321" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 39875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:07:56.178066 5137 consensus_queue.cc:1035] T 2c50c6cd78964322a61e36c487b29192 P f09172bcf6f54686b0094d1115d102d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05b0536b8a84ae6b7771596da672734" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 41173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:07:56.180378 5142 mvcc.cc:205] Tried to move back new op lower bound from 7317240529620082688 to 7317240529574875136. Current Snapshot: MvccSnapshot[applied={T|T < 7317240529620082688}]
I20260811 08:07:56.181421 5145 mvcc.cc:205] Tried to move back new op lower bound from 7317240529620082688 to 7317240529574875136. Current Snapshot: MvccSnapshot[applied={T|T < 7317240529620082688 or (T in {7317240529620082688})}]
I20260811 08:07:56.183490 4585 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38004:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:07:56.183593 4585 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38004:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:07:56.184455 4585 catalog_manager.cc:5782] T 00000000000000000000000000000000 P db7edc64645b499ea894599c74cf336d: Sending DeleteTablet for 3 replicas of tablet 2c50c6cd78964322a61e36c487b29192
I20260811 08:07:56.184825 4878 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c50c6cd78964322a61e36c487b29192 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:07:56 UTC) from {username='kudu', principal='kudu/127.15.36.254@KRBTEST.COM'} at 127.0.0.1:41168
I20260811 08:07:56.185068 5153 tablet_replica.cc:330] T 2c50c6cd78964322a61e36c487b29192 P 0ea86714b8f14ae3b6fca6c538f7a321: stopping tablet replica
I20260811 08:07:56.185194 5153 raft_consensus.cc:2229] T 2c50c6cd78964322a61e36c487b29192 P 0ea86714b8f14ae3b6fca6c538f7a321 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:07:56.185192 5033 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c50c6cd78964322a61e36c487b29192 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:07:56 UTC) from {username='kudu', principal='kudu/127.15.36.254@KRBTEST.COM'} at 127.0.0.1:45058
I20260811 08:07:56.185319 5153 raft_consensus.cc:2258] T 2c50c6cd78964322a61e36c487b29192 P 0ea86714b8f14ae3b6fca6c538f7a321 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:07:56.185410 5155 tablet_replica.cc:330] T 2c50c6cd78964322a61e36c487b29192 P f09172bcf6f54686b0094d1115d102d4: stopping tablet replica
I20260811 08:07:56.185503 4727 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c50c6cd78964322a61e36c487b29192 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:07:56 UTC) from {username='kudu', principal='kudu/127.15.36.254@KRBTEST.COM'} at 127.0.0.1:45368
I20260811 08:07:56.185552 5155 raft_consensus.cc:2229] T 2c50c6cd78964322a61e36c487b29192 P f09172bcf6f54686b0094d1115d102d4 [term 1 LEADER]: Raft consensus shutting down.
I20260811 08:07:56.185676 5155 raft_consensus.cc:2258] T 2c50c6cd78964322a61e36c487b29192 P f09172bcf6f54686b0094d1115d102d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:07:56.185727 5156 tablet_replica.cc:330] T 2c50c6cd78964322a61e36c487b29192 P c05b0536b8a84ae6b7771596da672734: stopping tablet replica
I20260811 08:07:56.185746 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 4659
I20260811 08:07:56.190570 5155 ts_tablet_manager.cc:1905] T 2c50c6cd78964322a61e36c487b29192 P f09172bcf6f54686b0094d1115d102d4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:07:56.192626 5155 ts_tablet_manager.cc:1918] T 2c50c6cd78964322a61e36c487b29192 P f09172bcf6f54686b0094d1115d102d4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:07:56.192648 5153 ts_tablet_manager.cc:1905] T 2c50c6cd78964322a61e36c487b29192 P 0ea86714b8f14ae3b6fca6c538f7a321: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:07:56.192873 5155 log.cc:1196] T 2c50c6cd78964322a61e36c487b29192 P f09172bcf6f54686b0094d1115d102d4: Deleting WAL directory at /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/minicluster-data/ts-2/wal/wals/2c50c6cd78964322a61e36c487b29192
I20260811 08:07:56.193307 5155 ts_tablet_manager.cc:1939] T 2c50c6cd78964322a61e36c487b29192 P f09172bcf6f54686b0094d1115d102d4: Deleting consensus metadata
I20260811 08:07:56.193912 4569 catalog_manager.cc:4841] TS f09172bcf6f54686b0094d1115d102d4 (127.15.36.195:45509): tablet 2c50c6cd78964322a61e36c487b29192 (table test-table [id=3d88c24721a54a0e8362459118a68a38]) successfully deleted
I20260811 08:07:56.194692 5153 ts_tablet_manager.cc:1918] T 2c50c6cd78964322a61e36c487b29192 P 0ea86714b8f14ae3b6fca6c538f7a321: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:07:56.194813 5153 log.cc:1196] T 2c50c6cd78964322a61e36c487b29192 P 0ea86714b8f14ae3b6fca6c538f7a321: Deleting WAL directory at /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786435400844580-15507-0/minicluster-data/ts-1/wal/wals/2c50c6cd78964322a61e36c487b29192
I20260811 08:07:56.195189 5153 ts_tablet_manager.cc:1939] T 2c50c6cd78964322a61e36c487b29192 P 0ea86714b8f14ae3b6fca6c538f7a321: Deleting consensus metadata
I20260811 08:07:56.195701 4572 catalog_manager.cc:4841] TS 0ea86714b8f14ae3b6fca6c538f7a321 (127.15.36.194:39875): tablet 2c50c6cd78964322a61e36c487b29192 (table test-table [id=3d88c24721a54a0e8362459118a68a38]) successfully deleted
W20260811 08:07:56.197113 4569 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.36.193:41173 (error 108)
I20260811 08:07:56.197374 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 4808
I20260811 08:07:56.197731 5124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:56.197595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.193:41173 (local address 127.0.0.1:45370)
0811 08:07:56.197654 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:56.197692 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.193:41173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260811 08:07:56.197872 4569 catalog_manager.cc:4584] TS c05b0536b8a84ae6b7771596da672734 (127.15.36.193:41173): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 2c50c6cd78964322a61e36c487b29192: Network error: Client connection negotiation failed: client connection to 127.15.36.193:41173: connect: Connection refused (error 111)
I20260811 08:07:56.205287 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 4959
I20260811 08:07:56.211687 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 4549
2026-08-11T08:07:56Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2063 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-11T08:07:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:07:56Z Disabled control of system clock
I20260811 08:07:56.243945 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435400844580-15507-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435400844580-15507-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435400844580-15507-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:44625
--webserver_interface=127.15.36.254
--webserver_port=0
--builtin_ntp_servers=127.15.36.212:44109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.36.254:44625
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 08:07:56.326764 5162 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:07:56.327052 5162 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:07:56.327076 5162 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:07:56.328222 5162 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:07:56.328265 5162 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:07:56.328277 5162 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:07:56.328290 5162 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:07:56.328303 5162 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:07:56.329775 5162 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:44109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435400844580-15507-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435400844580-15507-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.36.254:44625
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:44625
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.36.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5162
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435400844580-15507-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:07:56.330006 5162 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:07:56.330253 5162 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:07:56.335536 5170 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:07:56.335548 5168 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:07:56.335548 5167 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:07:56.335678 5162 server_base.cc:1034] running on GCE node
I20260811 08:07:56.336404 5162 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:07:56.336735 5162 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:07:56.337913 5162 hybrid_clock.cc:648] HybridClock initialized: now 1786435676337902 us; error 35 us; skew 500 ppm
I20260811 08:07:56.339375 5162 webserver.cc:460] Webserver started at http://127.15.36.254:41887/ using document root <none> and password file <none>
I20260811 08:07:56.339636 5162 fs_manager.cc:359] Metadata directory not provided
I20260811 08:07:56.339713 5162 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:07:56.339871 5162 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:07:56.340993 5162 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435400844580-15507-0/minicluster-data/master-0/data/instance:
uuid: "1a4a56600420468fa9c31ae26a2d7d06"
format_stamp: "Formatted at 2026-08-11 08:07:56 on dist-test-slave-2w3w"
server_key: "953e80cae1c47797e6f5effc0c70b109"
server_key_iv: "65f8e37edcbec35d1ac678ea14ddd21e"
server_key_version: "encryptionkey@0"
I20260811 08:07:56.341383 5162 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435400844580-15507-0/minicluster-data/master-0/wal/instance:
uuid: "1a4a56600420468fa9c31ae26a2d7d06"
format_stamp: "Formatted at 2026-08-11 08:07:56 on dist-test-slave-2w3w"
server_key: "953e80cae1c47797e6f5effc0c70b109"
server_key_iv: "65f8e37edcbec35d1ac678ea14ddd21e"
server_key_version: "encryptionkey@0"
I20260811 08:07:56.343444 5162 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260811 08:07:56.344298 5176 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:56.344630 5162 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:07:56.344738 5162 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435400844580-15507-0/minicluster-data/master-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435400844580-15507-0/minicluster-data/master-0/wal
uuid: "1a4a56600420468fa9c31ae26a2d7d06"
format_stamp: "Formatted at 2026-08-11 08:07:56 on dist-test-slave-2w3w"
server_key: "953e80cae1c47797e6f5effc0c70b109"
server_key_iv: "65f8e37edcbec35d1ac678ea14ddd21e"
server_key_version: "encryptionkey@0"
I20260811 08:07:56.344831 5162 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435400844580-15507-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435400844580-15507-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435400844580-15507-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:07:56.369514 5162 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:07:56.369889 5162 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:07:56.370062 5162 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:07:56.374169 5162 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.254:44625
I20260811 08:07:56.374228 5233 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.254:44625 every 8 connection(s)
I20260811 08:07:56.374639 5162 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
I20260811 08:07:56.375715 5235 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:07:56.378046 5235 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1a4a56600420468fa9c31ae26a2d7d06: Bootstrap starting.
I20260811 08:07:56.378594 5235 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1a4a56600420468fa9c31ae26a2d7d06: Neither blocks nor log segments found. Creating new log.
I20260811 08:07:56.378842 5235 log.cc:824] T 00000000000000000000000000000000 P 1a4a56600420468fa9c31ae26a2d7d06: Log is configured to *not* fsync() on all Append() calls
I20260811 08:07:56.379354 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 5162
I20260811 08:07:56.379482 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435400844580-15507-0/minicluster-data/master-0/wal/instance
I20260811 08:07:56.379683 15507 external_mini_cluster.cc:1428] Setting key bf14aae0cbee5dbdccdfc5d6265a9b23
I20260811 08:07:56.379711 5235 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1a4a56600420468fa9c31ae26a2d7d06: No bootstrap required, opened a new log
I20260811 08:07:56.382320 5235 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1a4a56600420468fa9c31ae26a2d7d06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a4a56600420468fa9c31ae26a2d7d06" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 44625 } }
I20260811 08:07:56.382505 5235 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1a4a56600420468fa9c31ae26a2d7d06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:07:56.382545 5235 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1a4a56600420468fa9c31ae26a2d7d06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a4a56600420468fa9c31ae26a2d7d06, State: Initialized, Role: FOLLOWER
I20260811 08:07:56.382675 5235 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1a4a56600420468fa9c31ae26a2d7d06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a4a56600420468fa9c31ae26a2d7d06" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 44625 } }
I20260811 08:07:56.382753 5235 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1a4a56600420468fa9c31ae26a2d7d06 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:07:56.382793 5235 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1a4a56600420468fa9c31ae26a2d7d06 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:07:56.382841 5235 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1a4a56600420468fa9c31ae26a2d7d06 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:07:56.383646 5235 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1a4a56600420468fa9c31ae26a2d7d06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a4a56600420468fa9c31ae26a2d7d06" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 44625 } }
I20260811 08:07:56.383740 5235 leader_election.cc:302] T 00000000000000000000000000000000 P 1a4a56600420468fa9c31ae26a2d7d06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1a4a56600420468fa9c31ae26a2d7d06; no voters:
I20260811 08:07:56.383977 5235 leader_election.cc:288] T 00000000000000000000000000000000 P 1a4a56600420468fa9c31ae26a2d7d06 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:07:56.384009 5242 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1a4a56600420468fa9c31ae26a2d7d06 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:07:56.384121 5242 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1a4a56600420468fa9c31ae26a2d7d06 [term 1 LEADER]: Becoming Leader. State: Replica: 1a4a56600420468fa9c31ae26a2d7d06, State: Running, Role: LEADER
I20260811 08:07:56.384260 5235 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1a4a56600420468fa9c31ae26a2d7d06 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:07:56.384279 5242 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1a4a56600420468fa9c31ae26a2d7d06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a4a56600420468fa9c31ae26a2d7d06" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 44625 } }
I20260811 08:07:56.384764 5243 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a4a56600420468fa9c31ae26a2d7d06 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1a4a56600420468fa9c31ae26a2d7d06" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a4a56600420468fa9c31ae26a2d7d06" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 44625 } } }
I20260811 08:07:56.385043 5243 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a4a56600420468fa9c31ae26a2d7d06 [sys.catalog]: This master's current role is: LEADER
I20260811 08:07:56.384963 5244 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a4a56600420468fa9c31ae26a2d7d06 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1a4a56600420468fa9c31ae26a2d7d06. Latest consensus state: current_term: 1 leader_uuid: "1a4a56600420468fa9c31ae26a2d7d06" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a4a56600420468fa9c31ae26a2d7d06" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 44625 } } }
I20260811 08:07:56.385318 5244 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a4a56600420468fa9c31ae26a2d7d06 [sys.catalog]: This master's current role is: LEADER
I20260811 08:07:56.385701 5251 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:07:56.386099 5241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:56.380285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45550 (local address 127.15.36.254:44625)
0811 08:07:56.380504 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:56.380512 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:56.380537 (+ 25us) server_negotiation.cc:407] Connection header received
0811 08:07:56.381065 (+ 528us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:56.381072 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:56.381129 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:56.381241 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:07:56.381476 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:56.382367 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:56.383483 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:56.384043 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:56.384779 (+ 736us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:56.385100 (+ 321us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:07:56.385103 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:07:56.385104 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:07:56.385310 (+ 206us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:07:56.385349 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:07:56.385363 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:07:56.385733 (+ 370us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:56.385769 (+ 36us) server_negotiation.cc:299] Negotiation successful
0811 08:07:56.385854 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":107,"threads_started":1}
I20260811 08:07:56.386282 5251 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:07:56.388033 5251 catalog_manager.cc:1347] Generated new cluster ID: 40acb6b6e3da495e9f3254e80e983547
I20260811 08:07:56.388090 5251 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:07:56.396917 5251 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:07:56.397802 5251 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:07:56.401823 5251 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1a4a56600420468fa9c31ae26a2d7d06: Generated new TSK 0
I20260811 08:07:56.402029 5251 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:07:56.407094 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435400844580-15507-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435400844580-15507-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435400844580-15507-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.193:0
--local_ip_for_outbound_sockets=127.15.36.193
--webserver_interface=127.15.36.193
--webserver_port=0
--tserver_master_addrs=127.15.36.254:44625
--builtin_ntp_servers=127.15.36.212:44109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 08:07:56.493099 5261 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:07:56.493321 5261 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:07:56.493346 5261 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:07:56.494570 5261 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:07:56.494616 5261 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:07:56.494643 5261 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.193
I20260811 08:07:56.496131 5261 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:44109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435400844580-15507-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435400844580-15507-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.36.193
--webserver_port=0
--tserver_master_addrs=127.15.36.254:44625
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5261
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.193
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435400844580-15507-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:07:56.496404 5261 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:07:56.496747 5261 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:07:56.503569 5267 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:07:56.503690 5266 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:07:56.503719 5261 server_base.cc:1034] running on GCE node
W20260811 08:07:56.503571 5269 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:07:56.504055 5261 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:07:56.504350 5261 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:07:56.505807 5261 hybrid_clock.cc:648] HybridClock initialized: now 1786435676505784 us; error 49 us; skew 500 ppm
I20260811 08:07:56.507609 5261 webserver.cc:460] Webserver started at http://127.15.36.193:40911/ using document root <none> and password file <none>
I20260811 08:07:56.507912 5261 fs_manager.cc:359] Metadata directory not provided
I20260811 08:07:56.507967 5261 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:07:56.508103 5261 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:07:56.509693 5261 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435400844580-15507-0/minicluster-data/ts-0/data/instance:
uuid: "e9f57da09ba041acbb361dbf3beb66fd"
format_stamp: "Formatted at 2026-08-11 08:07:56 on dist-test-slave-2w3w"
server_key: "cee27ce1e57887409b146b3e2f783e23"
server_key_iv: "78fb680a24fa564fed9ae843e9fa0e72"
server_key_version: "encryptionkey@0"
I20260811 08:07:56.510142 5261 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435400844580-15507-0/minicluster-data/ts-0/wal/instance:
uuid: "e9f57da09ba041acbb361dbf3beb66fd"
format_stamp: "Formatted at 2026-08-11 08:07:56 on dist-test-slave-2w3w"
server_key: "cee27ce1e57887409b146b3e2f783e23"
server_key_iv: "78fb680a24fa564fed9ae843e9fa0e72"
server_key_version: "encryptionkey@0"
I20260811 08:07:56.512131 5261 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.003s
I20260811 08:07:56.513185 5276 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:56.513432 5261 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:07:56.513553 5261 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435400844580-15507-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435400844580-15507-0/minicluster-data/ts-0/wal
uuid: "e9f57da09ba041acbb361dbf3beb66fd"
format_stamp: "Formatted at 2026-08-11 08:07:56 on dist-test-slave-2w3w"
server_key: "cee27ce1e57887409b146b3e2f783e23"
server_key_iv: "78fb680a24fa564fed9ae843e9fa0e72"
server_key_version: "encryptionkey@0"
I20260811 08:07:56.513639 5261 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435400844580-15507-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435400844580-15507-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435400844580-15507-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:07:56.527518 5261 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:07:56.527993 5261 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:07:56.528162 5261 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:07:56.528436 5261 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:07:56.528887 5261 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:07:56.528936 5261 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:56.528966 5261 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:07:56.528982 5261 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:56.536430 5261 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.193:41593
I20260811 08:07:56.536479 5402 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.193:41593 every 8 connection(s)
I20260811 08:07:56.536875 5261 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435400844580-15507-0/minicluster-data/ts-0/data/info.pb
I20260811 08:07:56.542394 5241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:56.537820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:47513 (local address 127.15.36.254:44625)
0811 08:07:56.537911 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:56.537913 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:56.538071 (+ 158us) server_negotiation.cc:407] Connection header received
0811 08:07:56.538532 (+ 461us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:56.538533 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:56.538547 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:56.538611 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:07:56.539445 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:56.539983 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:56.541030 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:56.541223 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:56.541281 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:56.542124 (+ 843us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:07:56.542125 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:07:56.542126 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:07:56.542131 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:07:56.542146 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:07:56.542149 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:07:56.542194 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:56.542281 (+ 87us) server_negotiation.cc:299] Negotiation successful
0811 08:07:56.542307 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 08:07:56.542649 5406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:56.537671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:44625 (local address 127.15.36.193:47513)
0811 08:07:56.537885 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:56.537933 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 08:07:56.538445 (+ 512us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:07:56.538674 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:07:56.538677 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:07:56.538686 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:07:56.539324 (+ 638us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:56.539331 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:56.540084 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:56.540085 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:56.540942 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:56.540944 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:56.541307 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:56.541308 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:56.541443 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:56.541984 (+ 541us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 08:07:56.541984 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:07:56.542015 (+ 31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 08:07:56.542041 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:07:56.542207 (+ 166us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:07:56.542212 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:07:56.542215 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:07:56.542271 (+ 56us) client_negotiation.cc:240] Negotiation successful
0811 08:07:56.542360 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":104,"threads_started":1}
I20260811 08:07:56.543217 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 5261
I20260811 08:07:56.543318 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435400844580-15507-0/minicluster-data/ts-0/wal/instance
I20260811 08:07:56.543357 5403 heartbeater.cc:347] Connected to a master server at 127.15.36.254:44625
I20260811 08:07:56.543457 5403 heartbeater.cc:464] Registering TS with master...
I20260811 08:07:56.543577 15507 external_mini_cluster.cc:1428] Setting key e4c856cbcf52ad6ab13e411405521409
I20260811 08:07:56.543680 5403 heartbeater.cc:511] Master 127.15.36.254:44625 requested a full tablet report, sending...
I20260811 08:07:56.544220 5193 ts_manager.cc:194] Registered new tserver with Master: e9f57da09ba041acbb361dbf3beb66fd (127.15.36.193:41593)
I20260811 08:07:56.544678 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435400844580-15507-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435400844580-15507-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435400844580-15507-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.194:0
--local_ip_for_outbound_sockets=127.15.36.194
--webserver_interface=127.15.36.194
--webserver_port=0
--tserver_master_addrs=127.15.36.254:44625
--builtin_ntp_servers=127.15.36.212:44109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 08:07:56.544997 5193 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.36.193:47513
W20260811 08:07:56.630831 5407 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:07:56.631089 5407 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:07:56.631116 5407 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:07:56.632323 5407 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:07:56.632371 5407 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:07:56.632398 5407 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.194
I20260811 08:07:56.634078 5407 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:44109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435400844580-15507-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435400844580-15507-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.36.194
--webserver_port=0
--tserver_master_addrs=127.15.36.254:44625
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5407
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.194
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435400844580-15507-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:07:56.634310 5407 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:07:56.634650 5407 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:07:56.640710 5417 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:07:56.640710 5419 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:07:56.640779 5414 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:07:56.640991 5407 server_base.cc:1034] running on GCE node
I20260811 08:07:56.641260 5407 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:07:56.641537 5407 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:07:56.642693 5407 hybrid_clock.cc:648] HybridClock initialized: now 1786435676642662 us; error 50 us; skew 500 ppm
I20260811 08:07:56.644099 5407 webserver.cc:460] Webserver started at http://127.15.36.194:35295/ using document root <none> and password file <none>
I20260811 08:07:56.644377 5407 fs_manager.cc:359] Metadata directory not provided
I20260811 08:07:56.644429 5407 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:07:56.644567 5407 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:07:56.645701 5407 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435400844580-15507-0/minicluster-data/ts-1/data/instance:
uuid: "6d181b3f06454c6da2b77527fdadcbd8"
format_stamp: "Formatted at 2026-08-11 08:07:56 on dist-test-slave-2w3w"
server_key: "833451de9fed9534bf6ba2a4e0b92344"
server_key_iv: "f9cf15a9d94d6e2f2176731a18c434a2"
server_key_version: "encryptionkey@0"
I20260811 08:07:56.646076 5407 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435400844580-15507-0/minicluster-data/ts-1/wal/instance:
uuid: "6d181b3f06454c6da2b77527fdadcbd8"
format_stamp: "Formatted at 2026-08-11 08:07:56 on dist-test-slave-2w3w"
server_key: "833451de9fed9534bf6ba2a4e0b92344"
server_key_iv: "f9cf15a9d94d6e2f2176731a18c434a2"
server_key_version: "encryptionkey@0"
I20260811 08:07:56.647601 5407 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 08:07:56.648449 5425 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:56.648639 5407 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:07:56.648751 5407 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435400844580-15507-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435400844580-15507-0/minicluster-data/ts-1/wal
uuid: "6d181b3f06454c6da2b77527fdadcbd8"
format_stamp: "Formatted at 2026-08-11 08:07:56 on dist-test-slave-2w3w"
server_key: "833451de9fed9534bf6ba2a4e0b92344"
server_key_iv: "f9cf15a9d94d6e2f2176731a18c434a2"
server_key_version: "encryptionkey@0"
I20260811 08:07:56.648828 5407 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435400844580-15507-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435400844580-15507-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435400844580-15507-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:07:56.656422 5407 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:07:56.656756 5407 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:07:56.656910 5407 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:07:56.657153 5407 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:07:56.657507 5407 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:07:56.657564 5407 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:56.657608 5407 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:07:56.657636 5407 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:56.663923 5407 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.194:45237
I20260811 08:07:56.664060 5557 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.194:45237 every 8 connection(s)
I20260811 08:07:56.664377 5407 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435400844580-15507-0/minicluster-data/ts-1/data/info.pb
I20260811 08:07:56.670190 5241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:56.665329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.194:47745 (local address 127.15.36.254:44625)
0811 08:07:56.665432 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:56.665434 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:56.665608 (+ 174us) server_negotiation.cc:407] Connection header received
0811 08:07:56.666127 (+ 519us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:56.666128 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:56.666138 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:56.666195 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:07:56.667035 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:56.667615 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:56.668691 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:56.668893 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:56.668955 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:56.669854 (+ 899us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:07:56.669855 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:07:56.669855 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:07:56.669860 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:07:56.669877 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:07:56.669880 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:07:56.669932 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:56.670095 (+ 163us) server_negotiation.cc:299] Negotiation successful
0811 08:07:56.670121 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 08:07:56.670461 5560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:56.665247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:44625 (local address 127.15.36.194:47745)
0811 08:07:56.665478 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:56.665514 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 08:07:56.666017 (+ 503us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:07:56.666248 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:07:56.666251 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:07:56.666260 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:07:56.666823 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:56.666828 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:56.667740 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:56.667740 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:56.668592 (+ 852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:56.668594 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:56.668975 (+ 381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:56.668976 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:56.669096 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:56.669681 (+ 585us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 08:07:56.669682 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:07:56.669713 (+ 31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 08:07:56.669739 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:07:56.669991 (+ 252us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:07:56.669998 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:07:56.670002 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:07:56.670079 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 08:07:56.670175 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":74,"threads_started":1}
I20260811 08:07:56.671196 5558 heartbeater.cc:347] Connected to a master server at 127.15.36.254:44625
I20260811 08:07:56.671301 5558 heartbeater.cc:464] Registering TS with master...
I20260811 08:07:56.671344 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 5407
I20260811 08:07:56.671463 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435400844580-15507-0/minicluster-data/ts-1/wal/instance
I20260811 08:07:56.671521 5558 heartbeater.cc:511] Master 127.15.36.254:44625 requested a full tablet report, sending...
I20260811 08:07:56.671727 15507 external_mini_cluster.cc:1428] Setting key a91e7bf4b5c7bf1e9541888eca93096e
I20260811 08:07:56.672003 5193 ts_manager.cc:194] Registered new tserver with Master: 6d181b3f06454c6da2b77527fdadcbd8 (127.15.36.194:45237)
I20260811 08:07:56.672453 5193 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.36.194:47745
I20260811 08:07:56.672869 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435400844580-15507-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435400844580-15507-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435400844580-15507-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.36.195:0
--local_ip_for_outbound_sockets=127.15.36.195
--webserver_interface=127.15.36.195
--webserver_port=0
--tserver_master_addrs=127.15.36.254:44625
--builtin_ntp_servers=127.15.36.212:44109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 08:07:56.766429 5561 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:07:56.766788 5561 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:07:56.766840 5561 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:07:56.769714 5561 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:07:56.769815 5561 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:07:56.769874 5561 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.36.195
I20260811 08:07:56.773054 5561 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:44109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435400844580-15507-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435400844580-15507-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.36.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.36.195
--webserver_port=0
--tserver_master_addrs=127.15.36.254:44625
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5561
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.36.195
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435400844580-15507-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:07:56.773411 5561 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:07:56.773842 5561 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:07:56.779827 5567 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:07:56.779836 5569 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:07:56.780083 5571 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:07:56.780427 5561 server_base.cc:1034] running on GCE node
I20260811 08:07:56.780733 5561 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:07:56.781085 5561 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:07:56.782274 5561 hybrid_clock.cc:648] HybridClock initialized: now 1786435676782259 us; error 33 us; skew 500 ppm
I20260811 08:07:56.783674 5561 webserver.cc:460] Webserver started at http://127.15.36.195:35767/ using document root <none> and password file <none>
I20260811 08:07:56.783975 5561 fs_manager.cc:359] Metadata directory not provided
I20260811 08:07:56.784109 5561 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:07:56.784324 5561 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:07:56.785645 5561 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435400844580-15507-0/minicluster-data/ts-2/data/instance:
uuid: "5fb2dfae38284ebb8d37595a99ced04b"
format_stamp: "Formatted at 2026-08-11 08:07:56 on dist-test-slave-2w3w"
server_key: "824dcdde58703afbbadf65a96948c989"
server_key_iv: "16a0621000cea4d866a8cf86497c4d5f"
server_key_version: "encryptionkey@0"
I20260811 08:07:56.786046 5561 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435400844580-15507-0/minicluster-data/ts-2/wal/instance:
uuid: "5fb2dfae38284ebb8d37595a99ced04b"
format_stamp: "Formatted at 2026-08-11 08:07:56 on dist-test-slave-2w3w"
server_key: "824dcdde58703afbbadf65a96948c989"
server_key_iv: "16a0621000cea4d866a8cf86497c4d5f"
server_key_version: "encryptionkey@0"
I20260811 08:07:56.787644 5561 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.004s
I20260811 08:07:56.788559 5578 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:56.788815 5561 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 08:07:56.788921 5561 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435400844580-15507-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435400844580-15507-0/minicluster-data/ts-2/wal
uuid: "5fb2dfae38284ebb8d37595a99ced04b"
format_stamp: "Formatted at 2026-08-11 08:07:56 on dist-test-slave-2w3w"
server_key: "824dcdde58703afbbadf65a96948c989"
server_key_iv: "16a0621000cea4d866a8cf86497c4d5f"
server_key_version: "encryptionkey@0"
I20260811 08:07:56.789033 5561 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435400844580-15507-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435400844580-15507-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435400844580-15507-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:07:56.827168 5561 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:07:56.827610 5561 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:07:56.827776 5561 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:07:56.828078 5561 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:07:56.828526 5561 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:07:56.828578 5561 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:56.828617 5561 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:07:56.828647 5561 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:56.837350 5561 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.195:37955
I20260811 08:07:56.837386 5702 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.195:37955 every 8 connection(s)
I20260811 08:07:56.837867 5561 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435400844580-15507-0/minicluster-data/ts-2/data/info.pb
I20260811 08:07:56.840039 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 5561
I20260811 08:07:56.840189 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435400844580-15507-0/minicluster-data/ts-2/wal/instance
I20260811 08:07:56.840440 15507 external_mini_cluster.cc:1428] Setting key a867e7f4725a10d190f54f834362e3a3
I20260811 08:07:56.844494 5241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:56.838811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.195:40161 (local address 127.15.36.254:44625)
0811 08:07:56.838877 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:56.838879 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:56.839197 (+ 318us) server_negotiation.cc:407] Connection header received
0811 08:07:56.839817 (+ 620us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:56.839818 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:56.839834 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:56.839916 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:07:56.840906 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:56.841667 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:56.842759 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:56.843038 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:56.843112 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:56.844124 (+ 1012us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:07:56.844126 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:07:56.844126 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:07:56.844152 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:07:56.844169 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:07:56.844173 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:07:56.844239 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:56.844363 (+ 124us) server_negotiation.cc:299] Negotiation successful
0811 08:07:56.844396 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 08:07:56.844739 5706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:56.838814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:44625 (local address 127.15.36.195:40161)
0811 08:07:56.839043 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:56.839089 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 08:07:56.839642 (+ 553us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:07:56.840006 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:07:56.840010 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:07:56.840019 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:07:56.840677 (+ 658us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:56.840685 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:56.841785 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:56.841786 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:56.842628 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:56.842631 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:56.843137 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:56.843138 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:56.843295 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:56.843943 (+ 648us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 08:07:56.843943 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:07:56.843974 (+ 31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 08:07:56.844002 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:07:56.844261 (+ 259us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:07:56.844268 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:07:56.844271 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:07:56.844354 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 08:07:56.844478 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":121,"threads_started":1}
I20260811 08:07:56.845197 5704 heartbeater.cc:347] Connected to a master server at 127.15.36.254:44625
I20260811 08:07:56.845300 5704 heartbeater.cc:464] Registering TS with master...
I20260811 08:07:56.845521 5704 heartbeater.cc:511] Master 127.15.36.254:44625 requested a full tablet report, sending...
I20260811 08:07:56.845918 5193 ts_manager.cc:194] Registered new tserver with Master: 5fb2dfae38284ebb8d37595a99ced04b (127.15.36.195:37955)
I20260811 08:07:56.846323 5193 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.36.195:40161
I20260811 08:07:56.852793 15507 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 08:07:56.857376 5241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:56.854385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45554 (local address 127.15.36.254:44625)
0811 08:07:56.854431 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:56.854433 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:56.854566 (+ 133us) server_negotiation.cc:407] Connection header received
0811 08:07:56.854613 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:56.854614 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:56.854624 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:56.854669 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:07:56.854826 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:56.855412 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:56.856160 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:56.856359 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:56.856437 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:56.857173 (+ 736us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:07:56.857174 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:07:56.857174 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:07:56.857179 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:07:56.857198 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:07:56.857202 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:07:56.857246 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:56.857281 (+ 35us) server_negotiation.cc:299] Negotiation successful
0811 08:07:56.857303 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 08:07:56.859242 5193 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45554:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:07:56.860822 5193 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:07:56.867413 5720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:56.863437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58714 (local address 127.15.36.195:37955)
0811 08:07:56.863603 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:56.863607 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:56.863616 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:07:56.863651 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:56.863653 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:56.863693 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:56.863803 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:07:56.863996 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:56.864888 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:56.866303 (+ 1415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:56.866948 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:56.867064 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:56.867163 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:56.867265 (+ 102us) server_negotiation.cc:299] Negotiation successful
0811 08:07:56.867308 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":96,"threads_started":1}
I20260811 08:07:56.867413 5716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:56.863134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.195:37955 (local address 127.0.0.1:58714)
0811 08:07:56.863328 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:56.863379 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 08:07:56.863444 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:07:56.863816 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:07:56.863817 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:07:56.863819 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:07:56.863892 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:56.863894 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:56.864991 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:56.864992 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:56.866193 (+ 1201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:56.866195 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:56.867069 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:56.867070 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:56.867151 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:56.867166 (+ 15us) client_negotiation.cc:769] Sending connection context
0811 08:07:56.867249 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 08:07:56.867315 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"mutex_wait_us":4,"thread_start_us":58,"threads_started":1}
I20260811 08:07:56.867600 5719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:56.863336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46992 (local address 127.15.36.194:45237)
0811 08:07:56.863546 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:56.863551 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:56.863561 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:07:56.863604 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:56.863606 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:56.863623 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:56.863709 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:07:56.863919 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:56.865094 (+ 1175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:56.866328 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:56.866949 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:56.867069 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:56.867164 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:56.867455 (+ 291us) server_negotiation.cc:299] Negotiation successful
0811 08:07:56.867505 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":176,"thread_start_us":100,"threads_started":1}
I20260811 08:07:56.867414 5715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:56.863134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.194:45237 (local address 127.0.0.1:46992)
0811 08:07:56.863332 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:56.863372 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 08:07:56.863444 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:07:56.863727 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:07:56.863731 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:07:56.863733 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:07:56.863811 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:56.863813 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:56.865196 (+ 1383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:56.865197 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:56.866212 (+ 1015us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:56.866214 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:56.867198 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:56.867199 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:56.867261 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:56.867264 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:07:56.867321 (+ 57us) client_negotiation.cc:240] Negotiation successful
0811 08:07:56.867352 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":64,"threads_started":1}
I20260811 08:07:56.867904 5718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:56.863141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.193:41593 (local address 127.0.0.1:47780)
0811 08:07:56.863890 (+ 749us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:56.863900 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:07:56.863947 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:07:56.864223 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:07:56.864224 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:07:56.864226 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:07:56.864262 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:56.864263 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:56.865529 (+ 1266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:56.865529 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:56.866579 (+ 1050us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:56.866582 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:56.867661 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:56.867662 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:56.867722 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:56.867726 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:07:56.867774 (+ 48us) client_negotiation.cc:240] Negotiation successful
0811 08:07:56.867816 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":727,"thread_start_us":112,"threads_started":1}
I20260811 08:07:56.868197 5721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:56.863607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47780 (local address 127.15.36.193:41593)
0811 08:07:56.863826 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:56.863830 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:56.864007 (+ 177us) server_negotiation.cc:407] Connection header received
0811 08:07:56.864051 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:56.864054 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:56.864068 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:56.864136 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:07:56.864372 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:56.865438 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:56.866673 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:56.867429 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:56.867499 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:56.867624 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:56.868049 (+ 425us) server_negotiation.cc:299] Negotiation successful
0811 08:07:56.868096 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":185,"thread_start_us":90,"threads_started":1}
I20260811 08:07:56.868638 5482 tablet_service.cc:1467] Processing CreateTablet for tablet b58fcd966b044a9ba1a893e7903049c2 (DEFAULT_TABLE table=test-table [id=9aebe3b5c29844bca0d302be8ce8d292]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:07:56.868639 5629 tablet_service.cc:1467] Processing CreateTablet for tablet b58fcd966b044a9ba1a893e7903049c2 (DEFAULT_TABLE table=test-table [id=9aebe3b5c29844bca0d302be8ce8d292]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:07:56.869042 5629 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b58fcd966b044a9ba1a893e7903049c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:07:56.869041 5482 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b58fcd966b044a9ba1a893e7903049c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:07:56.871879 5331 tablet_service.cc:1467] Processing CreateTablet for tablet b58fcd966b044a9ba1a893e7903049c2 (DEFAULT_TABLE table=test-table [id=9aebe3b5c29844bca0d302be8ce8d292]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:07:56.872283 5331 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b58fcd966b044a9ba1a893e7903049c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:07:56.873093 5722 tablet_bootstrap.cc:492] T b58fcd966b044a9ba1a893e7903049c2 P 5fb2dfae38284ebb8d37595a99ced04b: Bootstrap starting.
I20260811 08:07:56.873443 5723 tablet_bootstrap.cc:492] T b58fcd966b044a9ba1a893e7903049c2 P 6d181b3f06454c6da2b77527fdadcbd8: Bootstrap starting.
I20260811 08:07:56.873941 5722 tablet_bootstrap.cc:654] T b58fcd966b044a9ba1a893e7903049c2 P 5fb2dfae38284ebb8d37595a99ced04b: Neither blocks nor log segments found. Creating new log.
I20260811 08:07:56.874079 5723 tablet_bootstrap.cc:654] T b58fcd966b044a9ba1a893e7903049c2 P 6d181b3f06454c6da2b77527fdadcbd8: Neither blocks nor log segments found. Creating new log.
I20260811 08:07:56.874305 5722 log.cc:824] T b58fcd966b044a9ba1a893e7903049c2 P 5fb2dfae38284ebb8d37595a99ced04b: Log is configured to *not* fsync() on all Append() calls
I20260811 08:07:56.874359 5723 log.cc:824] T b58fcd966b044a9ba1a893e7903049c2 P 6d181b3f06454c6da2b77527fdadcbd8: Log is configured to *not* fsync() on all Append() calls
I20260811 08:07:56.875208 5722 tablet_bootstrap.cc:492] T b58fcd966b044a9ba1a893e7903049c2 P 5fb2dfae38284ebb8d37595a99ced04b: No bootstrap required, opened a new log
I20260811 08:07:56.875269 5723 tablet_bootstrap.cc:492] T b58fcd966b044a9ba1a893e7903049c2 P 6d181b3f06454c6da2b77527fdadcbd8: No bootstrap required, opened a new log
I20260811 08:07:56.875289 5722 ts_tablet_manager.cc:1397] T b58fcd966b044a9ba1a893e7903049c2 P 5fb2dfae38284ebb8d37595a99ced04b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 08:07:56.875334 5723 ts_tablet_manager.cc:1397] T b58fcd966b044a9ba1a893e7903049c2 P 6d181b3f06454c6da2b77527fdadcbd8: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 08:07:56.875805 5726 tablet_bootstrap.cc:492] T b58fcd966b044a9ba1a893e7903049c2 P e9f57da09ba041acbb361dbf3beb66fd: Bootstrap starting.
I20260811 08:07:56.876434 5726 tablet_bootstrap.cc:654] T b58fcd966b044a9ba1a893e7903049c2 P e9f57da09ba041acbb361dbf3beb66fd: Neither blocks nor log segments found. Creating new log.
I20260811 08:07:56.876858 5726 log.cc:824] T b58fcd966b044a9ba1a893e7903049c2 P e9f57da09ba041acbb361dbf3beb66fd: Log is configured to *not* fsync() on all Append() calls
I20260811 08:07:56.877547 5726 tablet_bootstrap.cc:492] T b58fcd966b044a9ba1a893e7903049c2 P e9f57da09ba041acbb361dbf3beb66fd: No bootstrap required, opened a new log
I20260811 08:07:56.877592 5726 ts_tablet_manager.cc:1397] T b58fcd966b044a9ba1a893e7903049c2 P e9f57da09ba041acbb361dbf3beb66fd: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 08:07:56.878043 5723 raft_consensus.cc:348] T b58fcd966b044a9ba1a893e7903049c2 P 6d181b3f06454c6da2b77527fdadcbd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb2dfae38284ebb8d37595a99ced04b" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 37955 } } peers { permanent_uuid: "6d181b3f06454c6da2b77527fdadcbd8" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45237 } } peers { permanent_uuid: "e9f57da09ba041acbb361dbf3beb66fd" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 41593 } }
I20260811 08:07:56.878043 5722 raft_consensus.cc:348] T b58fcd966b044a9ba1a893e7903049c2 P 5fb2dfae38284ebb8d37595a99ced04b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb2dfae38284ebb8d37595a99ced04b" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 37955 } } peers { permanent_uuid: "6d181b3f06454c6da2b77527fdadcbd8" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45237 } } peers { permanent_uuid: "e9f57da09ba041acbb361dbf3beb66fd" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 41593 } }
I20260811 08:07:56.878216 5723 raft_consensus.cc:374] T b58fcd966b044a9ba1a893e7903049c2 P 6d181b3f06454c6da2b77527fdadcbd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:07:56.878216 5722 raft_consensus.cc:374] T b58fcd966b044a9ba1a893e7903049c2 P 5fb2dfae38284ebb8d37595a99ced04b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:07:56.878255 5723 raft_consensus.cc:729] T b58fcd966b044a9ba1a893e7903049c2 P 6d181b3f06454c6da2b77527fdadcbd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d181b3f06454c6da2b77527fdadcbd8, State: Initialized, Role: FOLLOWER
I20260811 08:07:56.878269 5722 raft_consensus.cc:729] T b58fcd966b044a9ba1a893e7903049c2 P 5fb2dfae38284ebb8d37595a99ced04b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5fb2dfae38284ebb8d37595a99ced04b, State: Initialized, Role: FOLLOWER
I20260811 08:07:56.878391 5723 consensus_queue.cc:260] T b58fcd966b044a9ba1a893e7903049c2 P 6d181b3f06454c6da2b77527fdadcbd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb2dfae38284ebb8d37595a99ced04b" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 37955 } } peers { permanent_uuid: "6d181b3f06454c6da2b77527fdadcbd8" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45237 } } peers { permanent_uuid: "e9f57da09ba041acbb361dbf3beb66fd" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 41593 } }
I20260811 08:07:56.878489 5722 consensus_queue.cc:260] T b58fcd966b044a9ba1a893e7903049c2 P 5fb2dfae38284ebb8d37595a99ced04b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb2dfae38284ebb8d37595a99ced04b" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 37955 } } peers { permanent_uuid: "6d181b3f06454c6da2b77527fdadcbd8" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45237 } } peers { permanent_uuid: "e9f57da09ba041acbb361dbf3beb66fd" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 41593 } }
I20260811 08:07:56.878717 5723 ts_tablet_manager.cc:1428] T b58fcd966b044a9ba1a893e7903049c2 P 6d181b3f06454c6da2b77527fdadcbd8: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260811 08:07:56.878729 5722 ts_tablet_manager.cc:1428] T b58fcd966b044a9ba1a893e7903049c2 P 5fb2dfae38284ebb8d37595a99ced04b: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 08:07:56.878748 5558 heartbeater.cc:503] Master 127.15.36.254:44625 was elected leader, sending a full tablet report...
I20260811 08:07:56.878870 5704 heartbeater.cc:503] Master 127.15.36.254:44625 was elected leader, sending a full tablet report...
I20260811 08:07:56.879668 5726 raft_consensus.cc:348] T b58fcd966b044a9ba1a893e7903049c2 P e9f57da09ba041acbb361dbf3beb66fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb2dfae38284ebb8d37595a99ced04b" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 37955 } } peers { permanent_uuid: "6d181b3f06454c6da2b77527fdadcbd8" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45237 } } peers { permanent_uuid: "e9f57da09ba041acbb361dbf3beb66fd" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 41593 } }
I20260811 08:07:56.879899 5726 raft_consensus.cc:374] T b58fcd966b044a9ba1a893e7903049c2 P e9f57da09ba041acbb361dbf3beb66fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:07:56.879956 5726 raft_consensus.cc:729] T b58fcd966b044a9ba1a893e7903049c2 P e9f57da09ba041acbb361dbf3beb66fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9f57da09ba041acbb361dbf3beb66fd, State: Initialized, Role: FOLLOWER
I20260811 08:07:56.880084 5726 consensus_queue.cc:260] T b58fcd966b044a9ba1a893e7903049c2 P e9f57da09ba041acbb361dbf3beb66fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb2dfae38284ebb8d37595a99ced04b" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 37955 } } peers { permanent_uuid: "6d181b3f06454c6da2b77527fdadcbd8" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45237 } } peers { permanent_uuid: "e9f57da09ba041acbb361dbf3beb66fd" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 41593 } }
I20260811 08:07:56.880388 5726 ts_tablet_manager.cc:1428] T b58fcd966b044a9ba1a893e7903049c2 P e9f57da09ba041acbb361dbf3beb66fd: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 08:07:56.880419 5403 heartbeater.cc:503] Master 127.15.36.254:44625 was elected leader, sending a full tablet report...
W20260811 08:07:56.915033 5559 tablet.cc:2369] T b58fcd966b044a9ba1a893e7903049c2 P 6d181b3f06454c6da2b77527fdadcbd8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:07:57.015689 5731 raft_consensus.cc:482] T b58fcd966b044a9ba1a893e7903049c2 P e9f57da09ba041acbb361dbf3beb66fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:07:57.015820 5731 raft_consensus.cc:504] T b58fcd966b044a9ba1a893e7903049c2 P e9f57da09ba041acbb361dbf3beb66fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb2dfae38284ebb8d37595a99ced04b" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 37955 } } peers { permanent_uuid: "6d181b3f06454c6da2b77527fdadcbd8" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45237 } } peers { permanent_uuid: "e9f57da09ba041acbb361dbf3beb66fd" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 41593 } }
I20260811 08:07:57.016222 5731 leader_election.cc:288] T b58fcd966b044a9ba1a893e7903049c2 P e9f57da09ba041acbb361dbf3beb66fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5fb2dfae38284ebb8d37595a99ced04b (127.15.36.195:37955), 6d181b3f06454c6da2b77527fdadcbd8 (127.15.36.194:45237)
I20260811 08:07:57.019416 5720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:57.016555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:37895 (local address 127.15.36.195:37955)
0811 08:07:57.016606 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:57.016608 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:57.016698 (+ 90us) server_negotiation.cc:407] Connection header received
0811 08:07:57.016786 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:57.016787 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:57.016798 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:57.016865 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:07:57.017105 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:57.017579 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:57.018578 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:57.019059 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:57.019140 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:57.019148 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:57.019302 (+ 154us) server_negotiation.cc:299] Negotiation successful
0811 08:07:57.019339 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 08:07:57.019413 5719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:57.016537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.36.193:54625 (local address 127.15.36.194:45237)
0811 08:07:57.016626 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:57.016628 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:57.016638 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:07:57.016671 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:57.016672 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:57.016682 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:57.016745 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:07:57.016954 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:57.017437 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:57.018483 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:57.019045 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:57.019132 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:57.019141 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:57.019289 (+ 148us) server_negotiation.cc:299] Negotiation successful
0811 08:07:57.019326 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 08:07:57.019429 5406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:57.016448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.194:45237 (local address 127.15.36.193:54625)
0811 08:07:57.016517 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:57.016530 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 08:07:57.016575 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:07:57.016762 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:07:57.016763 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:07:57.016764 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:07:57.016845 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:57.016847 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:57.017524 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:57.017525 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:57.018380 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:57.018383 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:57.019129 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:57.019130 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:57.019213 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:57.019216 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:07:57.019283 (+ 67us) client_negotiation.cc:240] Negotiation successful
0811 08:07:57.019328 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260811 08:07:57.019435 5732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:57.016448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.195:37955 (local address 127.15.36.193:37895)
0811 08:07:57.016608 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:57.016619 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:07:57.016716 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:07:57.016907 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:07:57.016908 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:07:57.016910 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:07:57.017024 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:57.017026 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:57.017668 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:57.017669 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:57.018490 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:07:57.018493 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:07:57.019141 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:07:57.019142 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:07:57.019226 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:57.019229 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:07:57.019296 (+ 67us) client_negotiation.cc:240] Negotiation successful
0811 08:07:57.019338 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"mutex_wait_us":15,"thread_start_us":84,"threads_started":1}
I20260811 08:07:57.019762 5506 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b58fcd966b044a9ba1a893e7903049c2" candidate_uuid: "e9f57da09ba041acbb361dbf3beb66fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d181b3f06454c6da2b77527fdadcbd8" is_pre_election: true
I20260811 08:07:57.019946 5506 raft_consensus.cc:2454] T b58fcd966b044a9ba1a893e7903049c2 P 6d181b3f06454c6da2b77527fdadcbd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9f57da09ba041acbb361dbf3beb66fd in term 0.
I20260811 08:07:57.019924 5650 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b58fcd966b044a9ba1a893e7903049c2" candidate_uuid: "e9f57da09ba041acbb361dbf3beb66fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fb2dfae38284ebb8d37595a99ced04b" is_pre_election: true
I20260811 08:07:57.020066 5650 raft_consensus.cc:2454] T b58fcd966b044a9ba1a893e7903049c2 P 5fb2dfae38284ebb8d37595a99ced04b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9f57da09ba041acbb361dbf3beb66fd in term 0.
I20260811 08:07:57.020229 5278 leader_election.cc:302] T b58fcd966b044a9ba1a893e7903049c2 P e9f57da09ba041acbb361dbf3beb66fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d181b3f06454c6da2b77527fdadcbd8, e9f57da09ba041acbb361dbf3beb66fd; no voters:
I20260811 08:07:57.020358 5731 raft_consensus.cc:2781] T b58fcd966b044a9ba1a893e7903049c2 P e9f57da09ba041acbb361dbf3beb66fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:07:57.020426 5731 raft_consensus.cc:482] T b58fcd966b044a9ba1a893e7903049c2 P e9f57da09ba041acbb361dbf3beb66fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:07:57.020449 5731 raft_consensus.cc:3037] T b58fcd966b044a9ba1a893e7903049c2 P e9f57da09ba041acbb361dbf3beb66fd [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:07:57.021167 5731 raft_consensus.cc:504] T b58fcd966b044a9ba1a893e7903049c2 P e9f57da09ba041acbb361dbf3beb66fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb2dfae38284ebb8d37595a99ced04b" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 37955 } } peers { permanent_uuid: "6d181b3f06454c6da2b77527fdadcbd8" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45237 } } peers { permanent_uuid: "e9f57da09ba041acbb361dbf3beb66fd" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 41593 } }
I20260811 08:07:57.021333 5731 leader_election.cc:288] T b58fcd966b044a9ba1a893e7903049c2 P e9f57da09ba041acbb361dbf3beb66fd [CANDIDATE]: Term 1 election: Requested vote from peers 5fb2dfae38284ebb8d37595a99ced04b (127.15.36.195:37955), 6d181b3f06454c6da2b77527fdadcbd8 (127.15.36.194:45237)
I20260811 08:07:57.021481 5650 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b58fcd966b044a9ba1a893e7903049c2" candidate_uuid: "e9f57da09ba041acbb361dbf3beb66fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fb2dfae38284ebb8d37595a99ced04b"
I20260811 08:07:57.021488 5506 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b58fcd966b044a9ba1a893e7903049c2" candidate_uuid: "e9f57da09ba041acbb361dbf3beb66fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d181b3f06454c6da2b77527fdadcbd8"
I20260811 08:07:57.021570 5650 raft_consensus.cc:3037] T b58fcd966b044a9ba1a893e7903049c2 P 5fb2dfae38284ebb8d37595a99ced04b [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:07:57.021562 5506 raft_consensus.cc:3037] T b58fcd966b044a9ba1a893e7903049c2 P 6d181b3f06454c6da2b77527fdadcbd8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:07:57.022343 5650 raft_consensus.cc:2454] T b58fcd966b044a9ba1a893e7903049c2 P 5fb2dfae38284ebb8d37595a99ced04b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9f57da09ba041acbb361dbf3beb66fd in term 1.
I20260811 08:07:57.022373 5506 raft_consensus.cc:2454] T b58fcd966b044a9ba1a893e7903049c2 P 6d181b3f06454c6da2b77527fdadcbd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9f57da09ba041acbb361dbf3beb66fd in term 1.
I20260811 08:07:57.022545 5279 leader_election.cc:302] T b58fcd966b044a9ba1a893e7903049c2 P e9f57da09ba041acbb361dbf3beb66fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5fb2dfae38284ebb8d37595a99ced04b, e9f57da09ba041acbb361dbf3beb66fd; no voters:
I20260811 08:07:57.022657 5731 raft_consensus.cc:2781] T b58fcd966b044a9ba1a893e7903049c2 P e9f57da09ba041acbb361dbf3beb66fd [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:07:57.022804 5731 raft_consensus.cc:686] T b58fcd966b044a9ba1a893e7903049c2 P e9f57da09ba041acbb361dbf3beb66fd [term 1 LEADER]: Becoming Leader. State: Replica: e9f57da09ba041acbb361dbf3beb66fd, State: Running, Role: LEADER
I20260811 08:07:57.022905 5731 consensus_queue.cc:237] T b58fcd966b044a9ba1a893e7903049c2 P e9f57da09ba041acbb361dbf3beb66fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb2dfae38284ebb8d37595a99ced04b" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 37955 } } peers { permanent_uuid: "6d181b3f06454c6da2b77527fdadcbd8" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45237 } } peers { permanent_uuid: "e9f57da09ba041acbb361dbf3beb66fd" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 41593 } }
I20260811 08:07:57.023904 5192 catalog_manager.cc:5495] T b58fcd966b044a9ba1a893e7903049c2 P e9f57da09ba041acbb361dbf3beb66fd reported cstate change: term changed from 0 to 1, leader changed from <none> to e9f57da09ba041acbb361dbf3beb66fd (127.15.36.193). New cstate: current_term: 1 leader_uuid: "e9f57da09ba041acbb361dbf3beb66fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb2dfae38284ebb8d37595a99ced04b" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 37955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d181b3f06454c6da2b77527fdadcbd8" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9f57da09ba041acbb361dbf3beb66fd" member_type: VOTER last_known_addr { host: "127.15.36.193" port: 41593 } health_report { overall_health: HEALTHY } } }
W20260811 08:07:57.037585 5405 tablet.cc:2369] T b58fcd966b044a9ba1a893e7903049c2 P e9f57da09ba041acbb361dbf3beb66fd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:07:57.055393 5721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:57.052880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47792 (local address 127.15.36.193:41593)
0811 08:07:57.052926 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:57.052928 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:57.052938 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:07:57.052975 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:57.052976 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:57.052995 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:57.053055 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:07:57.053231 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:57.053724 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:57.054605 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:57.054820 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:57.054885 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:57.055068 (+ 183us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:07:57.055171 (+ 103us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:07:57.055234 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:57.055275 (+ 41us) server_negotiation.cc:299] Negotiation successful
0811 08:07:57.055293 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 08:07:57.057435 5506 raft_consensus.cc:1261] T b58fcd966b044a9ba1a893e7903049c2 P 6d181b3f06454c6da2b77527fdadcbd8 [term 1 FOLLOWER]: Refusing update from remote peer e9f57da09ba041acbb361dbf3beb66fd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:07:57.057487 5650 raft_consensus.cc:1261] T b58fcd966b044a9ba1a893e7903049c2 P 5fb2dfae38284ebb8d37595a99ced04b [term 1 FOLLOWER]: Refusing update from remote peer e9f57da09ba041acbb361dbf3beb66fd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:07:57.057870 5734 consensus_queue.cc:1035] T b58fcd966b044a9ba1a893e7903049c2 P e9f57da09ba041acbb361dbf3beb66fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "5fb2dfae38284ebb8d37595a99ced04b" member_type: VOTER last_known_addr { host: "127.15.36.195" port: 37955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:07:57.058058 5731 consensus_queue.cc:1035] T b58fcd966b044a9ba1a893e7903049c2 P e9f57da09ba041acbb361dbf3beb66fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d181b3f06454c6da2b77527fdadcbd8" member_type: VOTER last_known_addr { host: "127.15.36.194" port: 45237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:07:57.060601 5737 mvcc.cc:205] Tried to move back new op lower bound from 7317240533223968768 to 7317240533086670848. Current Snapshot: MvccSnapshot[applied={T|T < 7317240533223968768}]
I20260811 08:07:57.061054 5738 mvcc.cc:205] Tried to move back new op lower bound from 7317240533223968768 to 7317240533086670848. Current Snapshot: MvccSnapshot[applied={T|T < 7317240533223968768}]
I20260811 08:07:57.061887 5739 mvcc.cc:205] Tried to move back new op lower bound from 7317240533223968768 to 7317240533086670848. Current Snapshot: MvccSnapshot[applied={T|T < 7317240533223968768}]
I20260811 08:07:57.063015 5192 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45554:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:07:57.063120 5192 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45554:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:07:57.063908 5192 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1a4a56600420468fa9c31ae26a2d7d06: Sending DeleteTablet for 3 replicas of tablet b58fcd966b044a9ba1a893e7903049c2
I20260811 08:07:57.064301 5629 tablet_service.cc:1514] Processing DeleteTablet for tablet b58fcd966b044a9ba1a893e7903049c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:07:57 UTC) from {username='slave'} at 127.0.0.1:58714
I20260811 08:07:57.064320 5482 tablet_service.cc:1514] Processing DeleteTablet for tablet b58fcd966b044a9ba1a893e7903049c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:07:57 UTC) from {username='slave'} at 127.0.0.1:46992
I20260811 08:07:57.064306 5331 tablet_service.cc:1514] Processing DeleteTablet for tablet b58fcd966b044a9ba1a893e7903049c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:07:57 UTC) from {username='slave'} at 127.0.0.1:47780
I20260811 08:07:57.064558 5748 tablet_replica.cc:330] T b58fcd966b044a9ba1a893e7903049c2 P e9f57da09ba041acbb361dbf3beb66fd: stopping tablet replica
I20260811 08:07:57.064558 5747 tablet_replica.cc:330] T b58fcd966b044a9ba1a893e7903049c2 P 6d181b3f06454c6da2b77527fdadcbd8: stopping tablet replica
I20260811 08:07:57.064651 5747 raft_consensus.cc:2229] T b58fcd966b044a9ba1a893e7903049c2 P 6d181b3f06454c6da2b77527fdadcbd8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:07:57.064651 5748 raft_consensus.cc:2229] T b58fcd966b044a9ba1a893e7903049c2 P e9f57da09ba041acbb361dbf3beb66fd [term 1 LEADER]: Raft consensus shutting down.
I20260811 08:07:57.064739 5748 raft_consensus.cc:2258] T b58fcd966b044a9ba1a893e7903049c2 P e9f57da09ba041acbb361dbf3beb66fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:07:57.064749 5747 raft_consensus.cc:2258] T b58fcd966b044a9ba1a893e7903049c2 P 6d181b3f06454c6da2b77527fdadcbd8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:07:57.064801 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 5261
I20260811 08:07:57.065738 5747 ts_tablet_manager.cc:1905] T b58fcd966b044a9ba1a893e7903049c2 P 6d181b3f06454c6da2b77527fdadcbd8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:07:57.067557 5747 ts_tablet_manager.cc:1918] T b58fcd966b044a9ba1a893e7903049c2 P 6d181b3f06454c6da2b77527fdadcbd8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:07:57.067619 5747 log.cc:1196] T b58fcd966b044a9ba1a893e7903049c2 P 6d181b3f06454c6da2b77527fdadcbd8: Deleting WAL directory at /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435400844580-15507-0/minicluster-data/ts-1/wal/wals/b58fcd966b044a9ba1a893e7903049c2
I20260811 08:07:57.067807 5747 ts_tablet_manager.cc:1939] T b58fcd966b044a9ba1a893e7903049c2 P 6d181b3f06454c6da2b77527fdadcbd8: Deleting consensus metadata
I20260811 08:07:57.068272 5178 catalog_manager.cc:4841] TS 6d181b3f06454c6da2b77527fdadcbd8 (127.15.36.194:45237): tablet b58fcd966b044a9ba1a893e7903049c2 (table test-table [id=9aebe3b5c29844bca0d302be8ce8d292]) successfully deleted
I20260811 08:07:57.068291 5746 tablet_replica.cc:330] T b58fcd966b044a9ba1a893e7903049c2 P 5fb2dfae38284ebb8d37595a99ced04b: stopping tablet replica
I20260811 08:07:57.068441 5746 raft_consensus.cc:2229] T b58fcd966b044a9ba1a893e7903049c2 P 5fb2dfae38284ebb8d37595a99ced04b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:07:57.068575 5746 raft_consensus.cc:2258] T b58fcd966b044a9ba1a893e7903049c2 P 5fb2dfae38284ebb8d37595a99ced04b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:07:57.069132 5746 ts_tablet_manager.cc:1905] T b58fcd966b044a9ba1a893e7903049c2 P 5fb2dfae38284ebb8d37595a99ced04b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:07:57.070555 5746 ts_tablet_manager.cc:1918] T b58fcd966b044a9ba1a893e7903049c2 P 5fb2dfae38284ebb8d37595a99ced04b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:07:57.070657 5746 log.cc:1196] T b58fcd966b044a9ba1a893e7903049c2 P 5fb2dfae38284ebb8d37595a99ced04b: Deleting WAL directory at /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786435400844580-15507-0/minicluster-data/ts-2/wal/wals/b58fcd966b044a9ba1a893e7903049c2
I20260811 08:07:57.070890 5746 ts_tablet_manager.cc:1939] T b58fcd966b044a9ba1a893e7903049c2 P 5fb2dfae38284ebb8d37595a99ced04b: Deleting consensus metadata
I20260811 08:07:57.071394 5179 catalog_manager.cc:4841] TS 5fb2dfae38284ebb8d37595a99ced04b (127.15.36.195:37955): tablet b58fcd966b044a9ba1a893e7903049c2 (table test-table [id=9aebe3b5c29844bca0d302be8ce8d292]) successfully deleted
W20260811 08:07:57.072677 5180 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.36.193:41593 (error 108)
I20260811 08:07:57.072978 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 5407
I20260811 08:07:57.073190 5718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:57.073041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.193:41593 (local address 127.0.0.1:47798)
0811 08:07:57.073107 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0811 08:07:57.073150 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.193:41593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260811 08:07:57.075912 5180 catalog_manager.cc:4584] TS e9f57da09ba041acbb361dbf3beb66fd (127.15.36.193:41593): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b58fcd966b044a9ba1a893e7903049c2: Network error: Client connection negotiation failed: client connection to 127.15.36.193:41593: connect: Connection refused (error 111)
I20260811 08:07:57.083576 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 5561
I20260811 08:07:57.098096 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 5162
2026-08-11T08:07:57Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (886 ms)
[----------] 6 tests from EncryptionPolicyTest (9313 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786435400844580-15507-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:07:57 dist-test-slave-2w3w krb5kdc[5752](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:07:57 dist-test-slave-2w3w krb5kdc[5752](info): set up 2 sockets
Aug 11 08:07:57 dist-test-slave-2w3w krb5kdc[5752](info): commencing operation
krb5kdc: starting...
W20260811 08:07:58.212764 15507 mini_kdc.cc:121] Time spent starting KDC: real 1.091s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Aug 11 08:07:58 dist-test-slave-2w3w krb5kdc[5752](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435678, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:07:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:07:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786435400844580-15507-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786435400844580-15507-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 08:07:58.346791 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786435400844580-15507-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786435400844580-15507-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786435400844580-15507-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43903
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786435400844580-15507-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43903
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:07:58.429476 5771 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:07:58.429762 5771 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:07:58.429805 5771 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:07:58.431077 5771 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:07:58.431156 5771 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:07:58.431181 5771 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:07:58.431205 5771 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:07:58.431234 5771 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:07:58.432811 5771 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786435400844580-15507-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786435400844580-15507-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43903
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786435400844580-15507-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43903
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5771
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786435400844580-15507-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:07:58.433127 5771 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:07:58.433379 5771 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:07:58.438719 5779 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:07:58.438737 5777 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:07:58.438737 5776 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:07:58.438791 5771 server_base.cc:1034] running on GCE node
I20260811 08:07:58.439167 5771 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:07:58.439536 5771 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:07:58.440714 5771 hybrid_clock.cc:648] HybridClock initialized: now 1786435678440706 us; error 36 us; skew 500 ppm
Aug 11 08:07:58 dist-test-slave-2w3w krb5kdc[5752](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435678, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:07:58.447947 5771 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 08:07:58.448496 5771 webserver.cc:460] Webserver started at http://127.0.0.1:38755/ using document root <none> and password file <none>
I20260811 08:07:58.448741 5771 fs_manager.cc:359] Metadata directory not provided
I20260811 08:07:58.448817 5771 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:07:58.448995 5771 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:07:58.450140 5771 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786435400844580-15507-0/minicluster-data/master-0/data/instance:
uuid: "6391218d1df5471bbefa00b47ebae6ec"
format_stamp: "Formatted at 2026-08-11 08:07:58 on dist-test-slave-2w3w"
server_key: "bc234fdac03587a7ea44ff0812560516"
server_key_iv: "73affc60cce1502d35a6bd2196a5cb74"
server_key_version: "encryptionkey@0"
I20260811 08:07:58.450531 5771 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786435400844580-15507-0/minicluster-data/master-0/wal/instance:
uuid: "6391218d1df5471bbefa00b47ebae6ec"
format_stamp: "Formatted at 2026-08-11 08:07:58 on dist-test-slave-2w3w"
server_key: "bc234fdac03587a7ea44ff0812560516"
server_key_iv: "73affc60cce1502d35a6bd2196a5cb74"
server_key_version: "encryptionkey@0"
I20260811 08:07:58.452080 5771 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.003s
I20260811 08:07:58.452891 5789 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:58.453104 5771 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:07:58.453217 5771 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786435400844580-15507-0/minicluster-data/master-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786435400844580-15507-0/minicluster-data/master-0/wal
uuid: "6391218d1df5471bbefa00b47ebae6ec"
format_stamp: "Formatted at 2026-08-11 08:07:58 on dist-test-slave-2w3w"
server_key: "bc234fdac03587a7ea44ff0812560516"
server_key_iv: "73affc60cce1502d35a6bd2196a5cb74"
server_key_version: "encryptionkey@0"
I20260811 08:07:58.453321 5771 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786435400844580-15507-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786435400844580-15507-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786435400844580-15507-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:07:58.461643 5771 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:07:58.464161 5771 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:07:58.464342 5771 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:07:58.468732 5771 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43903
I20260811 08:07:58.468768 5843 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43903 every 8 connection(s)
I20260811 08:07:58.469159 5771 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
I20260811 08:07:58.470077 5846 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:07:58.472497 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 5771
I20260811 08:07:58.472628 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786435400844580-15507-0/minicluster-data/master-0/wal/instance
I20260811 08:07:58.472620 5846 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6391218d1df5471bbefa00b47ebae6ec: Bootstrap starting.
I20260811 08:07:58.472805 15507 external_mini_cluster.cc:1428] Setting key 960965f0ea1fad8dc06ed522387c2f3c
I20260811 08:07:58.473341 5846 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6391218d1df5471bbefa00b47ebae6ec: Neither blocks nor log segments found. Creating new log.
I20260811 08:07:58.473707 5846 log.cc:824] T 00000000000000000000000000000000 P 6391218d1df5471bbefa00b47ebae6ec: Log is configured to *not* fsync() on all Append() calls
I20260811 08:07:58.474539 5846 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6391218d1df5471bbefa00b47ebae6ec: No bootstrap required, opened a new log
I20260811 08:07:58.476864 5846 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6391218d1df5471bbefa00b47ebae6ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6391218d1df5471bbefa00b47ebae6ec" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43903 } }
I20260811 08:07:58.477038 5846 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6391218d1df5471bbefa00b47ebae6ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:07:58.477069 5846 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6391218d1df5471bbefa00b47ebae6ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6391218d1df5471bbefa00b47ebae6ec, State: Initialized, Role: FOLLOWER
I20260811 08:07:58.477192 5846 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6391218d1df5471bbefa00b47ebae6ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6391218d1df5471bbefa00b47ebae6ec" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43903 } }
I20260811 08:07:58.477268 5846 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6391218d1df5471bbefa00b47ebae6ec [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:07:58.477300 5846 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6391218d1df5471bbefa00b47ebae6ec [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:07:58.477348 5846 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6391218d1df5471bbefa00b47ebae6ec [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:07:58.478111 5846 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6391218d1df5471bbefa00b47ebae6ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6391218d1df5471bbefa00b47ebae6ec" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43903 } }
I20260811 08:07:58.478219 5846 leader_election.cc:302] T 00000000000000000000000000000000 P 6391218d1df5471bbefa00b47ebae6ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6391218d1df5471bbefa00b47ebae6ec; no voters:
I20260811 08:07:58.478447 5846 leader_election.cc:288] T 00000000000000000000000000000000 P 6391218d1df5471bbefa00b47ebae6ec [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:07:58.478523 5851 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6391218d1df5471bbefa00b47ebae6ec [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:07:58.478703 5851 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6391218d1df5471bbefa00b47ebae6ec [term 1 LEADER]: Becoming Leader. State: Replica: 6391218d1df5471bbefa00b47ebae6ec, State: Running, Role: LEADER
I20260811 08:07:58.478719 5846 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6391218d1df5471bbefa00b47ebae6ec [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:07:58.478905 5851 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6391218d1df5471bbefa00b47ebae6ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6391218d1df5471bbefa00b47ebae6ec" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43903 } }
I20260811 08:07:58.479312 5851 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6391218d1df5471bbefa00b47ebae6ec [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6391218d1df5471bbefa00b47ebae6ec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6391218d1df5471bbefa00b47ebae6ec" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43903 } } }
I20260811 08:07:58.479403 5851 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6391218d1df5471bbefa00b47ebae6ec [sys.catalog]: This master's current role is: LEADER
I20260811 08:07:58.479557 5851 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6391218d1df5471bbefa00b47ebae6ec [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6391218d1df5471bbefa00b47ebae6ec. Latest consensus state: current_term: 1 leader_uuid: "6391218d1df5471bbefa00b47ebae6ec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6391218d1df5471bbefa00b47ebae6ec" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43903 } } }
I20260811 08:07:58.479624 5851 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6391218d1df5471bbefa00b47ebae6ec [sys.catalog]: This master's current role is: LEADER
Aug 11 08:07:58 dist-test-slave-2w3w krb5kdc[5752](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435678, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
W20260811 08:07:58.481045 5867 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6391218d1df5471bbefa00b47ebae6ec: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 08:07:58.481113 5867 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 08:07:58.481268 5858 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:07:58.481519 5858 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:07:58.483217 5858 catalog_manager.cc:1347] Generated new cluster ID: 08589066a1e04c18a1856e9e724439dc
I20260811 08:07:58.483278 5858 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:07:58.485212 5849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:58.473404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54995 (local address 127.0.0.1:43903)
0811 08:07:58.473598 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:58.473606 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:58.473631 (+ 25us) server_negotiation.cc:407] Connection header received
0811 08:07:58.474237 (+ 606us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:58.474244 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:58.474299 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:58.474421 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:07:58.475366 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:58.476228 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:58.477390 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:58.478019 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:58.478151 (+ 132us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:58.481383 (+ 3232us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:07:58.481388 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:07:58.481389 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:07:58.481402 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:07:58.483589 (+ 2187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:07:58.484009 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:07:58.484013 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:07:58.484013 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:07:58.484112 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:07:58.484351 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:07:58.484352 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:07:58.484353 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:07:58.484597 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:07:58.484777 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:58.484888 (+ 111us) server_negotiation.cc:299] Negotiation successful
0811 08:07:58.484994 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":92,"threads_started":1}
I20260811 08:07:58.486147 15507 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:07:58.497524 5849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:58.487513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53109 (local address 127.0.0.1:43903)
0811 08:07:58.487552 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:58.487554 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:58.491183 (+ 3629us) server_negotiation.cc:407] Connection header received
0811 08:07:58.491254 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:58.491255 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:58.491268 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:58.491325 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:07:58.491931 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:58.492462 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:58.493173 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:58.493414 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:58.493493 (+ 79us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:58.494786 (+ 1293us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:07:58.494788 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:07:58.494788 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:07:58.494795 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:07:58.496282 (+ 1487us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:07:58.496675 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:07:58.496676 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:07:58.496676 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:07:58.496738 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:07:58.496976 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:07:58.496978 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:07:58.496978 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:07:58.497098 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:07:58.497212 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:58.497335 (+ 123us) server_negotiation.cc:299] Negotiation successful
0811 08:07:58.497412 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 08:07:58.506102 5858 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:07:58.506850 5858 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:07:58.515964 5858 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6391218d1df5471bbefa00b47ebae6ec: Generated new TSK 0
I20260811 08:07:58.516216 5858 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:07:58.521430 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 5771
W20260811 08:07:58.532759 5750 connection.cc:535] client connection to 127.0.0.1:43903 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43903): Connection reset by peer (error 104)
2026-08-11T08:07:58Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1425 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786435400844580-15507-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:07:58 dist-test-slave-2w3w krb5kdc[5881](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:07:58 dist-test-slave-2w3w krb5kdc[5881](info): set up 2 sockets
Aug 11 08:07:58 dist-test-slave-2w3w krb5kdc[5881](info): commencing operation
krb5kdc: starting...
W20260811 08:07:59.630522 15507 mini_kdc.cc:121] Time spent starting KDC: real 1.084s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Aug 11 08:07:59 dist-test-slave-2w3w krb5kdc[5881](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435679, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:07:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:07:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786435400844580-15507-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786435400844580-15507-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 08:07:59.766870 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786435400844580-15507-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786435400844580-15507-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786435400844580-15507-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36945
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786435400844580-15507-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36945
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:07:59.851426 5896 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:07:59.851662 5896 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:07:59.851686 5896 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:07:59.852828 5896 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:07:59.852869 5896 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:07:59.852882 5896 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:07:59.852895 5896 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:07:59.852907 5896 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:07:59.854357 5896 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786435400844580-15507-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786435400844580-15507-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36945
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786435400844580-15507-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36945
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5896
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786435400844580-15507-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:07:59.854574 5896 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:07:59.854780 5896 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:07:59.859946 5903 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:07:59.859972 5901 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:07:59.859941 5905 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:07:59.860196 5896 server_base.cc:1034] running on GCE node
I20260811 08:07:59.860441 5896 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:07:59.860714 5896 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:07:59.861980 5896 hybrid_clock.cc:648] HybridClock initialized: now 1786435679861959 us; error 39 us; skew 500 ppm
Aug 11 08:07:59 dist-test-slave-2w3w krb5kdc[5881](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435679, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:07:59.864817 5896 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 08:07:59.865269 5896 webserver.cc:460] Webserver started at http://127.0.0.1:37229/ using document root <none> and password file <none>
I20260811 08:07:59.865513 5896 fs_manager.cc:359] Metadata directory not provided
I20260811 08:07:59.865561 5896 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:07:59.865746 5896 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:07:59.866889 5896 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786435400844580-15507-0/minicluster-data/master-0/data/instance:
uuid: "853ba5fc92284748bf608e3a88ef1f27"
format_stamp: "Formatted at 2026-08-11 08:07:59 on dist-test-slave-2w3w"
server_key: "33a91fc256618ea2149958ae2efc3213"
server_key_iv: "5a816e32663422133b3d4686acb8bbae"
server_key_version: "encryptionkey@0"
I20260811 08:07:59.867353 5896 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786435400844580-15507-0/minicluster-data/master-0/wal/instance:
uuid: "853ba5fc92284748bf608e3a88ef1f27"
format_stamp: "Formatted at 2026-08-11 08:07:59 on dist-test-slave-2w3w"
server_key: "33a91fc256618ea2149958ae2efc3213"
server_key_iv: "5a816e32663422133b3d4686acb8bbae"
server_key_version: "encryptionkey@0"
I20260811 08:07:59.868862 5896 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:07:59.869777 5914 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:07:59.870040 5896 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:07:59.870148 5896 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786435400844580-15507-0/minicluster-data/master-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786435400844580-15507-0/minicluster-data/master-0/wal
uuid: "853ba5fc92284748bf608e3a88ef1f27"
format_stamp: "Formatted at 2026-08-11 08:07:59 on dist-test-slave-2w3w"
server_key: "33a91fc256618ea2149958ae2efc3213"
server_key_iv: "5a816e32663422133b3d4686acb8bbae"
server_key_version: "encryptionkey@0"
I20260811 08:07:59.870232 5896 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786435400844580-15507-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786435400844580-15507-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786435400844580-15507-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:07:59.888952 5896 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:07:59.891304 5896 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:07:59.891472 5896 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:07:59.895744 5896 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36945
I20260811 08:07:59.895838 5971 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36945 every 8 connection(s)
I20260811 08:07:59.896198 5896 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
I20260811 08:07:59.897122 5972 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:07:59.899694 5972 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 853ba5fc92284748bf608e3a88ef1f27: Bootstrap starting.
I20260811 08:07:59.900347 5972 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 853ba5fc92284748bf608e3a88ef1f27: Neither blocks nor log segments found. Creating new log.
I20260811 08:07:59.900660 5972 log.cc:824] T 00000000000000000000000000000000 P 853ba5fc92284748bf608e3a88ef1f27: Log is configured to *not* fsync() on all Append() calls
I20260811 08:07:59.901506 5972 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 853ba5fc92284748bf608e3a88ef1f27: No bootstrap required, opened a new log
I20260811 08:07:59.903124 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 5896
I20260811 08:07:59.903263 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786435400844580-15507-0/minicluster-data/master-0/wal/instance
I20260811 08:07:59.903520 15507 external_mini_cluster.cc:1428] Setting key 198335e87c4ba4883eb3728404d61839
I20260811 08:07:59.903446 5972 raft_consensus.cc:348] T 00000000000000000000000000000000 P 853ba5fc92284748bf608e3a88ef1f27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "853ba5fc92284748bf608e3a88ef1f27" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36945 } }
I20260811 08:07:59.903604 5972 raft_consensus.cc:374] T 00000000000000000000000000000000 P 853ba5fc92284748bf608e3a88ef1f27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:07:59.903649 5972 raft_consensus.cc:729] T 00000000000000000000000000000000 P 853ba5fc92284748bf608e3a88ef1f27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 853ba5fc92284748bf608e3a88ef1f27, State: Initialized, Role: FOLLOWER
I20260811 08:07:59.903872 5972 consensus_queue.cc:260] T 00000000000000000000000000000000 P 853ba5fc92284748bf608e3a88ef1f27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "853ba5fc92284748bf608e3a88ef1f27" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36945 } }
I20260811 08:07:59.904114 5972 raft_consensus.cc:388] T 00000000000000000000000000000000 P 853ba5fc92284748bf608e3a88ef1f27 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:07:59.904182 5972 raft_consensus.cc:482] T 00000000000000000000000000000000 P 853ba5fc92284748bf608e3a88ef1f27 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:07:59.904248 5972 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 853ba5fc92284748bf608e3a88ef1f27 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:07:59.905349 5972 raft_consensus.cc:504] T 00000000000000000000000000000000 P 853ba5fc92284748bf608e3a88ef1f27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "853ba5fc92284748bf608e3a88ef1f27" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36945 } }
I20260811 08:07:59.905481 5972 leader_election.cc:302] T 00000000000000000000000000000000 P 853ba5fc92284748bf608e3a88ef1f27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 853ba5fc92284748bf608e3a88ef1f27; no voters:
I20260811 08:07:59.905675 5972 leader_election.cc:288] T 00000000000000000000000000000000 P 853ba5fc92284748bf608e3a88ef1f27 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:07:59.905715 5977 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 853ba5fc92284748bf608e3a88ef1f27 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:07:59.905825 5977 raft_consensus.cc:686] T 00000000000000000000000000000000 P 853ba5fc92284748bf608e3a88ef1f27 [term 1 LEADER]: Becoming Leader. State: Replica: 853ba5fc92284748bf608e3a88ef1f27, State: Running, Role: LEADER
I20260811 08:07:59.905964 5972 sys_catalog.cc:564] T 00000000000000000000000000000000 P 853ba5fc92284748bf608e3a88ef1f27 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:07:59.905969 5977 consensus_queue.cc:237] T 00000000000000000000000000000000 P 853ba5fc92284748bf608e3a88ef1f27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "853ba5fc92284748bf608e3a88ef1f27" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36945 } }
I20260811 08:07:59.907331 5979 sys_catalog.cc:455] T 00000000000000000000000000000000 P 853ba5fc92284748bf608e3a88ef1f27 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "853ba5fc92284748bf608e3a88ef1f27" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "853ba5fc92284748bf608e3a88ef1f27" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36945 } } }
I20260811 08:07:59.907441 5979 sys_catalog.cc:458] T 00000000000000000000000000000000 P 853ba5fc92284748bf608e3a88ef1f27 [sys.catalog]: This master's current role is: LEADER
I20260811 08:07:59.907644 5980 sys_catalog.cc:455] T 00000000000000000000000000000000 P 853ba5fc92284748bf608e3a88ef1f27 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 853ba5fc92284748bf608e3a88ef1f27. Latest consensus state: current_term: 1 leader_uuid: "853ba5fc92284748bf608e3a88ef1f27" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "853ba5fc92284748bf608e3a88ef1f27" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36945 } } }
I20260811 08:07:59.907723 5980 sys_catalog.cc:458] T 00000000000000000000000000000000 P 853ba5fc92284748bf608e3a88ef1f27 [sys.catalog]: This master's current role is: LEADER
W20260811 08:07:59.907972 5994 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 853ba5fc92284748bf608e3a88ef1f27: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 08:07:59.908041 5994 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 08:07:59.908593 5995 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:07:59.909036 5995 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:07:59.909740 5976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:59.904129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49029 (local address 127.0.0.1:36945)
0811 08:07:59.904345 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:59.904355 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:59.904392 (+ 37us) server_negotiation.cc:407] Connection header received
0811 08:07:59.904502 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:59.904508 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:59.904551 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:59.904698 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:07:59.904999 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:59.906177 (+ 1178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:59.907336 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:59.907996 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:59.908104 (+ 108us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:59.908970 (+ 866us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:07:59.908974 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:07:59.908975 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:07:59.909185 (+ 210us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:07:59.909238 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:07:59.909254 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:07:59.909346 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:59.909467 (+ 121us) server_negotiation.cc:299] Negotiation successful
0811 08:07:59.909498 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":104,"threads_started":1}
I20260811 08:07:59.910723 5995 catalog_manager.cc:1347] Generated new cluster ID: dcd9b2b139a04a12b00b8b3b8d84c190
I20260811 08:07:59.910779 5995 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:07:59.911003 15507 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:07:59.918785 5976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:07:59.912673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53535 (local address 127.0.0.1:36945)
0811 08:07:59.912720 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 08:07:59.912722 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:07:59.915199 (+ 2477us) server_negotiation.cc:407] Connection header received
0811 08:07:59.915256 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:07:59.915257 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:07:59.915268 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:07:59.915334 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:07:59.915488 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:59.916249 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:59.917332 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:07:59.917644 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:07:59.917709 (+ 65us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:07:59.918505 (+ 796us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:07:59.918506 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:07:59.918507 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:07:59.918511 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:07:59.918527 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:07:59.918532 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:07:59.918587 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 08:07:59.918678 (+ 91us) server_negotiation.cc:299] Negotiation successful
0811 08:07:59.918692 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 08:07:59.922844 5995 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:07:59.923684 5995 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:07:59.930312 5995 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 853ba5fc92284748bf608e3a88ef1f27: Generated new TSK 0
I20260811 08:07:59.930528 5995 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:07:59.934286 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 5896
W20260811 08:07:59.942811 5878 connection.cc:535] client connection to 127.0.0.1:36945 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36945): Connection reset by peer (error 104)
2026-08-11T08:07:59Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1410 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786435400844580-15507-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:08:00 dist-test-slave-2w3w krb5kdc[6006](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:08:00 dist-test-slave-2w3w krb5kdc[6006](info): set up 2 sockets
Aug 11 08:08:00 dist-test-slave-2w3w krb5kdc[6006](info): commencing operation
krb5kdc: starting...
W20260811 08:08:01.110577 15507 mini_kdc.cc:121] Time spent starting KDC: real 1.153s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Aug 11 08:08:01 dist-test-slave-2w3w krb5kdc[6006](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435681, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:08:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:08:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786435400844580-15507-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786435400844580-15507-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 08:08:01.250175 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786435400844580-15507-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786435400844580-15507-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786435400844580-15507-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40105
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786435400844580-15507-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33759
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40105
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:08:01.336380 6020 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:08:01.336630 6020 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:08:01.336655 6020 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:08:01.337852 6020 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:08:01.337908 6020 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:08:01.337924 6020 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:08:01.337937 6020 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:08:01.337950 6020 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:08:01.339589 6020 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33759
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786435400844580-15507-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786435400844580-15507-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40105
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786435400844580-15507-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40105
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6020
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786435400844580-15507-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:08:01.339825 6020 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:08:01.340027 6020 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:08:01.345270 6025 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:01.345273 6029 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:01.345499 6020 server_base.cc:1034] running on GCE node
W20260811 08:08:01.345273 6026 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:01.345892 6020 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:08:01.346227 6020 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:08:01.347378 6020 hybrid_clock.cc:648] HybridClock initialized: now 1786435681347355 us; error 66 us; skew 500 ppm
Aug 11 08:08:01 dist-test-slave-2w3w krb5kdc[6006](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435681, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:08:01.350229 6020 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 08:08:01.350713 6020 webserver.cc:460] Webserver started at http://127.0.0.1:38891/ using document root <none> and password file <none>
I20260811 08:08:01.351037 6020 fs_manager.cc:359] Metadata directory not provided
I20260811 08:08:01.351109 6020 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:08:01.351279 6020 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:08:01.352439 6020 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786435400844580-15507-0/minicluster-data/master-0/data/instance:
uuid: "22e7f54cc35b4e9b8deab8e8ecf89c0e"
format_stamp: "Formatted at 2026-08-11 08:08:01 on dist-test-slave-2w3w"
server_key: "7a6c7b41195435116da5b48c70406b29"
server_key_iv: "0c4c33a7c0b0f30f151fb17334ee20d8"
server_key_version: "encryptionkey@0"
I20260811 08:08:01.352835 6020 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786435400844580-15507-0/minicluster-data/master-0/wal/instance:
uuid: "22e7f54cc35b4e9b8deab8e8ecf89c0e"
format_stamp: "Formatted at 2026-08-11 08:08:01 on dist-test-slave-2w3w"
server_key: "7a6c7b41195435116da5b48c70406b29"
server_key_iv: "0c4c33a7c0b0f30f151fb17334ee20d8"
server_key_version: "encryptionkey@0"
I20260811 08:08:01.354277 6020 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 08:08:01.355214 6037 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:01.355409 6020 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:08:01.355530 6020 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786435400844580-15507-0/minicluster-data/master-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786435400844580-15507-0/minicluster-data/master-0/wal
uuid: "22e7f54cc35b4e9b8deab8e8ecf89c0e"
format_stamp: "Formatted at 2026-08-11 08:08:01 on dist-test-slave-2w3w"
server_key: "7a6c7b41195435116da5b48c70406b29"
server_key_iv: "0c4c33a7c0b0f30f151fb17334ee20d8"
server_key_version: "encryptionkey@0"
I20260811 08:08:01.355613 6020 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786435400844580-15507-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786435400844580-15507-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786435400844580-15507-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:08:01.359293 6020 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:08:01.361828 6020 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:08:01.362018 6020 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:08:01.366626 6020 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40105
I20260811 08:08:01.366675 6097 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40105 every 8 connection(s)
I20260811 08:08:01.367281 6020 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
I20260811 08:08:01.368291 6098 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:08:01.370719 6098 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 22e7f54cc35b4e9b8deab8e8ecf89c0e: Bootstrap starting.
I20260811 08:08:01.371429 6098 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 22e7f54cc35b4e9b8deab8e8ecf89c0e: Neither blocks nor log segments found. Creating new log.
I20260811 08:08:01.371750 6098 log.cc:824] T 00000000000000000000000000000000 P 22e7f54cc35b4e9b8deab8e8ecf89c0e: Log is configured to *not* fsync() on all Append() calls
I20260811 08:08:01.372675 6098 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 22e7f54cc35b4e9b8deab8e8ecf89c0e: No bootstrap required, opened a new log
I20260811 08:08:01.374402 6098 raft_consensus.cc:348] T 00000000000000000000000000000000 P 22e7f54cc35b4e9b8deab8e8ecf89c0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22e7f54cc35b4e9b8deab8e8ecf89c0e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40105 } }
I20260811 08:08:01.374557 6098 raft_consensus.cc:374] T 00000000000000000000000000000000 P 22e7f54cc35b4e9b8deab8e8ecf89c0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:08:01.374579 6098 raft_consensus.cc:729] T 00000000000000000000000000000000 P 22e7f54cc35b4e9b8deab8e8ecf89c0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22e7f54cc35b4e9b8deab8e8ecf89c0e, State: Initialized, Role: FOLLOWER
I20260811 08:08:01.374801 6098 consensus_queue.cc:260] T 00000000000000000000000000000000 P 22e7f54cc35b4e9b8deab8e8ecf89c0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22e7f54cc35b4e9b8deab8e8ecf89c0e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40105 } }
I20260811 08:08:01.374886 6098 raft_consensus.cc:388] T 00000000000000000000000000000000 P 22e7f54cc35b4e9b8deab8e8ecf89c0e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:08:01.374931 6098 raft_consensus.cc:482] T 00000000000000000000000000000000 P 22e7f54cc35b4e9b8deab8e8ecf89c0e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:08:01.375018 6098 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 22e7f54cc35b4e9b8deab8e8ecf89c0e [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:08:01.375649 6098 raft_consensus.cc:504] T 00000000000000000000000000000000 P 22e7f54cc35b4e9b8deab8e8ecf89c0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22e7f54cc35b4e9b8deab8e8ecf89c0e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40105 } }
I20260811 08:08:01.375777 6098 leader_election.cc:302] T 00000000000000000000000000000000 P 22e7f54cc35b4e9b8deab8e8ecf89c0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 22e7f54cc35b4e9b8deab8e8ecf89c0e; no voters:
I20260811 08:08:01.375981 6098 leader_election.cc:288] T 00000000000000000000000000000000 P 22e7f54cc35b4e9b8deab8e8ecf89c0e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:08:01.376063 6101 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 22e7f54cc35b4e9b8deab8e8ecf89c0e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:08:01.376242 6101 raft_consensus.cc:686] T 00000000000000000000000000000000 P 22e7f54cc35b4e9b8deab8e8ecf89c0e [term 1 LEADER]: Becoming Leader. State: Replica: 22e7f54cc35b4e9b8deab8e8ecf89c0e, State: Running, Role: LEADER
I20260811 08:08:01.376246 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 6020
I20260811 08:08:01.376308 6098 sys_catalog.cc:564] T 00000000000000000000000000000000 P 22e7f54cc35b4e9b8deab8e8ecf89c0e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:08:01.376410 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786435400844580-15507-0/minicluster-data/master-0/wal/instance
I20260811 08:08:01.376338 6101 consensus_queue.cc:237] T 00000000000000000000000000000000 P 22e7f54cc35b4e9b8deab8e8ecf89c0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22e7f54cc35b4e9b8deab8e8ecf89c0e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40105 } }
I20260811 08:08:01.376648 15507 external_mini_cluster.cc:1428] Setting key 5046516b337e1f3b478f9ea65a6a4103
I20260811 08:08:01.377019 6103 sys_catalog.cc:455] T 00000000000000000000000000000000 P 22e7f54cc35b4e9b8deab8e8ecf89c0e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 22e7f54cc35b4e9b8deab8e8ecf89c0e. Latest consensus state: current_term: 1 leader_uuid: "22e7f54cc35b4e9b8deab8e8ecf89c0e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22e7f54cc35b4e9b8deab8e8ecf89c0e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40105 } } }
I20260811 08:08:01.377110 6103 sys_catalog.cc:458] T 00000000000000000000000000000000 P 22e7f54cc35b4e9b8deab8e8ecf89c0e [sys.catalog]: This master's current role is: LEADER
I20260811 08:08:01.377153 6102 sys_catalog.cc:455] T 00000000000000000000000000000000 P 22e7f54cc35b4e9b8deab8e8ecf89c0e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "22e7f54cc35b4e9b8deab8e8ecf89c0e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22e7f54cc35b4e9b8deab8e8ecf89c0e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40105 } } }
I20260811 08:08:01.377215 6102 sys_catalog.cc:458] T 00000000000000000000000000000000 P 22e7f54cc35b4e9b8deab8e8ecf89c0e [sys.catalog]: This master's current role is: LEADER
I20260811 08:08:01.377818 6106 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:08:01.378418 6106 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:08:01.379318 6107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:01.377348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34025 (local address 127.0.0.1:40105)
0811 08:08:01.377555 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:01.377565 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:01.377605 (+ 40us) server_negotiation.cc:407] Connection header received
0811 08:08:01.377735 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:01.377752 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:01.377795 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:01.378014 (+ 219us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:01.378803 (+ 789us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:01.378808 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:01.378808 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:08:01.378813 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:01.378858 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:08:01.378873 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:01.378932 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:01.379071 (+ 139us) server_negotiation.cc:299] Negotiation successful
0811 08:08:01.379115 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":123,"threads_started":1}
I20260811 08:08:01.380163 15507 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:08:01.380224 6106 catalog_manager.cc:1347] Generated new cluster ID: 1bfba28cdc084c28b0db68c09f8f3ec6
I20260811 08:08:01.380271 6106 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:08:01.382906 6107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:01.381765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53173 (local address 127.0.0.1:40105)
0811 08:08:01.381807 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:01.381809 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:01.381955 (+ 146us) server_negotiation.cc:407] Connection header received
0811 08:08:01.382016 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:01.382017 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:01.382023 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:01.382078 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:01.382698 (+ 620us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:01.382698 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:01.382699 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:08:01.382702 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:01.382719 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:08:01.382723 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:01.382773 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:01.382830 (+ 57us) server_negotiation.cc:299] Negotiation successful
0811 08:08:01.382843 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 08:08:01.399358 6106 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:08:01.399567 6106 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:08:01.404471 6106 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 22e7f54cc35b4e9b8deab8e8ecf89c0e: Generated new TSK 0
I20260811 08:08:01.404690 6106 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:08:01.413132 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 6020
2026-08-11T08:08:01Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1477 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786435400844580-15507-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:08:01 dist-test-slave-2w3w krb5kdc[6131](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:08:01 dist-test-slave-2w3w krb5kdc[6131](info): set up 2 sockets
Aug 11 08:08:01 dist-test-slave-2w3w krb5kdc[6131](info): commencing operation
krb5kdc: starting...
W20260811 08:08:02.537232 15507 mini_kdc.cc:121] Time spent starting KDC: real 1.102s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Aug 11 08:08:02 dist-test-slave-2w3w krb5kdc[6131](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435682, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:08:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:08:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786435400844580-15507-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786435400844580-15507-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 08:08:02.678268 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786435400844580-15507-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786435400844580-15507-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786435400844580-15507-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35459
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786435400844580-15507-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35459
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:08:02.762827 6144 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:08:02.763087 6144 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:08:02.763114 6144 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:08:02.764398 6144 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:08:02.764446 6144 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:08:02.764459 6144 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:08:02.764472 6144 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:08:02.764485 6144 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:08:02.766000 6144 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786435400844580-15507-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786435400844580-15507-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35459
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786435400844580-15507-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35459
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6144
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786435400844580-15507-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:08:02.766280 6144 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:08:02.766528 6144 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:08:02.771842 6155 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:02.771838 6152 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:02.771940 6144 server_base.cc:1034] running on GCE node
W20260811 08:08:02.771842 6153 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:02.772284 6144 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:08:02.772612 6144 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:08:02.773789 6144 hybrid_clock.cc:648] HybridClock initialized: now 1786435682773782 us; error 42 us; skew 500 ppm
Aug 11 08:08:02 dist-test-slave-2w3w krb5kdc[6131](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435682, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:08:02.776443 6144 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 08:08:02.776893 6144 webserver.cc:460] Webserver started at http://127.0.0.1:40547/ using document root <none> and password file <none>
I20260811 08:08:02.777146 6144 fs_manager.cc:359] Metadata directory not provided
I20260811 08:08:02.777197 6144 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:08:02.777344 6144 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:08:02.778474 6144 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786435400844580-15507-0/minicluster-data/master-0/data/instance:
uuid: "e46904131a764514bb29879d42b017d0"
format_stamp: "Formatted at 2026-08-11 08:08:02 on dist-test-slave-2w3w"
server_key: "d484e0ea645026b6deff8734e95beb6b"
server_key_iv: "00cd92c593e5cedeefb294ab02699263"
server_key_version: "encryptionkey@0"
I20260811 08:08:02.778860 6144 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786435400844580-15507-0/minicluster-data/master-0/wal/instance:
uuid: "e46904131a764514bb29879d42b017d0"
format_stamp: "Formatted at 2026-08-11 08:08:02 on dist-test-slave-2w3w"
server_key: "d484e0ea645026b6deff8734e95beb6b"
server_key_iv: "00cd92c593e5cedeefb294ab02699263"
server_key_version: "encryptionkey@0"
I20260811 08:08:02.780308 6144 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:08:02.781098 6164 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:02.781309 6144 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:08:02.781399 6144 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786435400844580-15507-0/minicluster-data/master-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786435400844580-15507-0/minicluster-data/master-0/wal
uuid: "e46904131a764514bb29879d42b017d0"
format_stamp: "Formatted at 2026-08-11 08:08:02 on dist-test-slave-2w3w"
server_key: "d484e0ea645026b6deff8734e95beb6b"
server_key_iv: "00cd92c593e5cedeefb294ab02699263"
server_key_version: "encryptionkey@0"
I20260811 08:08:02.781458 6144 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786435400844580-15507-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786435400844580-15507-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786435400844580-15507-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:08:02.789871 6144 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:08:02.792294 6144 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:08:02.792418 6144 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:08:02.796396 6144 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35459
I20260811 08:08:02.796453 6220 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35459 every 8 connection(s)
I20260811 08:08:02.796801 6144 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
I20260811 08:08:02.797751 6221 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:08:02.800225 6221 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e46904131a764514bb29879d42b017d0: Bootstrap starting.
I20260811 08:08:02.800860 6221 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e46904131a764514bb29879d42b017d0: Neither blocks nor log segments found. Creating new log.
I20260811 08:08:02.801153 6221 log.cc:824] T 00000000000000000000000000000000 P e46904131a764514bb29879d42b017d0: Log is configured to *not* fsync() on all Append() calls
I20260811 08:08:02.801923 6221 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e46904131a764514bb29879d42b017d0: No bootstrap required, opened a new log
I20260811 08:08:02.803696 6221 raft_consensus.cc:348] T 00000000000000000000000000000000 P e46904131a764514bb29879d42b017d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e46904131a764514bb29879d42b017d0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35459 } }
I20260811 08:08:02.803865 6221 raft_consensus.cc:374] T 00000000000000000000000000000000 P e46904131a764514bb29879d42b017d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:08:02.803915 6221 raft_consensus.cc:729] T 00000000000000000000000000000000 P e46904131a764514bb29879d42b017d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e46904131a764514bb29879d42b017d0, State: Initialized, Role: FOLLOWER
I20260811 08:08:02.804104 6221 consensus_queue.cc:260] T 00000000000000000000000000000000 P e46904131a764514bb29879d42b017d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e46904131a764514bb29879d42b017d0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35459 } }
I20260811 08:08:02.804193 6221 raft_consensus.cc:388] T 00000000000000000000000000000000 P e46904131a764514bb29879d42b017d0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:08:02.804232 6221 raft_consensus.cc:482] T 00000000000000000000000000000000 P e46904131a764514bb29879d42b017d0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:08:02.804286 6221 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e46904131a764514bb29879d42b017d0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:08:02.804277 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 6144
I20260811 08:08:02.804433 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786435400844580-15507-0/minicluster-data/master-0/wal/instance
I20260811 08:08:02.804649 15507 external_mini_cluster.cc:1428] Setting key feaecac04e7a0c9cf4d5ad1ec371c141
I20260811 08:08:02.804986 6221 raft_consensus.cc:504] T 00000000000000000000000000000000 P e46904131a764514bb29879d42b017d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e46904131a764514bb29879d42b017d0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35459 } }
I20260811 08:08:02.805110 6221 leader_election.cc:302] T 00000000000000000000000000000000 P e46904131a764514bb29879d42b017d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e46904131a764514bb29879d42b017d0; no voters:
I20260811 08:08:02.805298 6221 leader_election.cc:288] T 00000000000000000000000000000000 P e46904131a764514bb29879d42b017d0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:08:02.805449 6225 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e46904131a764514bb29879d42b017d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:08:02.805574 6221 sys_catalog.cc:564] T 00000000000000000000000000000000 P e46904131a764514bb29879d42b017d0 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:08:02.805603 6225 raft_consensus.cc:686] T 00000000000000000000000000000000 P e46904131a764514bb29879d42b017d0 [term 1 LEADER]: Becoming Leader. State: Replica: e46904131a764514bb29879d42b017d0, State: Running, Role: LEADER
I20260811 08:08:02.805706 6225 consensus_queue.cc:237] T 00000000000000000000000000000000 P e46904131a764514bb29879d42b017d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e46904131a764514bb29879d42b017d0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35459 } }
I20260811 08:08:02.806109 6225 sys_catalog.cc:455] T 00000000000000000000000000000000 P e46904131a764514bb29879d42b017d0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e46904131a764514bb29879d42b017d0. Latest consensus state: current_term: 1 leader_uuid: "e46904131a764514bb29879d42b017d0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e46904131a764514bb29879d42b017d0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35459 } } }
I20260811 08:08:02.806195 6225 sys_catalog.cc:458] T 00000000000000000000000000000000 P e46904131a764514bb29879d42b017d0 [sys.catalog]: This master's current role is: LEADER
I20260811 08:08:02.806397 6227 sys_catalog.cc:455] T 00000000000000000000000000000000 P e46904131a764514bb29879d42b017d0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e46904131a764514bb29879d42b017d0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e46904131a764514bb29879d42b017d0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35459 } } }
I20260811 08:08:02.806507 6227 sys_catalog.cc:458] T 00000000000000000000000000000000 P e46904131a764514bb29879d42b017d0 [sys.catalog]: This master's current role is: LEADER
W20260811 08:08:02.807447 6241 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e46904131a764514bb29879d42b017d0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 08:08:02.807507 6241 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 08:08:02.807587 6235 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:08:02.807770 6235 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:08:02.809594 6235 catalog_manager.cc:1347] Generated new cluster ID: 9deee49412af413eba14acef6fd9f226
I20260811 08:08:02.809654 6235 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 08:08:02 dist-test-slave-2w3w krb5kdc[6131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435682, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 08:08:02.817574 6226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:02.805148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41053 (local address 127.0.0.1:35459)
0811 08:08:02.805367 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:02.805378 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:02.805417 (+ 39us) server_negotiation.cc:407] Connection header received
0811 08:08:02.805545 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:02.805553 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:02.805616 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:02.806393 (+ 777us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:02.806655 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:02.808230 (+ 1575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:02.809352 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:02.809971 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:02.810081 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:02.813195 (+ 3114us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:02.813199 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:02.813200 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:02.813212 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:02.815828 (+ 2616us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:02.816261 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:02.816264 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:02.816264 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:02.816389 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:02.816610 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:02.816611 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:02.816611 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:02.816916 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:02.817060 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:02.817201 (+ 141us) server_negotiation.cc:299] Negotiation successful
0811 08:08:02.817350 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":120,"threads_started":1}
I20260811 08:08:02.818558 15507 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:08:02.827761 6226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:02.820134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58557 (local address 127.0.0.1:35459)
0811 08:08:02.820175 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:02.820177 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:02.820241 (+ 64us) server_negotiation.cc:407] Connection header received
0811 08:08:02.820301 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:02.820302 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:02.820312 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:02.820382 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:02.821002 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:02.821808 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:02.822840 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:02.823193 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:02.823271 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:02.824713 (+ 1442us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:02.824714 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:02.824715 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:02.824724 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:02.826403 (+ 1679us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:02.826792 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:02.826793 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:02.826793 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:02.826919 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:02.827199 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:02.827200 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:02.827200 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:02.827351 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:02.827454 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:02.827566 (+ 112us) server_negotiation.cc:299] Negotiation successful
0811 08:08:02.827657 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 08:08:02.829108 6235 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:08:02.829696 6235 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:08:02.833760 6235 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e46904131a764514bb29879d42b017d0: Generated new TSK 0
I20260811 08:08:02.833969 6235 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:08:02.840444 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 6144
2026-08-11T08:08:02Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1429 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786435400844580-15507-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:08:02 dist-test-slave-2w3w krb5kdc[6252](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:08:02 dist-test-slave-2w3w krb5kdc[6252](info): set up 2 sockets
Aug 11 08:08:02 dist-test-slave-2w3w krb5kdc[6252](info): commencing operation
krb5kdc: starting...
W20260811 08:08:03.973541 15507 mini_kdc.cc:121] Time spent starting KDC: real 1.109s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Aug 11 08:08:04 dist-test-slave-2w3w krb5kdc[6252](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435684, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:08:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:08:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786435400844580-15507-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786435400844580-15507-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 08:08:04.107641 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786435400844580-15507-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786435400844580-15507-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786435400844580-15507-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38477
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786435400844580-15507-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38477
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:08:04.191895 6271 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:08:04.192183 6271 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:08:04.192229 6271 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:08:04.193461 6271 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:08:04.193542 6271 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:08:04.193568 6271 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:08:04.193590 6271 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:08:04.193621 6271 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:08:04.195262 6271 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786435400844580-15507-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786435400844580-15507-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38477
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786435400844580-15507-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38477
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6271
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786435400844580-15507-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:08:04.195612 6271 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:08:04.195875 6271 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:08:04.201407 6278 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:04.201530 6271 server_base.cc:1034] running on GCE node
W20260811 08:08:04.201390 6277 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:04.201416 6280 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:04.201879 6271 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:08:04.202277 6271 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:08:04.203512 6271 hybrid_clock.cc:648] HybridClock initialized: now 1786435684203509 us; error 44 us; skew 500 ppm
Aug 11 08:08:04 dist-test-slave-2w3w krb5kdc[6252](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435684, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:08:04.209549 6271 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 08:08:04.210106 6271 webserver.cc:460] Webserver started at http://127.0.0.1:34517/ using document root <none> and password file <none>
I20260811 08:08:04.210363 6271 fs_manager.cc:359] Metadata directory not provided
I20260811 08:08:04.210443 6271 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:08:04.210599 6271 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:08:04.211825 6271 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786435400844580-15507-0/minicluster-data/master-0/data/instance:
uuid: "79e4cc4d82dd4bb58a96004e4307d020"
format_stamp: "Formatted at 2026-08-11 08:08:04 on dist-test-slave-2w3w"
server_key: "4d45031ab6d8db16c4890f05f9ec81e8"
server_key_iv: "4ceec351de20b82439d3787de792000c"
server_key_version: "encryptionkey@0"
I20260811 08:08:04.212206 6271 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786435400844580-15507-0/minicluster-data/master-0/wal/instance:
uuid: "79e4cc4d82dd4bb58a96004e4307d020"
format_stamp: "Formatted at 2026-08-11 08:08:04 on dist-test-slave-2w3w"
server_key: "4d45031ab6d8db16c4890f05f9ec81e8"
server_key_iv: "4ceec351de20b82439d3787de792000c"
server_key_version: "encryptionkey@0"
I20260811 08:08:04.213703 6271 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 08:08:04.214618 6289 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:04.214836 6271 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:08:04.214946 6271 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786435400844580-15507-0/minicluster-data/master-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786435400844580-15507-0/minicluster-data/master-0/wal
uuid: "79e4cc4d82dd4bb58a96004e4307d020"
format_stamp: "Formatted at 2026-08-11 08:08:04 on dist-test-slave-2w3w"
server_key: "4d45031ab6d8db16c4890f05f9ec81e8"
server_key_iv: "4ceec351de20b82439d3787de792000c"
server_key_version: "encryptionkey@0"
I20260811 08:08:04.215106 6271 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786435400844580-15507-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786435400844580-15507-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786435400844580-15507-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:08:04.225941 6271 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:08:04.228344 6271 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:08:04.228474 6271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:08:04.232692 6271 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38477
I20260811 08:08:04.232729 6348 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38477 every 8 connection(s)
I20260811 08:08:04.233146 6271 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
I20260811 08:08:04.233471 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 6271
I20260811 08:08:04.233597 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786435400844580-15507-0/minicluster-data/master-0/wal/instance
I20260811 08:08:04.233798 15507 external_mini_cluster.cc:1428] Setting key 676f29309cf2f13ceea3252fd3c6abc2
I20260811 08:08:04.234360 6349 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:08:04.237919 6349 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 79e4cc4d82dd4bb58a96004e4307d020: Bootstrap starting.
I20260811 08:08:04.238819 6349 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 79e4cc4d82dd4bb58a96004e4307d020: Neither blocks nor log segments found. Creating new log.
I20260811 08:08:04.239180 6349 log.cc:824] T 00000000000000000000000000000000 P 79e4cc4d82dd4bb58a96004e4307d020: Log is configured to *not* fsync() on all Append() calls
I20260811 08:08:04.239979 6349 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 79e4cc4d82dd4bb58a96004e4307d020: No bootstrap required, opened a new log
I20260811 08:08:04.240234 6353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:04.234353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56581 (local address 127.0.0.1:38477)
0811 08:08:04.234580 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:04.234589 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:04.234619 (+ 30us) server_negotiation.cc:407] Connection header received
0811 08:08:04.235263 (+ 644us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:04.235273 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:04.235339 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:04.235503 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:04.235712 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:04.237138 (+ 1426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:04.238014 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:04.238631 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:04.238759 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:04.239524 (+ 765us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:04.239528 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:04.239529 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:08:04.239705 (+ 176us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:04.239735 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:08:04.239747 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:04.239825 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:04.239959 (+ 134us) server_negotiation.cc:299] Negotiation successful
0811 08:08:04.240033 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":104,"threads_started":1}
I20260811 08:08:04.241258 15507 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:08:04.242220 6349 raft_consensus.cc:348] T 00000000000000000000000000000000 P 79e4cc4d82dd4bb58a96004e4307d020 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79e4cc4d82dd4bb58a96004e4307d020" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38477 } }
I20260811 08:08:04.242362 6349 raft_consensus.cc:374] T 00000000000000000000000000000000 P 79e4cc4d82dd4bb58a96004e4307d020 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:08:04.242386 6349 raft_consensus.cc:729] T 00000000000000000000000000000000 P 79e4cc4d82dd4bb58a96004e4307d020 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79e4cc4d82dd4bb58a96004e4307d020, State: Initialized, Role: FOLLOWER
I20260811 08:08:04.242542 6349 consensus_queue.cc:260] T 00000000000000000000000000000000 P 79e4cc4d82dd4bb58a96004e4307d020 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79e4cc4d82dd4bb58a96004e4307d020" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38477 } }
I20260811 08:08:04.242628 6349 raft_consensus.cc:388] T 00000000000000000000000000000000 P 79e4cc4d82dd4bb58a96004e4307d020 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:08:04.242679 6349 raft_consensus.cc:482] T 00000000000000000000000000000000 P 79e4cc4d82dd4bb58a96004e4307d020 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:08:04.242740 6349 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 79e4cc4d82dd4bb58a96004e4307d020 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:08:04.243522 6349 raft_consensus.cc:504] T 00000000000000000000000000000000 P 79e4cc4d82dd4bb58a96004e4307d020 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79e4cc4d82dd4bb58a96004e4307d020" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38477 } }
I20260811 08:08:04.243616 6349 leader_election.cc:302] T 00000000000000000000000000000000 P 79e4cc4d82dd4bb58a96004e4307d020 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 79e4cc4d82dd4bb58a96004e4307d020; no voters:
I20260811 08:08:04.243819 6349 leader_election.cc:288] T 00000000000000000000000000000000 P 79e4cc4d82dd4bb58a96004e4307d020 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:08:04.243888 6361 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 79e4cc4d82dd4bb58a96004e4307d020 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:08:04.244040 6361 raft_consensus.cc:686] T 00000000000000000000000000000000 P 79e4cc4d82dd4bb58a96004e4307d020 [term 1 LEADER]: Becoming Leader. State: Replica: 79e4cc4d82dd4bb58a96004e4307d020, State: Running, Role: LEADER
I20260811 08:08:04.244103 6349 sys_catalog.cc:564] T 00000000000000000000000000000000 P 79e4cc4d82dd4bb58a96004e4307d020 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:08:04.244226 6361 consensus_queue.cc:237] T 00000000000000000000000000000000 P 79e4cc4d82dd4bb58a96004e4307d020 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79e4cc4d82dd4bb58a96004e4307d020" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38477 } }
I20260811 08:08:04.244609 6361 sys_catalog.cc:455] T 00000000000000000000000000000000 P 79e4cc4d82dd4bb58a96004e4307d020 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 79e4cc4d82dd4bb58a96004e4307d020. Latest consensus state: current_term: 1 leader_uuid: "79e4cc4d82dd4bb58a96004e4307d020" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79e4cc4d82dd4bb58a96004e4307d020" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38477 } } }
I20260811 08:08:04.244853 6361 sys_catalog.cc:458] T 00000000000000000000000000000000 P 79e4cc4d82dd4bb58a96004e4307d020 [sys.catalog]: This master's current role is: LEADER
I20260811 08:08:04.244773 6363 sys_catalog.cc:455] T 00000000000000000000000000000000 P 79e4cc4d82dd4bb58a96004e4307d020 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "79e4cc4d82dd4bb58a96004e4307d020" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79e4cc4d82dd4bb58a96004e4307d020" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38477 } } }
I20260811 08:08:04.245121 6363 sys_catalog.cc:458] T 00000000000000000000000000000000 P 79e4cc4d82dd4bb58a96004e4307d020 [sys.catalog]: This master's current role is: LEADER
I20260811 08:08:04.245572 6370 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:08:04.246228 6353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:04.242587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55999 (local address 127.0.0.1:38477)
0811 08:08:04.242625 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:04.242627 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:04.242771 (+ 144us) server_negotiation.cc:407] Connection header received
0811 08:08:04.242854 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:04.242855 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:04.242864 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:04.242928 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:04.243097 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:04.243595 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:04.244648 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:04.244953 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:04.245046 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:04.245919 (+ 873us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:04.245920 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:04.245920 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:08:04.245932 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:04.245962 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:08:04.245968 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:04.246019 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:04.246111 (+ 92us) server_negotiation.cc:299] Negotiation successful
0811 08:08:04.246144 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 08:08:04.246500 6370 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:08:04.248268 6370 catalog_manager.cc:1347] Generated new cluster ID: ec53c448e75c400885fdf5d1bd8f7f99
I20260811 08:08:04.248350 6370 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:08:04.267938 6370 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:08:04.268553 6370 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:08:04.272702 6370 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 79e4cc4d82dd4bb58a96004e4307d020: Generated new TSK 0
I20260811 08:08:04.272902 6370 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:08:04.282142 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 6271
2026-08-11T08:08:04Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1438 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786435400844580-15507-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:08:04 dist-test-slave-2w3w krb5kdc[6384](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:08:04 dist-test-slave-2w3w krb5kdc[6384](info): set up 2 sockets
Aug 11 08:08:04 dist-test-slave-2w3w krb5kdc[6384](info): commencing operation
krb5kdc: starting...
W20260811 08:08:05.390722 15507 mini_kdc.cc:121] Time spent starting KDC: real 1.088s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Aug 11 08:08:05 dist-test-slave-2w3w krb5kdc[6384](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435685, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:08:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:08:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786435400844580-15507-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786435400844580-15507-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 08:08:05.523396 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786435400844580-15507-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786435400844580-15507-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786435400844580-15507-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36869
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786435400844580-15507-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36869
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:08:05.609309 6398 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:08:05.609575 6398 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:08:05.609622 6398 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:08:05.610848 6398 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:08:05.610926 6398 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:08:05.610951 6398 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:08:05.610973 6398 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:08:05.611057 6398 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:08:05.612615 6398 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786435400844580-15507-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786435400844580-15507-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36869
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786435400844580-15507-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36869
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6398
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786435400844580-15507-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:08:05.612974 6398 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:08:05.613219 6398 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:08:05.618474 6403 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:05.618614 6398 server_base.cc:1034] running on GCE node
W20260811 08:08:05.618495 6406 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:05.618515 6404 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:05.619263 6398 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:08:05.619624 6398 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:08:05.620848 6398 hybrid_clock.cc:648] HybridClock initialized: now 1786435685620833 us; error 39 us; skew 500 ppm
Aug 11 08:08:05 dist-test-slave-2w3w krb5kdc[6384](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435685, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:08:05.623663 6398 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 08:08:05.624198 6398 webserver.cc:460] Webserver started at http://127.0.0.1:43057/ using document root <none> and password file <none>
I20260811 08:08:05.624465 6398 fs_manager.cc:359] Metadata directory not provided
I20260811 08:08:05.624539 6398 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:08:05.624692 6398 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:08:05.625785 6398 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786435400844580-15507-0/minicluster-data/master-0/data/instance:
uuid: "a6e892c67d7546cb83fc5effd269d925"
format_stamp: "Formatted at 2026-08-11 08:08:05 on dist-test-slave-2w3w"
server_key: "2fb8a26485742946b1f4125fc2922c45"
server_key_iv: "dd90b8519ab6a3a38d1ba54f918d4ff5"
server_key_version: "encryptionkey@0"
I20260811 08:08:05.626175 6398 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786435400844580-15507-0/minicluster-data/master-0/wal/instance:
uuid: "a6e892c67d7546cb83fc5effd269d925"
format_stamp: "Formatted at 2026-08-11 08:08:05 on dist-test-slave-2w3w"
server_key: "2fb8a26485742946b1f4125fc2922c45"
server_key_iv: "dd90b8519ab6a3a38d1ba54f918d4ff5"
server_key_version: "encryptionkey@0"
I20260811 08:08:05.627681 6398 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 08:08:05.628607 6414 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:05.628867 6398 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:08:05.628989 6398 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786435400844580-15507-0/minicluster-data/master-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786435400844580-15507-0/minicluster-data/master-0/wal
uuid: "a6e892c67d7546cb83fc5effd269d925"
format_stamp: "Formatted at 2026-08-11 08:08:05 on dist-test-slave-2w3w"
server_key: "2fb8a26485742946b1f4125fc2922c45"
server_key_iv: "dd90b8519ab6a3a38d1ba54f918d4ff5"
server_key_version: "encryptionkey@0"
I20260811 08:08:05.629068 6398 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786435400844580-15507-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786435400844580-15507-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786435400844580-15507-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:08:05.632591 6398 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:08:05.634676 6398 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:08:05.634855 6398 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:08:05.639364 6398 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36869
I20260811 08:08:05.639398 6472 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36869 every 8 connection(s)
I20260811 08:08:05.639765 6398 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
I20260811 08:08:05.640671 6473 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:08:05.643121 6473 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a6e892c67d7546cb83fc5effd269d925: Bootstrap starting.
I20260811 08:08:05.643682 6473 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a6e892c67d7546cb83fc5effd269d925: Neither blocks nor log segments found. Creating new log.
I20260811 08:08:05.643944 6473 log.cc:824] T 00000000000000000000000000000000 P a6e892c67d7546cb83fc5effd269d925: Log is configured to *not* fsync() on all Append() calls
I20260811 08:08:05.644696 6473 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a6e892c67d7546cb83fc5effd269d925: No bootstrap required, opened a new log
I20260811 08:08:05.646404 6473 raft_consensus.cc:348] T 00000000000000000000000000000000 P a6e892c67d7546cb83fc5effd269d925 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6e892c67d7546cb83fc5effd269d925" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36869 } }
I20260811 08:08:05.646554 6473 raft_consensus.cc:374] T 00000000000000000000000000000000 P a6e892c67d7546cb83fc5effd269d925 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:08:05.646579 6473 raft_consensus.cc:729] T 00000000000000000000000000000000 P a6e892c67d7546cb83fc5effd269d925 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6e892c67d7546cb83fc5effd269d925, State: Initialized, Role: FOLLOWER
I20260811 08:08:05.646759 6473 consensus_queue.cc:260] T 00000000000000000000000000000000 P a6e892c67d7546cb83fc5effd269d925 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6e892c67d7546cb83fc5effd269d925" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36869 } }
I20260811 08:08:05.646857 6473 raft_consensus.cc:388] T 00000000000000000000000000000000 P a6e892c67d7546cb83fc5effd269d925 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:08:05.646883 6473 raft_consensus.cc:482] T 00000000000000000000000000000000 P a6e892c67d7546cb83fc5effd269d925 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:08:05.646912 6473 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a6e892c67d7546cb83fc5effd269d925 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:08:05.647527 6473 raft_consensus.cc:504] T 00000000000000000000000000000000 P a6e892c67d7546cb83fc5effd269d925 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6e892c67d7546cb83fc5effd269d925" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36869 } }
I20260811 08:08:05.647619 6473 leader_election.cc:302] T 00000000000000000000000000000000 P a6e892c67d7546cb83fc5effd269d925 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a6e892c67d7546cb83fc5effd269d925; no voters:
I20260811 08:08:05.647751 6473 leader_election.cc:288] T 00000000000000000000000000000000 P a6e892c67d7546cb83fc5effd269d925 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:08:05.647830 6476 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a6e892c67d7546cb83fc5effd269d925 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:08:05.648017 6476 raft_consensus.cc:686] T 00000000000000000000000000000000 P a6e892c67d7546cb83fc5effd269d925 [term 1 LEADER]: Becoming Leader. State: Replica: a6e892c67d7546cb83fc5effd269d925, State: Running, Role: LEADER
I20260811 08:08:05.648074 6473 sys_catalog.cc:564] T 00000000000000000000000000000000 P a6e892c67d7546cb83fc5effd269d925 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:08:05.648160 6476 consensus_queue.cc:237] T 00000000000000000000000000000000 P a6e892c67d7546cb83fc5effd269d925 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6e892c67d7546cb83fc5effd269d925" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36869 } }
I20260811 08:08:05.648600 6478 sys_catalog.cc:455] T 00000000000000000000000000000000 P a6e892c67d7546cb83fc5effd269d925 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a6e892c67d7546cb83fc5effd269d925" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6e892c67d7546cb83fc5effd269d925" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36869 } } }
I20260811 08:08:05.648629 6479 sys_catalog.cc:455] T 00000000000000000000000000000000 P a6e892c67d7546cb83fc5effd269d925 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a6e892c67d7546cb83fc5effd269d925. Latest consensus state: current_term: 1 leader_uuid: "a6e892c67d7546cb83fc5effd269d925" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6e892c67d7546cb83fc5effd269d925" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36869 } } }
I20260811 08:08:05.648725 6478 sys_catalog.cc:458] T 00000000000000000000000000000000 P a6e892c67d7546cb83fc5effd269d925 [sys.catalog]: This master's current role is: LEADER
I20260811 08:08:05.648736 6479 sys_catalog.cc:458] T 00000000000000000000000000000000 P a6e892c67d7546cb83fc5effd269d925 [sys.catalog]: This master's current role is: LEADER
I20260811 08:08:05.648944 6481 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:08:05.649405 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 6398
I20260811 08:08:05.649552 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786435400844580-15507-0/minicluster-data/master-0/wal/instance
I20260811 08:08:05.649789 15507 external_mini_cluster.cc:1428] Setting key 0592884eaf5e036c9bde3875e8b8066f
I20260811 08:08:05.650307 6481 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:08:05.652470 6496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:05.650346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52073 (local address 127.0.0.1:36869)
0811 08:08:05.650741 (+ 395us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:05.650751 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:05.650782 (+ 31us) server_negotiation.cc:407] Connection header received
0811 08:08:05.651060 (+ 278us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:05.651068 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:05.651101 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:05.651248 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:05.652042 (+ 794us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:05.652046 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:05.652047 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:08:05.652051 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:05.652101 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:08:05.652113 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:05.652184 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:05.652259 (+ 75us) server_negotiation.cc:299] Negotiation successful
0811 08:08:05.652304 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":339,"thread_start_us":77,"threads_started":1}
I20260811 08:08:05.652621 6481 catalog_manager.cc:1347] Generated new cluster ID: 115322809953430d876f7377cb63ea47
I20260811 08:08:05.652686 6481 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:08:05.653682 15507 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:08:05.656481 6496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:05.655199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49943 (local address 127.0.0.1:36869)
0811 08:08:05.655238 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:05.655240 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:05.655467 (+ 227us) server_negotiation.cc:407] Connection header received
0811 08:08:05.655529 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:05.655530 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:05.655536 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:05.655582 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:05.656258 (+ 676us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:05.656260 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:05.656260 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:08:05.656264 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:05.656280 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:08:05.656285 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:05.656337 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:05.656393 (+ 56us) server_negotiation.cc:299] Negotiation successful
0811 08:08:05.656408 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 08:08:05.676777 6481 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:08:05.677047 6481 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:08:05.685034 6481 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a6e892c67d7546cb83fc5effd269d925: Generated new TSK 0
I20260811 08:08:05.685297 6481 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:08:05.692916 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 6398
2026-08-11T08:08:05Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1412 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786435400844580-15507-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:08:05 dist-test-slave-2w3w krb5kdc[6509](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:08:05 dist-test-slave-2w3w krb5kdc[6509](info): set up 2 sockets
Aug 11 08:08:05 dist-test-slave-2w3w krb5kdc[6509](info): commencing operation
krb5kdc: starting...
W20260811 08:08:06.799831 15507 mini_kdc.cc:121] Time spent starting KDC: real 1.085s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Aug 11 08:08:06 dist-test-slave-2w3w krb5kdc[6509](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435686, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:08:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:08:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786435400844580-15507-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786435400844580-15507-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 08:08:06.935134 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786435400844580-15507-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786435400844580-15507-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786435400844580-15507-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40583
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786435400844580-15507-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:32921
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40583
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:08:07.021521 6522 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:08:07.021745 6522 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:08:07.021770 6522 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:08:07.022873 6522 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:08:07.022910 6522 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:08:07.022925 6522 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:08:07.022938 6522 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:08:07.022951 6522 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:08:07.024490 6522 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:32921
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786435400844580-15507-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786435400844580-15507-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40583
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786435400844580-15507-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40583
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6522
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786435400844580-15507-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:08:07.024693 6522 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:08:07.024871 6522 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:08:07.029978 6532 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:07.029973 6534 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:07.029986 6531 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:07.030100 6522 server_base.cc:1034] running on GCE node
I20260811 08:08:07.030464 6522 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:08:07.030797 6522 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:08:07.031971 6522 hybrid_clock.cc:648] HybridClock initialized: now 1786435687031960 us; error 33 us; skew 500 ppm
Aug 11 08:08:07 dist-test-slave-2w3w krb5kdc[6509](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435687, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:08:07.034740 6522 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 08:08:07.035318 6522 webserver.cc:460] Webserver started at http://127.0.0.1:33597/ using document root <none> and password file <none>
I20260811 08:08:07.035570 6522 fs_manager.cc:359] Metadata directory not provided
I20260811 08:08:07.035619 6522 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:08:07.035774 6522 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:08:07.036936 6522 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786435400844580-15507-0/minicluster-data/master-0/data/instance:
uuid: "e4aed47f8cbf446d9c1c296d54f53b05"
format_stamp: "Formatted at 2026-08-11 08:08:07 on dist-test-slave-2w3w"
server_key: "f053c2d9f303709374c2e97afea5b3e4"
server_key_iv: "4d83962cbfd8bdaa5c7f99148ff75cec"
server_key_version: "encryptionkey@0"
I20260811 08:08:07.037308 6522 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786435400844580-15507-0/minicluster-data/master-0/wal/instance:
uuid: "e4aed47f8cbf446d9c1c296d54f53b05"
format_stamp: "Formatted at 2026-08-11 08:08:07 on dist-test-slave-2w3w"
server_key: "f053c2d9f303709374c2e97afea5b3e4"
server_key_iv: "4d83962cbfd8bdaa5c7f99148ff75cec"
server_key_version: "encryptionkey@0"
I20260811 08:08:07.039038 6522 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20260811 08:08:07.039848 6542 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:07.040038 6522 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:08:07.040155 6522 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786435400844580-15507-0/minicluster-data/master-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786435400844580-15507-0/minicluster-data/master-0/wal
uuid: "e4aed47f8cbf446d9c1c296d54f53b05"
format_stamp: "Formatted at 2026-08-11 08:08:07 on dist-test-slave-2w3w"
server_key: "f053c2d9f303709374c2e97afea5b3e4"
server_key_iv: "4d83962cbfd8bdaa5c7f99148ff75cec"
server_key_version: "encryptionkey@0"
I20260811 08:08:07.040236 6522 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786435400844580-15507-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786435400844580-15507-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786435400844580-15507-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:08:07.050393 6522 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:08:07.056835 6522 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:08:07.057015 6522 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:08:07.061496 6522 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40583
I20260811 08:08:07.061538 6596 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40583 every 8 connection(s)
I20260811 08:08:07.061913 6522 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
I20260811 08:08:07.062892 6597 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:08:07.065299 6597 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e4aed47f8cbf446d9c1c296d54f53b05: Bootstrap starting.
I20260811 08:08:07.065914 6597 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e4aed47f8cbf446d9c1c296d54f53b05: Neither blocks nor log segments found. Creating new log.
I20260811 08:08:07.066210 6597 log.cc:824] T 00000000000000000000000000000000 P e4aed47f8cbf446d9c1c296d54f53b05: Log is configured to *not* fsync() on all Append() calls
I20260811 08:08:07.067025 6597 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e4aed47f8cbf446d9c1c296d54f53b05: No bootstrap required, opened a new log
I20260811 08:08:07.068655 6597 raft_consensus.cc:348] T 00000000000000000000000000000000 P e4aed47f8cbf446d9c1c296d54f53b05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4aed47f8cbf446d9c1c296d54f53b05" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40583 } }
I20260811 08:08:07.068797 6597 raft_consensus.cc:374] T 00000000000000000000000000000000 P e4aed47f8cbf446d9c1c296d54f53b05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:08:07.068830 6597 raft_consensus.cc:729] T 00000000000000000000000000000000 P e4aed47f8cbf446d9c1c296d54f53b05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4aed47f8cbf446d9c1c296d54f53b05, State: Initialized, Role: FOLLOWER
I20260811 08:08:07.069008 6597 consensus_queue.cc:260] T 00000000000000000000000000000000 P e4aed47f8cbf446d9c1c296d54f53b05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4aed47f8cbf446d9c1c296d54f53b05" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40583 } }
I20260811 08:08:07.069067 6597 raft_consensus.cc:388] T 00000000000000000000000000000000 P e4aed47f8cbf446d9c1c296d54f53b05 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:08:07.069111 6597 raft_consensus.cc:482] T 00000000000000000000000000000000 P e4aed47f8cbf446d9c1c296d54f53b05 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:08:07.069164 6597 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e4aed47f8cbf446d9c1c296d54f53b05 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:08:07.069734 6597 raft_consensus.cc:504] T 00000000000000000000000000000000 P e4aed47f8cbf446d9c1c296d54f53b05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4aed47f8cbf446d9c1c296d54f53b05" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40583 } }
I20260811 08:08:07.069837 6597 leader_election.cc:302] T 00000000000000000000000000000000 P e4aed47f8cbf446d9c1c296d54f53b05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e4aed47f8cbf446d9c1c296d54f53b05; no voters:
I20260811 08:08:07.070070 6597 leader_election.cc:288] T 00000000000000000000000000000000 P e4aed47f8cbf446d9c1c296d54f53b05 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:08:07.070156 6601 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e4aed47f8cbf446d9c1c296d54f53b05 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:08:07.070343 6601 raft_consensus.cc:686] T 00000000000000000000000000000000 P e4aed47f8cbf446d9c1c296d54f53b05 [term 1 LEADER]: Becoming Leader. State: Replica: e4aed47f8cbf446d9c1c296d54f53b05, State: Running, Role: LEADER
I20260811 08:08:07.070360 6597 sys_catalog.cc:564] T 00000000000000000000000000000000 P e4aed47f8cbf446d9c1c296d54f53b05 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:08:07.070473 6601 consensus_queue.cc:237] T 00000000000000000000000000000000 P e4aed47f8cbf446d9c1c296d54f53b05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4aed47f8cbf446d9c1c296d54f53b05" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40583 } }
I20260811 08:08:07.071230 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 6522
I20260811 08:08:07.071380 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786435400844580-15507-0/minicluster-data/master-0/wal/instance
I20260811 08:08:07.071650 15507 external_mini_cluster.cc:1428] Setting key da79e8f3d9295ab95ee8c350d48f99ce
I20260811 08:08:07.071625 6603 sys_catalog.cc:455] T 00000000000000000000000000000000 P e4aed47f8cbf446d9c1c296d54f53b05 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e4aed47f8cbf446d9c1c296d54f53b05. Latest consensus state: current_term: 1 leader_uuid: "e4aed47f8cbf446d9c1c296d54f53b05" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4aed47f8cbf446d9c1c296d54f53b05" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40583 } } }
I20260811 08:08:07.071758 6603 sys_catalog.cc:458] T 00000000000000000000000000000000 P e4aed47f8cbf446d9c1c296d54f53b05 [sys.catalog]: This master's current role is: LEADER
I20260811 08:08:07.072081 6602 sys_catalog.cc:455] T 00000000000000000000000000000000 P e4aed47f8cbf446d9c1c296d54f53b05 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e4aed47f8cbf446d9c1c296d54f53b05" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4aed47f8cbf446d9c1c296d54f53b05" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40583 } } }
I20260811 08:08:07.072232 6602 sys_catalog.cc:458] T 00000000000000000000000000000000 P e4aed47f8cbf446d9c1c296d54f53b05 [sys.catalog]: This master's current role is: LEADER
W20260811 08:08:07.072459 6619 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e4aed47f8cbf446d9c1c296d54f53b05: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 08:08:07.072510 6619 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 08:08:07.073278 6618 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:08:07.073491 6618 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:08:07.075100 6618 catalog_manager.cc:1347] Generated new cluster ID: df3d3806b1b6474480e349bf5c0236e8
I20260811 08:08:07.075155 6618 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 08:08:07 dist-test-slave-2w3w krb5kdc[6509](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435686, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 08:08:07.082890 6618 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:08:07.083617 6618 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:08:07.084525 6622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:07.072357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.84:48923 (local address 127.0.0.1:40583)
0811 08:08:07.072797 (+ 440us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:07.072805 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:07.072829 (+ 24us) server_negotiation.cc:407] Connection header received
0811 08:08:07.072923 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:07.072928 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:07.072975 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:07.073116 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:07.073927 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:07.075421 (+ 1494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:07.076529 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:07.077202 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:07.077323 (+ 121us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:07.080274 (+ 2951us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:07.080279 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:07.080279 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:07.080293 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:07.082456 (+ 2163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:07.083023 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:07.083026 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:07.083027 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:07.083138 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:07.083428 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:07.083429 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:07.083429 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:07.083727 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:07.083901 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:07.084031 (+ 130us) server_negotiation.cc:299] Negotiation successful
0811 08:08:07.084255 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":397,"thread_start_us":86,"threads_started":1}
I20260811 08:08:07.085346 15507 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:08:07.087641 6618 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e4aed47f8cbf446d9c1c296d54f53b05: Generated new TSK 0
I20260811 08:08:07.087834 6618 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:08:07.094839 6622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:07.086861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.84:48041 (local address 127.0.0.1:40583)
0811 08:08:07.086896 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:07.086898 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:07.087171 (+ 273us) server_negotiation.cc:407] Connection header received
0811 08:08:07.087408 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:07.087409 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:07.087421 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:07.087477 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:07.088226 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:07.089110 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:07.089914 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:07.090334 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:07.090423 (+ 89us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:07.091914 (+ 1491us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:07.091915 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:07.091916 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:07.091923 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:07.093568 (+ 1645us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:07.093975 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:07.093976 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:07.093976 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:07.094039 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:07.094295 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:07.094295 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:07.094296 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:07.094439 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:07.094547 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:07.094653 (+ 106us) server_negotiation.cc:299] Negotiation successful
0811 08:08:07.094738 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260811 08:08:07.097046 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 6522
W20260811 08:08:07.105198 6507 connection.cc:535] client connection to 127.0.0.1:40583 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40583): Connection reset by peer (error 104)
2026-08-11T08:08:07Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1404 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786435400844580-15507-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:08:07 dist-test-slave-2w3w krb5kdc[6631](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:08:07 dist-test-slave-2w3w krb5kdc[6631](info): set up 2 sockets
Aug 11 08:08:07 dist-test-slave-2w3w krb5kdc[6631](info): commencing operation
krb5kdc: starting...
W20260811 08:08:08.220252 15507 mini_kdc.cc:121] Time spent starting KDC: real 1.101s user 0.004s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Aug 11 08:08:08 dist-test-slave-2w3w krb5kdc[6631](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435688, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:08:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:08:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786435400844580-15507-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786435400844580-15507-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 08:08:08.354557 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786435400844580-15507-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786435400844580-15507-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786435400844580-15507-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41551
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786435400844580-15507-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35563
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41551
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:08:08.439342 6644 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:08:08.439632 6644 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:08:08.439678 6644 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:08:08.440893 6644 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:08:08.440977 6644 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:08:08.441004 6644 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:08:08.441030 6644 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:08:08.441061 6644 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:08:08.442616 6644 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35563
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786435400844580-15507-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786435400844580-15507-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41551
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786435400844580-15507-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41551
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6644
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786435400844580-15507-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:08:08.442920 6644 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:08:08.443179 6644 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:08:08.448350 6650 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:08.448339 6653 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:08.448410 6651 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:08.448730 6644 server_base.cc:1034] running on GCE node
I20260811 08:08:08.449023 6644 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:08:08.449373 6644 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:08:08.450551 6644 hybrid_clock.cc:648] HybridClock initialized: now 1786435688450533 us; error 51 us; skew 500 ppm
Aug 11 08:08:08 dist-test-slave-2w3w krb5kdc[6631](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435688, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:08:08.453318 6644 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 08:08:08.453787 6644 webserver.cc:460] Webserver started at http://127.0.0.1:42811/ using document root <none> and password file <none>
I20260811 08:08:08.454032 6644 fs_manager.cc:359] Metadata directory not provided
I20260811 08:08:08.454109 6644 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:08:08.454273 6644 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:08:08.455519 6644 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786435400844580-15507-0/minicluster-data/master-0/data/instance:
uuid: "59e0f68e40584925b8920be551eaa0e6"
format_stamp: "Formatted at 2026-08-11 08:08:08 on dist-test-slave-2w3w"
server_key: "91682c824b89c7a80a2b110800aa4ef4"
server_key_iv: "a757deab0d087150903367d904c00005"
server_key_version: "encryptionkey@0"
I20260811 08:08:08.455911 6644 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786435400844580-15507-0/minicluster-data/master-0/wal/instance:
uuid: "59e0f68e40584925b8920be551eaa0e6"
format_stamp: "Formatted at 2026-08-11 08:08:08 on dist-test-slave-2w3w"
server_key: "91682c824b89c7a80a2b110800aa4ef4"
server_key_iv: "a757deab0d087150903367d904c00005"
server_key_version: "encryptionkey@0"
I20260811 08:08:08.457324 6644 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260811 08:08:08.458184 6660 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:08.458372 6644 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:08:08.458485 6644 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786435400844580-15507-0/minicluster-data/master-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786435400844580-15507-0/minicluster-data/master-0/wal
uuid: "59e0f68e40584925b8920be551eaa0e6"
format_stamp: "Formatted at 2026-08-11 08:08:08 on dist-test-slave-2w3w"
server_key: "91682c824b89c7a80a2b110800aa4ef4"
server_key_iv: "a757deab0d087150903367d904c00005"
server_key_version: "encryptionkey@0"
I20260811 08:08:08.458565 6644 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786435400844580-15507-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786435400844580-15507-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786435400844580-15507-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:08:08.473165 6644 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:08:08.475478 6644 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:08:08.475689 6644 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:08:08.479914 6644 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41551
I20260811 08:08:08.479950 6719 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41551 every 8 connection(s)
I20260811 08:08:08.480333 6644 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
I20260811 08:08:08.480656 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 6644
I20260811 08:08:08.480796 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786435400844580-15507-0/minicluster-data/master-0/wal/instance
I20260811 08:08:08.481119 15507 external_mini_cluster.cc:1428] Setting key bb4206a861a3ed8220013b222a8064de
I20260811 08:08:08.481488 6720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:08:08.484556 6720 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 59e0f68e40584925b8920be551eaa0e6: Bootstrap starting.
I20260811 08:08:08.485198 6720 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 59e0f68e40584925b8920be551eaa0e6: Neither blocks nor log segments found. Creating new log.
I20260811 08:08:08.485574 6720 log.cc:824] T 00000000000000000000000000000000 P 59e0f68e40584925b8920be551eaa0e6: Log is configured to *not* fsync() on all Append() calls
I20260811 08:08:08.486315 6720 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 59e0f68e40584925b8920be551eaa0e6: No bootstrap required, opened a new log
I20260811 08:08:08.487083 6723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:08.481672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.84:40409 (local address 127.0.0.1:41551)
0811 08:08:08.481897 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:08.481907 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:08.481946 (+ 39us) server_negotiation.cc:407] Connection header received
0811 08:08:08.482625 (+ 679us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:08.482633 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:08.482687 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:08.482841 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:08.483085 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:08.484009 (+ 924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:08.484898 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:08.485431 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:08.485558 (+ 127us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:08.486355 (+ 797us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:08.486360 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:08.486360 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:08:08.486579 (+ 219us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:08.486610 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:08:08.486622 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:08.486718 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:08.486803 (+ 85us) server_negotiation.cc:299] Negotiation successful
0811 08:08:08.486833 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":99,"threads_started":1}
I20260811 08:08:08.488273 15507 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:08:08.488859 6720 raft_consensus.cc:348] T 00000000000000000000000000000000 P 59e0f68e40584925b8920be551eaa0e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59e0f68e40584925b8920be551eaa0e6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41551 } }
I20260811 08:08:08.489050 6720 raft_consensus.cc:374] T 00000000000000000000000000000000 P 59e0f68e40584925b8920be551eaa0e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:08:08.489086 6720 raft_consensus.cc:729] T 00000000000000000000000000000000 P 59e0f68e40584925b8920be551eaa0e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59e0f68e40584925b8920be551eaa0e6, State: Initialized, Role: FOLLOWER
I20260811 08:08:08.489212 6720 consensus_queue.cc:260] T 00000000000000000000000000000000 P 59e0f68e40584925b8920be551eaa0e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59e0f68e40584925b8920be551eaa0e6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41551 } }
I20260811 08:08:08.489289 6720 raft_consensus.cc:388] T 00000000000000000000000000000000 P 59e0f68e40584925b8920be551eaa0e6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:08:08.489336 6720 raft_consensus.cc:482] T 00000000000000000000000000000000 P 59e0f68e40584925b8920be551eaa0e6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:08:08.489390 6720 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 59e0f68e40584925b8920be551eaa0e6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:08:08.490278 6720 raft_consensus.cc:504] T 00000000000000000000000000000000 P 59e0f68e40584925b8920be551eaa0e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59e0f68e40584925b8920be551eaa0e6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41551 } }
I20260811 08:08:08.490417 6720 leader_election.cc:302] T 00000000000000000000000000000000 P 59e0f68e40584925b8920be551eaa0e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 59e0f68e40584925b8920be551eaa0e6; no voters:
I20260811 08:08:08.490587 6720 leader_election.cc:288] T 00000000000000000000000000000000 P 59e0f68e40584925b8920be551eaa0e6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:08:08.490621 6731 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 59e0f68e40584925b8920be551eaa0e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:08:08.490744 6731 raft_consensus.cc:686] T 00000000000000000000000000000000 P 59e0f68e40584925b8920be551eaa0e6 [term 1 LEADER]: Becoming Leader. State: Replica: 59e0f68e40584925b8920be551eaa0e6, State: Running, Role: LEADER
I20260811 08:08:08.490862 6720 sys_catalog.cc:564] T 00000000000000000000000000000000 P 59e0f68e40584925b8920be551eaa0e6 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:08:08.490898 6731 consensus_queue.cc:237] T 00000000000000000000000000000000 P 59e0f68e40584925b8920be551eaa0e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59e0f68e40584925b8920be551eaa0e6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41551 } }
I20260811 08:08:08.491305 6732 sys_catalog.cc:455] T 00000000000000000000000000000000 P 59e0f68e40584925b8920be551eaa0e6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "59e0f68e40584925b8920be551eaa0e6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59e0f68e40584925b8920be551eaa0e6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41551 } } }
I20260811 08:08:08.491418 6732 sys_catalog.cc:458] T 00000000000000000000000000000000 P 59e0f68e40584925b8920be551eaa0e6 [sys.catalog]: This master's current role is: LEADER
I20260811 08:08:08.491291 6731 sys_catalog.cc:455] T 00000000000000000000000000000000 P 59e0f68e40584925b8920be551eaa0e6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 59e0f68e40584925b8920be551eaa0e6. Latest consensus state: current_term: 1 leader_uuid: "59e0f68e40584925b8920be551eaa0e6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59e0f68e40584925b8920be551eaa0e6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41551 } } }
I20260811 08:08:08.491627 6731 sys_catalog.cc:458] T 00000000000000000000000000000000 P 59e0f68e40584925b8920be551eaa0e6 [sys.catalog]: This master's current role is: LEADER
W20260811 08:08:08.492981 6748 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 59e0f68e40584925b8920be551eaa0e6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 08:08:08.493312 6748 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 08:08:08.493404 6737 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:08:08.493602 6737 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:08:08.493709 6723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:08.489902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.84:47751 (local address 127.0.0.1:41551)
0811 08:08:08.489951 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:08.489953 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:08.490054 (+ 101us) server_negotiation.cc:407] Connection header received
0811 08:08:08.490128 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:08.490129 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:08.490137 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:08.490186 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:08.490329 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:08.491061 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:08.492118 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:08.492432 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:08.492501 (+ 69us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:08.493386 (+ 885us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:08.493387 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:08.493388 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:08:08.493393 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:08.493409 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:08:08.493413 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:08.493468 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:08.493611 (+ 143us) server_negotiation.cc:299] Negotiation successful
0811 08:08:08.493623 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 08:08:08.495087 6737 catalog_manager.cc:1347] Generated new cluster ID: a2b0b11e2534499e95c5e82d5f4ea8ed
I20260811 08:08:08.495142 6737 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:08:08.505959 6737 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:08:08.506536 6737 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:08:08.509657 6737 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 59e0f68e40584925b8920be551eaa0e6: Generated new TSK 0
I20260811 08:08:08.509867 6737 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:08:08.513219 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 6644
W20260811 08:08:08.520045 6629 connection.cc:535] client connection to 127.0.0.1:41551 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41551): Connection reset by peer (error 104)
2026-08-11T08:08:08Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1414 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786435400844580-15507-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:08:08 dist-test-slave-2w3w krb5kdc[6753](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:08:08 dist-test-slave-2w3w krb5kdc[6753](info): set up 2 sockets
Aug 11 08:08:08 dist-test-slave-2w3w krb5kdc[6753](info): commencing operation
krb5kdc: starting...
W20260811 08:08:09.645643 15507 mini_kdc.cc:121] Time spent starting KDC: real 1.111s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Aug 11 08:08:09 dist-test-slave-2w3w krb5kdc[6753](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435689, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:08:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:08:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786435400844580-15507-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786435400844580-15507-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 08:08:09.783337 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786435400844580-15507-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786435400844580-15507-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786435400844580-15507-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35245
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786435400844580-15507-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39153
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35245
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:08:09.867878 6766 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:08:09.868160 6766 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:08:09.868201 6766 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:08:09.869397 6766 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:08:09.869481 6766 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:08:09.869508 6766 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:08:09.869536 6766 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:08:09.869565 6766 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:08:09.871126 6766 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39153
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786435400844580-15507-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786435400844580-15507-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35245
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786435400844580-15507-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35245
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6766
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786435400844580-15507-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:08:09.871433 6766 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:08:09.871677 6766 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:08:09.876842 6772 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:09.876894 6766 server_base.cc:1034] running on GCE node
W20260811 08:08:09.876837 6773 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:09.876900 6775 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:09.877460 6766 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:08:09.877727 6766 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:08:09.879004 6766 hybrid_clock.cc:648] HybridClock initialized: now 1786435689878963 us; error 59 us; skew 500 ppm
Aug 11 08:08:09 dist-test-slave-2w3w krb5kdc[6753](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435689, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:08:09.887434 6766 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 08:08:09.887975 6766 webserver.cc:460] Webserver started at http://127.0.0.1:36033/ using document root <none> and password file <none>
I20260811 08:08:09.888267 6766 fs_manager.cc:359] Metadata directory not provided
I20260811 08:08:09.888350 6766 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:08:09.888516 6766 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:08:09.889847 6766 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786435400844580-15507-0/minicluster-data/master-0/data/instance:
uuid: "4e2c10e082474b0297aac2f14c3df3e7"
format_stamp: "Formatted at 2026-08-11 08:08:09 on dist-test-slave-2w3w"
server_key: "4d7b1ca5c79918b335ed9a1bd4286615"
server_key_iv: "118170786bca01fa5ae2dda46460d511"
server_key_version: "encryptionkey@0"
I20260811 08:08:09.890265 6766 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786435400844580-15507-0/minicluster-data/master-0/wal/instance:
uuid: "4e2c10e082474b0297aac2f14c3df3e7"
format_stamp: "Formatted at 2026-08-11 08:08:09 on dist-test-slave-2w3w"
server_key: "4d7b1ca5c79918b335ed9a1bd4286615"
server_key_iv: "118170786bca01fa5ae2dda46460d511"
server_key_version: "encryptionkey@0"
I20260811 08:08:09.891889 6766 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.004s
I20260811 08:08:09.892808 6782 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:09.893047 6766 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:08:09.893150 6766 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786435400844580-15507-0/minicluster-data/master-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786435400844580-15507-0/minicluster-data/master-0/wal
uuid: "4e2c10e082474b0297aac2f14c3df3e7"
format_stamp: "Formatted at 2026-08-11 08:08:09 on dist-test-slave-2w3w"
server_key: "4d7b1ca5c79918b335ed9a1bd4286615"
server_key_iv: "118170786bca01fa5ae2dda46460d511"
server_key_version: "encryptionkey@0"
I20260811 08:08:09.893211 6766 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786435400844580-15507-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786435400844580-15507-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786435400844580-15507-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:08:09.896672 6766 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:08:09.898860 6766 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:08:09.899056 6766 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:08:09.902940 6766 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35245
I20260811 08:08:09.903038 6840 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35245 every 8 connection(s)
I20260811 08:08:09.903411 6766 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
I20260811 08:08:09.904363 6841 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:08:09.906659 6841 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4e2c10e082474b0297aac2f14c3df3e7: Bootstrap starting.
I20260811 08:08:09.907357 6841 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4e2c10e082474b0297aac2f14c3df3e7: Neither blocks nor log segments found. Creating new log.
I20260811 08:08:09.907646 6841 log.cc:824] T 00000000000000000000000000000000 P 4e2c10e082474b0297aac2f14c3df3e7: Log is configured to *not* fsync() on all Append() calls
I20260811 08:08:09.908420 6841 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4e2c10e082474b0297aac2f14c3df3e7: No bootstrap required, opened a new log
I20260811 08:08:09.909585 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 6766
I20260811 08:08:09.909740 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786435400844580-15507-0/minicluster-data/master-0/wal/instance
I20260811 08:08:09.909982 15507 external_mini_cluster.cc:1428] Setting key 6751368fedb332991fc7b031fe024c3f
I20260811 08:08:09.910310 6841 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4e2c10e082474b0297aac2f14c3df3e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e2c10e082474b0297aac2f14c3df3e7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35245 } }
I20260811 08:08:09.910491 6841 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4e2c10e082474b0297aac2f14c3df3e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:08:09.910528 6841 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4e2c10e082474b0297aac2f14c3df3e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e2c10e082474b0297aac2f14c3df3e7, State: Initialized, Role: FOLLOWER
I20260811 08:08:09.910655 6841 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4e2c10e082474b0297aac2f14c3df3e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e2c10e082474b0297aac2f14c3df3e7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35245 } }
I20260811 08:08:09.910776 6841 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4e2c10e082474b0297aac2f14c3df3e7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:08:09.910823 6841 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4e2c10e082474b0297aac2f14c3df3e7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:08:09.910876 6841 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4e2c10e082474b0297aac2f14c3df3e7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:08:09.912125 6841 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4e2c10e082474b0297aac2f14c3df3e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e2c10e082474b0297aac2f14c3df3e7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35245 } }
I20260811 08:08:09.912248 6841 leader_election.cc:302] T 00000000000000000000000000000000 P 4e2c10e082474b0297aac2f14c3df3e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4e2c10e082474b0297aac2f14c3df3e7; no voters:
I20260811 08:08:09.912449 6841 leader_election.cc:288] T 00000000000000000000000000000000 P 4e2c10e082474b0297aac2f14c3df3e7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:08:09.912472 6847 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4e2c10e082474b0297aac2f14c3df3e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:08:09.912647 6847 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4e2c10e082474b0297aac2f14c3df3e7 [term 1 LEADER]: Becoming Leader. State: Replica: 4e2c10e082474b0297aac2f14c3df3e7, State: Running, Role: LEADER
I20260811 08:08:09.912729 6846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:09.910586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.84:43885 (local address 127.0.0.1:35245)
0811 08:08:09.910797 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:09.910818 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:09.910855 (+ 37us) server_negotiation.cc:407] Connection header received
0811 08:08:09.911059 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:09.911067 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:09.911108 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:09.911286 (+ 178us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:09.912094 (+ 808us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:09.912099 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:09.912099 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:08:09.912104 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:09.912157 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:08:09.912172 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:09.912256 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:09.912389 (+ 133us) server_negotiation.cc:299] Negotiation successful
0811 08:08:09.912441 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":104,"threads_started":1}
I20260811 08:08:09.912783 6841 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4e2c10e082474b0297aac2f14c3df3e7 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:08:09.912789 6847 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4e2c10e082474b0297aac2f14c3df3e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e2c10e082474b0297aac2f14c3df3e7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35245 } }
I20260811 08:08:09.913475 6848 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4e2c10e082474b0297aac2f14c3df3e7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4e2c10e082474b0297aac2f14c3df3e7. Latest consensus state: current_term: 1 leader_uuid: "4e2c10e082474b0297aac2f14c3df3e7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e2c10e082474b0297aac2f14c3df3e7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35245 } } }
I20260811 08:08:09.913570 6848 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4e2c10e082474b0297aac2f14c3df3e7 [sys.catalog]: This master's current role is: LEADER
I20260811 08:08:09.913931 6849 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4e2c10e082474b0297aac2f14c3df3e7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4e2c10e082474b0297aac2f14c3df3e7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e2c10e082474b0297aac2f14c3df3e7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35245 } } }
I20260811 08:08:09.913971 15507 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:08:09.914016 6849 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4e2c10e082474b0297aac2f14c3df3e7 [sys.catalog]: This master's current role is: LEADER
I20260811 08:08:09.914136 6856 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:08:09.914744 6856 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:08:09.920719 6856 catalog_manager.cc:1347] Generated new cluster ID: d538ce27f15c485a97b78517a9ff0439
I20260811 08:08:09.920817 6856 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:08:09.920900 6846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:09.919331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.84:51365 (local address 127.0.0.1:35245)
0811 08:08:09.919376 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:09.919378 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:09.919498 (+ 120us) server_negotiation.cc:407] Connection header received
0811 08:08:09.919607 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:09.919608 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:09.919614 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:09.919691 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:09.920435 (+ 744us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:09.920436 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:09.920437 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:08:09.920441 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:09.920459 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:08:09.920464 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:09.920531 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:09.920637 (+ 106us) server_negotiation.cc:299] Negotiation successful
0811 08:08:09.920655 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 08:08:09.928323 6856 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:08:09.928524 6856 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:08:09.933621 6856 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4e2c10e082474b0297aac2f14c3df3e7: Generated new TSK 0
I20260811 08:08:09.933943 6856 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:08:09.940164 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 6766
2026-08-11T08:08:09Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1425 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786435400844580-15507-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:08:09 dist-test-slave-2w3w krb5kdc[6874](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:08:09 dist-test-slave-2w3w krb5kdc[6874](info): set up 2 sockets
Aug 11 08:08:09 dist-test-slave-2w3w krb5kdc[6874](info): commencing operation
krb5kdc: starting...
W20260811 08:08:11.041388 15507 mini_kdc.cc:121] Time spent starting KDC: real 1.081s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Aug 11 08:08:11 dist-test-slave-2w3w krb5kdc[6874](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435691, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:08:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:08:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786435400844580-15507-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786435400844580-15507-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 08:08:11.183185 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786435400844580-15507-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786435400844580-15507-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786435400844580-15507-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34033
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786435400844580-15507-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34051
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34033
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:08:11.267195 6887 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:08:11.267602 6887 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:08:11.267654 6887 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:08:11.269011 6887 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:08:11.269102 6887 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:08:11.269131 6887 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:08:11.269165 6887 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:08:11.269199 6887 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:08:11.270947 6887 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34051
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786435400844580-15507-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786435400844580-15507-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34033
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786435400844580-15507-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34033
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6887
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786435400844580-15507-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:08:11.271317 6887 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:08:11.271589 6887 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:08:11.277395 6895 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:11.277496 6887 server_base.cc:1034] running on GCE node
W20260811 08:08:11.277356 6893 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:11.277612 6892 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:11.277920 6887 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:08:11.278257 6887 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:08:11.279459 6887 hybrid_clock.cc:648] HybridClock initialized: now 1786435691279434 us; error 69 us; skew 500 ppm
Aug 11 08:08:11 dist-test-slave-2w3w krb5kdc[6874](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435691, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:08:11.282474 6887 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 08:08:11.283030 6887 webserver.cc:460] Webserver started at http://127.0.0.1:33709/ using document root <none> and password file <none>
I20260811 08:08:11.283334 6887 fs_manager.cc:359] Metadata directory not provided
I20260811 08:08:11.283412 6887 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:08:11.283556 6887 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:08:11.284686 6887 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786435400844580-15507-0/minicluster-data/master-0/data/instance:
uuid: "069a4ab110a34194af13679cd2311921"
format_stamp: "Formatted at 2026-08-11 08:08:11 on dist-test-slave-2w3w"
server_key: "046ab3a17c5c55112f342d23b7e5fd9a"
server_key_iv: "290da45b93b4f472f656436da5eb473b"
server_key_version: "encryptionkey@0"
I20260811 08:08:11.285136 6887 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786435400844580-15507-0/minicluster-data/master-0/wal/instance:
uuid: "069a4ab110a34194af13679cd2311921"
format_stamp: "Formatted at 2026-08-11 08:08:11 on dist-test-slave-2w3w"
server_key: "046ab3a17c5c55112f342d23b7e5fd9a"
server_key_iv: "290da45b93b4f472f656436da5eb473b"
server_key_version: "encryptionkey@0"
I20260811 08:08:11.286573 6887 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 08:08:11.287573 6902 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:11.287812 6887 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 08:08:11.287925 6887 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786435400844580-15507-0/minicluster-data/master-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786435400844580-15507-0/minicluster-data/master-0/wal
uuid: "069a4ab110a34194af13679cd2311921"
format_stamp: "Formatted at 2026-08-11 08:08:11 on dist-test-slave-2w3w"
server_key: "046ab3a17c5c55112f342d23b7e5fd9a"
server_key_iv: "290da45b93b4f472f656436da5eb473b"
server_key_version: "encryptionkey@0"
I20260811 08:08:11.288005 6887 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786435400844580-15507-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786435400844580-15507-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786435400844580-15507-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:08:11.300246 6887 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:08:11.302795 6887 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:08:11.303082 6887 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:08:11.307466 6887 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34033
I20260811 08:08:11.307510 6961 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34033 every 8 connection(s)
I20260811 08:08:11.307933 6887 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
I20260811 08:08:11.308990 6962 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:08:11.309072 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 6887
I20260811 08:08:11.309193 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786435400844580-15507-0/minicluster-data/master-0/wal/instance
I20260811 08:08:11.309418 15507 external_mini_cluster.cc:1428] Setting key 2e40998b56767f3b051e07099dcfd7b0
I20260811 08:08:11.313200 6962 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 069a4ab110a34194af13679cd2311921: Bootstrap starting.
I20260811 08:08:11.313927 6962 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 069a4ab110a34194af13679cd2311921: Neither blocks nor log segments found. Creating new log.
I20260811 08:08:11.314253 6962 log.cc:824] T 00000000000000000000000000000000 P 069a4ab110a34194af13679cd2311921: Log is configured to *not* fsync() on all Append() calls
I20260811 08:08:11.315063 6962 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 069a4ab110a34194af13679cd2311921: No bootstrap required, opened a new log
Aug 11 08:08:11 dist-test-slave-2w3w krb5kdc[6874](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435691, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 08:08:11.317394 6962 raft_consensus.cc:348] T 00000000000000000000000000000000 P 069a4ab110a34194af13679cd2311921 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "069a4ab110a34194af13679cd2311921" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34033 } }
I20260811 08:08:11.317579 6962 raft_consensus.cc:374] T 00000000000000000000000000000000 P 069a4ab110a34194af13679cd2311921 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:08:11.317605 6962 raft_consensus.cc:729] T 00000000000000000000000000000000 P 069a4ab110a34194af13679cd2311921 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 069a4ab110a34194af13679cd2311921, State: Initialized, Role: FOLLOWER
I20260811 08:08:11.317761 6962 consensus_queue.cc:260] T 00000000000000000000000000000000 P 069a4ab110a34194af13679cd2311921 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "069a4ab110a34194af13679cd2311921" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34033 } }
I20260811 08:08:11.317839 6962 raft_consensus.cc:388] T 00000000000000000000000000000000 P 069a4ab110a34194af13679cd2311921 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:08:11.317863 6962 raft_consensus.cc:482] T 00000000000000000000000000000000 P 069a4ab110a34194af13679cd2311921 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:08:11.317916 6962 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 069a4ab110a34194af13679cd2311921 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:08:11.318665 6962 raft_consensus.cc:504] T 00000000000000000000000000000000 P 069a4ab110a34194af13679cd2311921 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "069a4ab110a34194af13679cd2311921" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34033 } }
I20260811 08:08:11.318771 6962 leader_election.cc:302] T 00000000000000000000000000000000 P 069a4ab110a34194af13679cd2311921 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 069a4ab110a34194af13679cd2311921; no voters:
I20260811 08:08:11.319018 6962 leader_election.cc:288] T 00000000000000000000000000000000 P 069a4ab110a34194af13679cd2311921 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:08:11.319064 6968 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 069a4ab110a34194af13679cd2311921 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:08:11.319224 6968 raft_consensus.cc:686] T 00000000000000000000000000000000 P 069a4ab110a34194af13679cd2311921 [term 1 LEADER]: Becoming Leader. State: Replica: 069a4ab110a34194af13679cd2311921, State: Running, Role: LEADER
I20260811 08:08:11.319317 6962 sys_catalog.cc:564] T 00000000000000000000000000000000 P 069a4ab110a34194af13679cd2311921 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:08:11.319361 6968 consensus_queue.cc:237] T 00000000000000000000000000000000 P 069a4ab110a34194af13679cd2311921 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "069a4ab110a34194af13679cd2311921" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34033 } }
I20260811 08:08:11.319761 6969 sys_catalog.cc:455] T 00000000000000000000000000000000 P 069a4ab110a34194af13679cd2311921 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 069a4ab110a34194af13679cd2311921. Latest consensus state: current_term: 1 leader_uuid: "069a4ab110a34194af13679cd2311921" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "069a4ab110a34194af13679cd2311921" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34033 } } }
I20260811 08:08:11.319888 6969 sys_catalog.cc:458] T 00000000000000000000000000000000 P 069a4ab110a34194af13679cd2311921 [sys.catalog]: This master's current role is: LEADER
I20260811 08:08:11.320922 6978 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:08:11.321444 6978 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:08:11.322480 6966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:11.310024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.84:43139 (local address 127.0.0.1:34033)
0811 08:08:11.310207 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:11.310217 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:11.310252 (+ 35us) server_negotiation.cc:407] Connection header received
0811 08:08:11.311085 (+ 833us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:11.311095 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:11.311168 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:11.311333 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:11.312073 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:11.313505 (+ 1432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:11.314436 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:11.314912 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:11.315098 (+ 186us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:11.318070 (+ 2972us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:11.318075 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:11.318075 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:11.318086 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:11.320356 (+ 2270us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:11.320819 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:11.320822 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:11.320823 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:11.320936 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:11.321242 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:11.321243 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:11.321243 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:11.321592 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:11.321728 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:11.322170 (+ 442us) server_negotiation.cc:299] Negotiation successful
0811 08:08:11.322273 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":98,"threads_started":1}
I20260811 08:08:11.321461 6971 sys_catalog.cc:455] T 00000000000000000000000000000000 P 069a4ab110a34194af13679cd2311921 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "069a4ab110a34194af13679cd2311921" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "069a4ab110a34194af13679cd2311921" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34033 } } }
I20260811 08:08:11.322781 6971 sys_catalog.cc:458] T 00000000000000000000000000000000 P 069a4ab110a34194af13679cd2311921 [sys.catalog]: This master's current role is: LEADER
I20260811 08:08:11.323603 6978 catalog_manager.cc:1347] Generated new cluster ID: 9f62c3fe4ebd4cf996b985c985872bc0
I20260811 08:08:11.323608 15507 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:08:11.323657 6978 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:08:11.331336 6978 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:08:11.332129 6978 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:08:11.338356 6978 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 069a4ab110a34194af13679cd2311921: Generated new TSK 0
I20260811 08:08:11.338585 6978 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:08:11.339040 6966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:11.327405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.84:53929 (local address 127.0.0.1:34033)
0811 08:08:11.327446 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:11.327448 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:11.331119 (+ 3671us) server_negotiation.cc:407] Connection header received
0811 08:08:11.331201 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:11.331203 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:11.331216 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:11.331270 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:11.331993 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:11.332789 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:11.333821 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:11.334173 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:11.334249 (+ 76us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:11.335786 (+ 1537us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:11.335788 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:11.335788 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:11.335797 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:11.337487 (+ 1690us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:11.337967 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:11.337969 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:11.337969 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:11.338058 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:11.338365 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:11.338366 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:11.338366 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:11.338555 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:11.338673 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:11.338834 (+ 161us) server_negotiation.cc:299] Negotiation successful
0811 08:08:11.338914 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 08:08:11.341285 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 6887
W20260811 08:08:11.348395 6871 connection.cc:535] client connection to 127.0.0.1:34033 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34033): Connection reset by peer (error 104)
2026-08-11T08:08:11Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1402 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786435400844580-15507-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:08:11 dist-test-slave-2w3w krb5kdc[6996](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:08:11 dist-test-slave-2w3w krb5kdc[6996](info): set up 2 sockets
Aug 11 08:08:11 dist-test-slave-2w3w krb5kdc[6996](info): commencing operation
krb5kdc: starting...
W20260811 08:08:12.462881 15507 mini_kdc.cc:121] Time spent starting KDC: real 1.100s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Aug 11 08:08:12 dist-test-slave-2w3w krb5kdc[6996](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435692, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:08:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:08:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786435400844580-15507-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786435400844580-15507-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 08:08:12.614557 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786435400844580-15507-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786435400844580-15507-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786435400844580-15507-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38893
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786435400844580-15507-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45563
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38893
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:08:12.702059 7010 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:08:12.702284 7010 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:08:12.702309 7010 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:08:12.703595 7010 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:08:12.703650 7010 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:08:12.703665 7010 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:08:12.703679 7010 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:08:12.703691 7010 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:08:12.705257 7010 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45563
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786435400844580-15507-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786435400844580-15507-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38893
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786435400844580-15507-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38893
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7010
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786435400844580-15507-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:08:12.705542 7010 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:08:12.705797 7010 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:08:12.711200 7018 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:12.711192 7016 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:12.711232 7010 server_base.cc:1034] running on GCE node
W20260811 08:08:12.711197 7015 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:12.711802 7010 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:08:12.712159 7010 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:08:12.713354 7010 hybrid_clock.cc:648] HybridClock initialized: now 1786435692713340 us; error 37 us; skew 500 ppm
Aug 11 08:08:12 dist-test-slave-2w3w krb5kdc[6996](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435692, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:08:12.716217 7010 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 08:08:12.716782 7010 webserver.cc:460] Webserver started at http://127.0.0.1:46269/ using document root <none> and password file <none>
I20260811 08:08:12.717027 7010 fs_manager.cc:359] Metadata directory not provided
I20260811 08:08:12.717099 7010 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:08:12.717257 7010 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:08:12.718403 7010 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786435400844580-15507-0/minicluster-data/master-0/data/instance:
uuid: "a657376b9f94442ca7493b13e26d3a45"
format_stamp: "Formatted at 2026-08-11 08:08:12 on dist-test-slave-2w3w"
server_key: "87b086b4e7b5ee368866ff041e5d714e"
server_key_iv: "fa206db2312e5c02c82bc2a90c3cc977"
server_key_version: "encryptionkey@0"
I20260811 08:08:12.718791 7010 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786435400844580-15507-0/minicluster-data/master-0/wal/instance:
uuid: "a657376b9f94442ca7493b13e26d3a45"
format_stamp: "Formatted at 2026-08-11 08:08:12 on dist-test-slave-2w3w"
server_key: "87b086b4e7b5ee368866ff041e5d714e"
server_key_iv: "fa206db2312e5c02c82bc2a90c3cc977"
server_key_version: "encryptionkey@0"
I20260811 08:08:12.720444 7010 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:08:12.721431 7025 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:12.721729 7010 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:08:12.721935 7010 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786435400844580-15507-0/minicluster-data/master-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786435400844580-15507-0/minicluster-data/master-0/wal
uuid: "a657376b9f94442ca7493b13e26d3a45"
format_stamp: "Formatted at 2026-08-11 08:08:12 on dist-test-slave-2w3w"
server_key: "87b086b4e7b5ee368866ff041e5d714e"
server_key_iv: "fa206db2312e5c02c82bc2a90c3cc977"
server_key_version: "encryptionkey@0"
I20260811 08:08:12.722035 7010 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786435400844580-15507-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786435400844580-15507-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786435400844580-15507-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:08:12.733122 7010 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:08:12.735343 7010 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:08:12.735518 7010 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:08:12.740204 7010 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38893
I20260811 08:08:12.740242 7081 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38893 every 8 connection(s)
I20260811 08:08:12.740664 7010 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
I20260811 08:08:12.740932 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 7010
I20260811 08:08:12.741071 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786435400844580-15507-0/minicluster-data/master-0/wal/instance
I20260811 08:08:12.741284 15507 external_mini_cluster.cc:1428] Setting key ad9aac9ecd9fc41ca24cd52e34775b64
I20260811 08:08:12.741674 7082 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:08:12.745287 7082 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a657376b9f94442ca7493b13e26d3a45: Bootstrap starting.
I20260811 08:08:12.746038 7082 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a657376b9f94442ca7493b13e26d3a45: Neither blocks nor log segments found. Creating new log.
I20260811 08:08:12.746371 7082 log.cc:824] T 00000000000000000000000000000000 P a657376b9f94442ca7493b13e26d3a45: Log is configured to *not* fsync() on all Append() calls
I20260811 08:08:12.747359 7082 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a657376b9f94442ca7493b13e26d3a45: No bootstrap required, opened a new log
I20260811 08:08:12.747874 7085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:12.741895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.84:36545 (local address 127.0.0.1:38893)
0811 08:08:12.742086 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:12.742095 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:12.742136 (+ 41us) server_negotiation.cc:407] Connection header received
0811 08:08:12.742904 (+ 768us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:12.742912 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:12.743030 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:12.743170 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:12.743458 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:12.744396 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:12.745515 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:12.746136 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:12.746272 (+ 136us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:12.747080 (+ 808us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:12.747086 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:12.747086 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:08:12.747327 (+ 241us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:12.747369 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:08:12.747386 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:12.747483 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:12.747598 (+ 115us) server_negotiation.cc:299] Negotiation successful
0811 08:08:12.747626 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":78,"threads_started":1}
I20260811 08:08:12.749166 15507 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:08:12.749960 7082 raft_consensus.cc:348] T 00000000000000000000000000000000 P a657376b9f94442ca7493b13e26d3a45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a657376b9f94442ca7493b13e26d3a45" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38893 } }
I20260811 08:08:12.750154 7082 raft_consensus.cc:374] T 00000000000000000000000000000000 P a657376b9f94442ca7493b13e26d3a45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:08:12.750195 7082 raft_consensus.cc:729] T 00000000000000000000000000000000 P a657376b9f94442ca7493b13e26d3a45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a657376b9f94442ca7493b13e26d3a45, State: Initialized, Role: FOLLOWER
I20260811 08:08:12.750341 7082 consensus_queue.cc:260] T 00000000000000000000000000000000 P a657376b9f94442ca7493b13e26d3a45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a657376b9f94442ca7493b13e26d3a45" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38893 } }
I20260811 08:08:12.750447 7082 raft_consensus.cc:388] T 00000000000000000000000000000000 P a657376b9f94442ca7493b13e26d3a45 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:08:12.750483 7082 raft_consensus.cc:482] T 00000000000000000000000000000000 P a657376b9f94442ca7493b13e26d3a45 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:08:12.750538 7082 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a657376b9f94442ca7493b13e26d3a45 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:08:12.751468 7082 raft_consensus.cc:504] T 00000000000000000000000000000000 P a657376b9f94442ca7493b13e26d3a45 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a657376b9f94442ca7493b13e26d3a45" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38893 } }
I20260811 08:08:12.751587 7082 leader_election.cc:302] T 00000000000000000000000000000000 P a657376b9f94442ca7493b13e26d3a45 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a657376b9f94442ca7493b13e26d3a45; no voters:
I20260811 08:08:12.751785 7082 leader_election.cc:288] T 00000000000000000000000000000000 P a657376b9f94442ca7493b13e26d3a45 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:08:12.751895 7094 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a657376b9f94442ca7493b13e26d3a45 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:08:12.752028 7082 sys_catalog.cc:564] T 00000000000000000000000000000000 P a657376b9f94442ca7493b13e26d3a45 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:08:12.752094 7094 raft_consensus.cc:686] T 00000000000000000000000000000000 P a657376b9f94442ca7493b13e26d3a45 [term 1 LEADER]: Becoming Leader. State: Replica: a657376b9f94442ca7493b13e26d3a45, State: Running, Role: LEADER
I20260811 08:08:12.752265 7094 consensus_queue.cc:237] T 00000000000000000000000000000000 P a657376b9f94442ca7493b13e26d3a45 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a657376b9f94442ca7493b13e26d3a45" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38893 } }
I20260811 08:08:12.752700 7094 sys_catalog.cc:455] T 00000000000000000000000000000000 P a657376b9f94442ca7493b13e26d3a45 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a657376b9f94442ca7493b13e26d3a45. Latest consensus state: current_term: 1 leader_uuid: "a657376b9f94442ca7493b13e26d3a45" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a657376b9f94442ca7493b13e26d3a45" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38893 } } }
I20260811 08:08:12.752707 7096 sys_catalog.cc:455] T 00000000000000000000000000000000 P a657376b9f94442ca7493b13e26d3a45 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a657376b9f94442ca7493b13e26d3a45" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a657376b9f94442ca7493b13e26d3a45" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38893 } } }
I20260811 08:08:12.752872 7094 sys_catalog.cc:458] T 00000000000000000000000000000000 P a657376b9f94442ca7493b13e26d3a45 [sys.catalog]: This master's current role is: LEADER
I20260811 08:08:12.752880 7096 sys_catalog.cc:458] T 00000000000000000000000000000000 P a657376b9f94442ca7493b13e26d3a45 [sys.catalog]: This master's current role is: LEADER
I20260811 08:08:12.753176 7103 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:08:12.753721 7103 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:08:12.754753 7085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:12.750810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.84:45477 (local address 127.0.0.1:38893)
0811 08:08:12.750853 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:12.750855 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:12.750997 (+ 142us) server_negotiation.cc:407] Connection header received
0811 08:08:12.751064 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:12.751065 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:12.751075 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:12.751146 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:12.751243 (+ 97us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:12.751957 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:12.753045 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:12.753402 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:12.753472 (+ 70us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:12.754424 (+ 952us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:12.754426 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:12.754426 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:08:12.754431 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:12.754447 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:08:12.754452 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:12.754508 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:12.754657 (+ 149us) server_negotiation.cc:299] Negotiation successful
0811 08:08:12.754668 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 08:08:12.755645 7103 catalog_manager.cc:1347] Generated new cluster ID: bc09871aa9ea40c5b5390b0855357e8e
I20260811 08:08:12.755708 7103 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:08:12.774509 7103 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:08:12.775271 7103 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:08:12.784183 7103 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a657376b9f94442ca7493b13e26d3a45: Generated new TSK 0
I20260811 08:08:12.784474 7103 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:08:12.787937 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 7010
W20260811 08:08:12.795701 6994 connection.cc:535] client connection to 127.0.0.1:38893 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:38893): Connection reset by peer (error 104)
2026-08-11T08:08:12Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1447 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786435400844580-15507-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:08:12 dist-test-slave-2w3w krb5kdc[7115](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:08:12 dist-test-slave-2w3w krb5kdc[7115](info): set up 2 sockets
Aug 11 08:08:12 dist-test-slave-2w3w krb5kdc[7115](info): commencing operation
krb5kdc: starting...
W20260811 08:08:13.914868 15507 mini_kdc.cc:121] Time spent starting KDC: real 1.104s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Aug 11 08:08:14 dist-test-slave-2w3w krb5kdc[7115](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435694, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:08:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:08:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786435400844580-15507-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786435400844580-15507-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 08:08:14.050761 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786435400844580-15507-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786435400844580-15507-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786435400844580-15507-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34777
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786435400844580-15507-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34777
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:08:14.133616 7132 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:08:14.133920 7132 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:08:14.133965 7132 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:08:14.135233 7132 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:08:14.135321 7132 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:08:14.135347 7132 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:08:14.135370 7132 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:08:14.135397 7132 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:08:14.136976 7132 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786435400844580-15507-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786435400844580-15507-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34777
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786435400844580-15507-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34777
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7132
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786435400844580-15507-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:08:14.137293 7132 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:08:14.137542 7132 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:08:14.142767 7138 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:14.142802 7141 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:14.142846 7139 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:14.143098 7132 server_base.cc:1034] running on GCE node
I20260811 08:08:14.143347 7132 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:08:14.143601 7132 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:08:14.144752 7132 hybrid_clock.cc:648] HybridClock initialized: now 1786435694144726 us; error 40 us; skew 500 ppm
Aug 11 08:08:14 dist-test-slave-2w3w krb5kdc[7115](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435694, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:08:14.147796 7132 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 08:08:14.148288 7132 webserver.cc:460] Webserver started at http://127.0.0.1:33179/ using document root <none> and password file <none>
I20260811 08:08:14.148545 7132 fs_manager.cc:359] Metadata directory not provided
I20260811 08:08:14.148617 7132 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:08:14.148774 7132 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:08:14.149859 7132 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786435400844580-15507-0/minicluster-data/master-0/data/instance:
uuid: "8b057dd69dfa4676b8ea18e89ce1965c"
format_stamp: "Formatted at 2026-08-11 08:08:14 on dist-test-slave-2w3w"
server_key: "7dec08db3865be6d9079986d79157c31"
server_key_iv: "d606758ae950f40a250e75f06d52694a"
server_key_version: "encryptionkey@0"
I20260811 08:08:14.150221 7132 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786435400844580-15507-0/minicluster-data/master-0/wal/instance:
uuid: "8b057dd69dfa4676b8ea18e89ce1965c"
format_stamp: "Formatted at 2026-08-11 08:08:14 on dist-test-slave-2w3w"
server_key: "7dec08db3865be6d9079986d79157c31"
server_key_iv: "d606758ae950f40a250e75f06d52694a"
server_key_version: "encryptionkey@0"
I20260811 08:08:14.151661 7132 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.002s
I20260811 08:08:14.152462 7149 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:14.152632 7132 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:08:14.152733 7132 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786435400844580-15507-0/minicluster-data/master-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786435400844580-15507-0/minicluster-data/master-0/wal
uuid: "8b057dd69dfa4676b8ea18e89ce1965c"
format_stamp: "Formatted at 2026-08-11 08:08:14 on dist-test-slave-2w3w"
server_key: "7dec08db3865be6d9079986d79157c31"
server_key_iv: "d606758ae950f40a250e75f06d52694a"
server_key_version: "encryptionkey@0"
I20260811 08:08:14.152814 7132 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786435400844580-15507-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786435400844580-15507-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786435400844580-15507-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:08:14.156282 7132 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:08:14.158636 7132 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:08:14.158806 7132 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:08:14.162671 7132 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34777
I20260811 08:08:14.162724 7203 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34777 every 8 connection(s)
I20260811 08:08:14.163123 7132 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
I20260811 08:08:14.164063 7204 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:08:14.166334 7204 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b057dd69dfa4676b8ea18e89ce1965c: Bootstrap starting.
I20260811 08:08:14.166834 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 7132
I20260811 08:08:14.167008 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786435400844580-15507-0/minicluster-data/master-0/wal/instance
I20260811 08:08:14.167146 7204 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8b057dd69dfa4676b8ea18e89ce1965c: Neither blocks nor log segments found. Creating new log.
I20260811 08:08:14.167237 15507 external_mini_cluster.cc:1428] Setting key 57c622f1124f9447ba53b247533f561b
I20260811 08:08:14.167542 7204 log.cc:824] T 00000000000000000000000000000000 P 8b057dd69dfa4676b8ea18e89ce1965c: Log is configured to *not* fsync() on all Append() calls
I20260811 08:08:14.168357 7204 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b057dd69dfa4676b8ea18e89ce1965c: No bootstrap required, opened a new log
I20260811 08:08:14.169970 7208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:14.167869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.84:45719 (local address 127.0.0.1:34777)
0811 08:08:14.168065 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:14.168074 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:14.168110 (+ 36us) server_negotiation.cc:407] Connection header received
0811 08:08:14.168613 (+ 503us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:14.168620 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:14.168651 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:14.168771 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:14.169465 (+ 694us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:14.169468 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:14.169468 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:08:14.169472 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:14.169514 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:08:14.169525 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:14.169602 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:14.169681 (+ 79us) server_negotiation.cc:299] Negotiation successful
0811 08:08:14.169746 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":83,"threads_started":1}
I20260811 08:08:14.171109 15507 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:08:14.171168 7204 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8b057dd69dfa4676b8ea18e89ce1965c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b057dd69dfa4676b8ea18e89ce1965c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34777 } }
I20260811 08:08:14.171335 7204 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8b057dd69dfa4676b8ea18e89ce1965c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:08:14.171365 7204 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8b057dd69dfa4676b8ea18e89ce1965c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b057dd69dfa4676b8ea18e89ce1965c, State: Initialized, Role: FOLLOWER
I20260811 08:08:14.171487 7204 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8b057dd69dfa4676b8ea18e89ce1965c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b057dd69dfa4676b8ea18e89ce1965c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34777 } }
I20260811 08:08:14.171576 7204 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8b057dd69dfa4676b8ea18e89ce1965c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:08:14.171612 7204 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8b057dd69dfa4676b8ea18e89ce1965c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:08:14.171662 7204 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8b057dd69dfa4676b8ea18e89ce1965c [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:08:14.172468 7204 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8b057dd69dfa4676b8ea18e89ce1965c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b057dd69dfa4676b8ea18e89ce1965c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34777 } }
I20260811 08:08:14.172605 7204 leader_election.cc:302] T 00000000000000000000000000000000 P 8b057dd69dfa4676b8ea18e89ce1965c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8b057dd69dfa4676b8ea18e89ce1965c; no voters:
I20260811 08:08:14.172771 7204 leader_election.cc:288] T 00000000000000000000000000000000 P 8b057dd69dfa4676b8ea18e89ce1965c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:08:14.172801 7214 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8b057dd69dfa4676b8ea18e89ce1965c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:08:14.173029 7214 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8b057dd69dfa4676b8ea18e89ce1965c [term 1 LEADER]: Becoming Leader. State: Replica: 8b057dd69dfa4676b8ea18e89ce1965c, State: Running, Role: LEADER
I20260811 08:08:14.173127 7204 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8b057dd69dfa4676b8ea18e89ce1965c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:08:14.173203 7214 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8b057dd69dfa4676b8ea18e89ce1965c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b057dd69dfa4676b8ea18e89ce1965c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34777 } }
I20260811 08:08:14.173542 7218 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b057dd69dfa4676b8ea18e89ce1965c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8b057dd69dfa4676b8ea18e89ce1965c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b057dd69dfa4676b8ea18e89ce1965c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34777 } } }
I20260811 08:08:14.173714 7218 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b057dd69dfa4676b8ea18e89ce1965c [sys.catalog]: This master's current role is: LEADER
I20260811 08:08:14.173957 7224 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:08:14.174038 7208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:14.172818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.84:46627 (local address 127.0.0.1:34777)
0811 08:08:14.172855 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:14.172857 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:14.172866 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:08:14.172898 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:14.172899 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:14.172904 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:14.172968 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:14.173629 (+ 661us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:14.173631 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:14.173631 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:08:14.173635 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:14.173653 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:08:14.173658 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:14.173710 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:14.173949 (+ 239us) server_negotiation.cc:299] Negotiation successful
0811 08:08:14.173966 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 08:08:14.174328 7215 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b057dd69dfa4676b8ea18e89ce1965c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8b057dd69dfa4676b8ea18e89ce1965c. Latest consensus state: current_term: 1 leader_uuid: "8b057dd69dfa4676b8ea18e89ce1965c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b057dd69dfa4676b8ea18e89ce1965c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34777 } } }
I20260811 08:08:14.174453 7215 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b057dd69dfa4676b8ea18e89ce1965c [sys.catalog]: This master's current role is: LEADER
I20260811 08:08:14.174539 7224 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:08:14.176484 7224 catalog_manager.cc:1347] Generated new cluster ID: 1e8f7fd64bcf433eb7a23e6d7c98095f
I20260811 08:08:14.176540 7224 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:08:14.203088 7224 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:08:14.203325 7224 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:08:14.207154 7224 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8b057dd69dfa4676b8ea18e89ce1965c: Generated new TSK 0
I20260811 08:08:14.207420 7224 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:08:14.215137 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 7132
2026-08-11T08:08:14Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1427 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786435400844580-15507-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:08:14 dist-test-slave-2w3w krb5kdc[7238](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:08:14 dist-test-slave-2w3w krb5kdc[7238](info): set up 2 sockets
Aug 11 08:08:14 dist-test-slave-2w3w krb5kdc[7238](info): commencing operation
krb5kdc: starting...
W20260811 08:08:15.324079 15507 mini_kdc.cc:121] Time spent starting KDC: real 1.086s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Aug 11 08:08:15 dist-test-slave-2w3w krb5kdc[7238](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435695, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:08:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:08:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.36.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab.
Entry for principal kudu/127.15.36.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab.
I20260811 08:08:15.459338 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786435400844580-15507-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786435400844580-15507-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786435400844580-15507-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:35327
--webserver_interface=127.15.36.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=kudu/127.15.36.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:38209
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.36.254:35327
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:08:15.545280 7251 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:08:15.545573 7251 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:08:15.545616 7251 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:08:15.546839 7251 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:08:15.546924 7251 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:08:15.546952 7251 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:08:15.546974 7251 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:08:15.547060 7251 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:08:15.548610 7251 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:38209
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786435400844580-15507-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786435400844580-15507-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.36.254:35327
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=kudu/127.15.36.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:35327
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.36.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7251
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786435400844580-15507-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:08:15.548918 7251 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:08:15.549170 7251 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 08:08:15.554678 7251 server_base.cc:1034] running on GCE node
W20260811 08:08:15.554642 7258 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:15.554642 7260 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:15.554642 7257 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:15.555253 7251 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:08:15.555593 7251 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:08:15.556793 7251 hybrid_clock.cc:648] HybridClock initialized: now 1786435695556763 us; error 49 us; skew 500 ppm
Aug 11 08:08:15 dist-test-slave-2w3w krb5kdc[7238](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435695, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:08:15.565974 7251 init.cc:377] Logged in from keytab as kudu/127.15.36.254@KRBTEST.COM (short username kudu)
I20260811 08:08:15.566594 7251 webserver.cc:460] Webserver started at http://127.15.36.254:42797/ using document root <none> and password file <none>
I20260811 08:08:15.566843 7251 fs_manager.cc:359] Metadata directory not provided
I20260811 08:08:15.566915 7251 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:08:15.567091 7251 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:08:15.568337 7251 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786435400844580-15507-0/minicluster-data/master-0/data/instance:
uuid: "d5cb05fb9edd48f3abbc09fef8d9db5b"
format_stamp: "Formatted at 2026-08-11 08:08:15 on dist-test-slave-2w3w"
server_key: "06a3bd5b7cb641bc6253567513e98229"
server_key_iv: "bc614fd11830bd9bdbd9b2bb5565debf"
server_key_version: "encryptionkey@0"
I20260811 08:08:15.568737 7251 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786435400844580-15507-0/minicluster-data/master-0/wal/instance:
uuid: "d5cb05fb9edd48f3abbc09fef8d9db5b"
format_stamp: "Formatted at 2026-08-11 08:08:15 on dist-test-slave-2w3w"
server_key: "06a3bd5b7cb641bc6253567513e98229"
server_key_iv: "bc614fd11830bd9bdbd9b2bb5565debf"
server_key_version: "encryptionkey@0"
I20260811 08:08:15.570214 7251 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 08:08:15.571177 7267 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:15.571398 7251 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:08:15.571522 7251 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786435400844580-15507-0/minicluster-data/master-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786435400844580-15507-0/minicluster-data/master-0/wal
uuid: "d5cb05fb9edd48f3abbc09fef8d9db5b"
format_stamp: "Formatted at 2026-08-11 08:08:15 on dist-test-slave-2w3w"
server_key: "06a3bd5b7cb641bc6253567513e98229"
server_key_iv: "bc614fd11830bd9bdbd9b2bb5565debf"
server_key_version: "encryptionkey@0"
I20260811 08:08:15.571614 7251 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786435400844580-15507-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786435400844580-15507-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786435400844580-15507-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:08:15.586382 7251 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:08:15.588938 7251 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:08:15.589103 7251 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:08:15.593333 7251 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.254:35327
I20260811 08:08:15.593432 7326 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.254:35327 every 8 connection(s)
I20260811 08:08:15.593776 7251 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
I20260811 08:08:15.594743 7327 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:08:15.595826 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 7251
I20260811 08:08:15.595960 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786435400844580-15507-0/minicluster-data/master-0/wal/instance
I20260811 08:08:15.596195 15507 external_mini_cluster.cc:1428] Setting key 2c899771569c6b9648797c5f39c3a803
I20260811 08:08:15.598361 7327 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d5cb05fb9edd48f3abbc09fef8d9db5b: Bootstrap starting.
I20260811 08:08:15.599117 7327 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d5cb05fb9edd48f3abbc09fef8d9db5b: Neither blocks nor log segments found. Creating new log.
I20260811 08:08:15.599457 7327 log.cc:824] T 00000000000000000000000000000000 P d5cb05fb9edd48f3abbc09fef8d9db5b: Log is configured to *not* fsync() on all Append() calls
I20260811 08:08:15.600219 7327 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d5cb05fb9edd48f3abbc09fef8d9db5b: No bootstrap required, opened a new log
I20260811 08:08:15.602432 7327 raft_consensus.cc:348] T 00000000000000000000000000000000 P d5cb05fb9edd48f3abbc09fef8d9db5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5cb05fb9edd48f3abbc09fef8d9db5b" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 35327 } }
I20260811 08:08:15.602573 7327 raft_consensus.cc:374] T 00000000000000000000000000000000 P d5cb05fb9edd48f3abbc09fef8d9db5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:08:15.602595 7327 raft_consensus.cc:729] T 00000000000000000000000000000000 P d5cb05fb9edd48f3abbc09fef8d9db5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5cb05fb9edd48f3abbc09fef8d9db5b, State: Initialized, Role: FOLLOWER
I20260811 08:08:15.602753 7327 consensus_queue.cc:260] T 00000000000000000000000000000000 P d5cb05fb9edd48f3abbc09fef8d9db5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5cb05fb9edd48f3abbc09fef8d9db5b" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 35327 } }
I20260811 08:08:15.602820 7327 raft_consensus.cc:388] T 00000000000000000000000000000000 P d5cb05fb9edd48f3abbc09fef8d9db5b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:08:15.602842 7327 raft_consensus.cc:482] T 00000000000000000000000000000000 P d5cb05fb9edd48f3abbc09fef8d9db5b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:08:15.602906 7327 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d5cb05fb9edd48f3abbc09fef8d9db5b [term 0 FOLLOWER]: Advancing to term 1
Aug 11 08:08:15 dist-test-slave-2w3w krb5kdc[7238](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435695, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:08:15.603590 7327 raft_consensus.cc:504] T 00000000000000000000000000000000 P d5cb05fb9edd48f3abbc09fef8d9db5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5cb05fb9edd48f3abbc09fef8d9db5b" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 35327 } }
I20260811 08:08:15.603708 7327 leader_election.cc:302] T 00000000000000000000000000000000 P d5cb05fb9edd48f3abbc09fef8d9db5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d5cb05fb9edd48f3abbc09fef8d9db5b; no voters:
I20260811 08:08:15.603917 7327 leader_election.cc:288] T 00000000000000000000000000000000 P d5cb05fb9edd48f3abbc09fef8d9db5b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:08:15.603965 7333 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d5cb05fb9edd48f3abbc09fef8d9db5b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:08:15.604096 7333 raft_consensus.cc:686] T 00000000000000000000000000000000 P d5cb05fb9edd48f3abbc09fef8d9db5b [term 1 LEADER]: Becoming Leader. State: Replica: d5cb05fb9edd48f3abbc09fef8d9db5b, State: Running, Role: LEADER
I20260811 08:08:15.604213 7327 sys_catalog.cc:564] T 00000000000000000000000000000000 P d5cb05fb9edd48f3abbc09fef8d9db5b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:08:15.604235 7333 consensus_queue.cc:237] T 00000000000000000000000000000000 P d5cb05fb9edd48f3abbc09fef8d9db5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5cb05fb9edd48f3abbc09fef8d9db5b" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 35327 } }
I20260811 08:08:15.604553 7333 sys_catalog.cc:455] T 00000000000000000000000000000000 P d5cb05fb9edd48f3abbc09fef8d9db5b [sys.catalog]: SysCatalogTable state changed. Reason: New leader d5cb05fb9edd48f3abbc09fef8d9db5b. Latest consensus state: current_term: 1 leader_uuid: "d5cb05fb9edd48f3abbc09fef8d9db5b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5cb05fb9edd48f3abbc09fef8d9db5b" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 35327 } } }
I20260811 08:08:15.604629 7333 sys_catalog.cc:458] T 00000000000000000000000000000000 P d5cb05fb9edd48f3abbc09fef8d9db5b [sys.catalog]: This master's current role is: LEADER
I20260811 08:08:15.604842 7334 sys_catalog.cc:455] T 00000000000000000000000000000000 P d5cb05fb9edd48f3abbc09fef8d9db5b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d5cb05fb9edd48f3abbc09fef8d9db5b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5cb05fb9edd48f3abbc09fef8d9db5b" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 35327 } } }
I20260811 08:08:15.604984 7334 sys_catalog.cc:458] T 00000000000000000000000000000000 P d5cb05fb9edd48f3abbc09fef8d9db5b [sys.catalog]: This master's current role is: LEADER
I20260811 08:08:15.605226 7338 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:08:15.606920 7338 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:08:15.608271 7330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:15.596829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45461 (local address 127.15.36.254:35327)
0811 08:08:15.597040 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:15.597049 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:15.597083 (+ 34us) server_negotiation.cc:407] Connection header received
0811 08:08:15.597589 (+ 506us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:15.597598 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:15.597663 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:15.597814 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:15.598446 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:15.599832 (+ 1386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:15.600655 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:15.601297 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:15.601416 (+ 119us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:15.604193 (+ 2777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:15.604198 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:15.604198 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:15.604211 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:15.606339 (+ 2128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:15.606802 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:15.606805 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:15.606806 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:15.606917 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:15.607243 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:15.607244 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:15.607244 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:15.607563 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:15.607717 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:15.607970 (+ 253us) server_negotiation.cc:299] Negotiation successful
0811 08:08:15.608074 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":98,"threads_started":1}
I20260811 08:08:15.609192 7338 catalog_manager.cc:1347] Generated new cluster ID: 6fd75a0c246f40179219c8b7427c5e70
I20260811 08:08:15.609272 7338 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:08:15.609337 15507 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:08:15.618848 7330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:15.611034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34791 (local address 127.15.36.254:35327)
0811 08:08:15.611076 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:15.611079 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:15.611138 (+ 59us) server_negotiation.cc:407] Connection header received
0811 08:08:15.611211 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:15.611212 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:15.611222 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:15.611285 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:15.611973 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:15.612722 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:15.613844 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:15.614182 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:15.614247 (+ 65us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:15.615870 (+ 1623us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:15.615871 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:15.615872 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:15.615879 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:15.617519 (+ 1640us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:15.617977 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:15.617978 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:15.617979 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:15.618044 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:15.618288 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:15.618288 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:15.618289 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:15.618416 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:15.618511 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:15.618684 (+ 173us) server_negotiation.cc:299] Negotiation successful
0811 08:08:15.618750 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 08:08:15.623669 7338 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:08:15.624401 7338 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:08:15.631879 7338 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d5cb05fb9edd48f3abbc09fef8d9db5b: Generated new TSK 0
I20260811 08:08:15.632117 7338 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:08:15.634503 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 7251
W20260811 08:08:15.642446 7236 connection.cc:535] client connection to 127.15.36.254:35327 recv error: Network error: failed to read from TLS socket (remote: 127.15.36.254:35327): Connection reset by peer (error 104)
2026-08-11T08:08:15Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1419 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786435400844580-15507-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:08:15 dist-test-slave-2w3w krb5kdc[7361](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:08:15 dist-test-slave-2w3w krb5kdc[7361](info): set up 2 sockets
Aug 11 08:08:15 dist-test-slave-2w3w krb5kdc[7361](info): commencing operation
krb5kdc: starting...
W20260811 08:08:16.751585 15507 mini_kdc.cc:121] Time spent starting KDC: real 1.095s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Aug 11 08:08:16 dist-test-slave-2w3w krb5kdc[7361](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435696, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:08:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:08:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.36.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab.
Entry for principal kudu/127.15.36.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab.
I20260811 08:08:16.891690 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786435400844580-15507-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786435400844580-15507-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786435400844580-15507-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:38461
--webserver_interface=127.15.36.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=kudu/127.15.36.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:37803
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.36.254:38461
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:08:16.976939 7375 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:08:16.977162 7375 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:08:16.977186 7375 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:08:16.978416 7375 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:08:16.978471 7375 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:08:16.978487 7375 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:08:16.978499 7375 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:08:16.978511 7375 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:08:16.980139 7375 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:37803
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786435400844580-15507-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786435400844580-15507-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.36.254:38461
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=kudu/127.15.36.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:38461
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.36.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7375
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786435400844580-15507-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:08:16.980448 7375 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:08:16.980693 7375 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:08:16.985999 7381 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:16.986016 7384 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:16.986028 7382 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:16.986490 7375 server_base.cc:1034] running on GCE node
I20260811 08:08:16.986811 7375 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:08:16.987287 7375 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:08:16.988517 7375 hybrid_clock.cc:648] HybridClock initialized: now 1786435696988489 us; error 47 us; skew 500 ppm
Aug 11 08:08:16 dist-test-slave-2w3w krb5kdc[7361](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435696, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:08:16.991573 7375 init.cc:377] Logged in from keytab as kudu/127.15.36.254@KRBTEST.COM (short username kudu)
I20260811 08:08:16.992089 7375 webserver.cc:460] Webserver started at http://127.15.36.254:33343/ using document root <none> and password file <none>
I20260811 08:08:16.992368 7375 fs_manager.cc:359] Metadata directory not provided
I20260811 08:08:16.992448 7375 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:08:16.992614 7375 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:08:16.993817 7375 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786435400844580-15507-0/minicluster-data/master-0/data/instance:
uuid: "711a5485e0004e3488ad910f01bb4393"
format_stamp: "Formatted at 2026-08-11 08:08:16 on dist-test-slave-2w3w"
server_key: "28c7d597c9b6728fa2b59a5e61daf402"
server_key_iv: "b1d9feb9c7db04ab94476d2ada8fef8e"
server_key_version: "encryptionkey@0"
I20260811 08:08:16.994215 7375 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786435400844580-15507-0/minicluster-data/master-0/wal/instance:
uuid: "711a5485e0004e3488ad910f01bb4393"
format_stamp: "Formatted at 2026-08-11 08:08:16 on dist-test-slave-2w3w"
server_key: "28c7d597c9b6728fa2b59a5e61daf402"
server_key_iv: "b1d9feb9c7db04ab94476d2ada8fef8e"
server_key_version: "encryptionkey@0"
I20260811 08:08:16.995790 7375 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 08:08:16.996708 7391 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:16.996960 7375 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:08:16.997082 7375 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786435400844580-15507-0/minicluster-data/master-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786435400844580-15507-0/minicluster-data/master-0/wal
uuid: "711a5485e0004e3488ad910f01bb4393"
format_stamp: "Formatted at 2026-08-11 08:08:16 on dist-test-slave-2w3w"
server_key: "28c7d597c9b6728fa2b59a5e61daf402"
server_key_iv: "b1d9feb9c7db04ab94476d2ada8fef8e"
server_key_version: "encryptionkey@0"
I20260811 08:08:16.997169 7375 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786435400844580-15507-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786435400844580-15507-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786435400844580-15507-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:08:17.008975 7375 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:08:17.011780 7375 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:08:17.011955 7375 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:08:17.016993 7375 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.254:38461
I20260811 08:08:17.017153 7450 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.254:38461 every 8 connection(s)
I20260811 08:08:17.017470 7375 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
I20260811 08:08:17.017765 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 7375
I20260811 08:08:17.017961 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786435400844580-15507-0/minicluster-data/master-0/wal/instance
I20260811 08:08:17.018193 15507 external_mini_cluster.cc:1428] Setting key 02edffbde39c58a5889fb0744bf0de28
I20260811 08:08:17.018576 7451 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:08:17.022101 7451 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 711a5485e0004e3488ad910f01bb4393: Bootstrap starting.
I20260811 08:08:17.022807 7451 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 711a5485e0004e3488ad910f01bb4393: Neither blocks nor log segments found. Creating new log.
I20260811 08:08:17.023149 7451 log.cc:824] T 00000000000000000000000000000000 P 711a5485e0004e3488ad910f01bb4393: Log is configured to *not* fsync() on all Append() calls
I20260811 08:08:17.024026 7451 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 711a5485e0004e3488ad910f01bb4393: No bootstrap required, opened a new log
I20260811 08:08:17.025151 7454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:17.018777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37315 (local address 127.15.36.254:38461)
0811 08:08:17.019070 (+ 293us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:17.019080 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:17.019123 (+ 43us) server_negotiation.cc:407] Connection header received
0811 08:08:17.019790 (+ 667us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:17.019800 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:17.019863 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:17.020031 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:17.020276 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:17.021662 (+ 1386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:17.022565 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:17.023231 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:17.023347 (+ 116us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:17.024322 (+ 975us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:17.024326 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:17.024326 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:08:17.024539 (+ 213us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:17.024581 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:08:17.024598 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:17.024698 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:17.024873 (+ 175us) server_negotiation.cc:299] Negotiation successful
0811 08:08:17.024904 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":224,"thread_start_us":149,"threads_started":1}
I20260811 08:08:17.026449 15507 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:08:17.026473 7451 raft_consensus.cc:348] T 00000000000000000000000000000000 P 711a5485e0004e3488ad910f01bb4393 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "711a5485e0004e3488ad910f01bb4393" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38461 } }
I20260811 08:08:17.026643 7451 raft_consensus.cc:374] T 00000000000000000000000000000000 P 711a5485e0004e3488ad910f01bb4393 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:08:17.026683 7451 raft_consensus.cc:729] T 00000000000000000000000000000000 P 711a5485e0004e3488ad910f01bb4393 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 711a5485e0004e3488ad910f01bb4393, State: Initialized, Role: FOLLOWER
I20260811 08:08:17.026796 7451 consensus_queue.cc:260] T 00000000000000000000000000000000 P 711a5485e0004e3488ad910f01bb4393 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "711a5485e0004e3488ad910f01bb4393" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38461 } }
I20260811 08:08:17.026859 7451 raft_consensus.cc:388] T 00000000000000000000000000000000 P 711a5485e0004e3488ad910f01bb4393 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:08:17.026889 7451 raft_consensus.cc:482] T 00000000000000000000000000000000 P 711a5485e0004e3488ad910f01bb4393 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:08:17.026942 7451 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 711a5485e0004e3488ad910f01bb4393 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:08:17.027789 7451 raft_consensus.cc:504] T 00000000000000000000000000000000 P 711a5485e0004e3488ad910f01bb4393 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "711a5485e0004e3488ad910f01bb4393" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38461 } }
I20260811 08:08:17.027899 7451 leader_election.cc:302] T 00000000000000000000000000000000 P 711a5485e0004e3488ad910f01bb4393 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 711a5485e0004e3488ad910f01bb4393; no voters:
I20260811 08:08:17.028106 7451 leader_election.cc:288] T 00000000000000000000000000000000 P 711a5485e0004e3488ad910f01bb4393 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:08:17.028228 7460 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 711a5485e0004e3488ad910f01bb4393 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:08:17.028364 7451 sys_catalog.cc:564] T 00000000000000000000000000000000 P 711a5485e0004e3488ad910f01bb4393 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:08:17.028427 7460 raft_consensus.cc:686] T 00000000000000000000000000000000 P 711a5485e0004e3488ad910f01bb4393 [term 1 LEADER]: Becoming Leader. State: Replica: 711a5485e0004e3488ad910f01bb4393, State: Running, Role: LEADER
I20260811 08:08:17.028563 7460 consensus_queue.cc:237] T 00000000000000000000000000000000 P 711a5485e0004e3488ad910f01bb4393 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "711a5485e0004e3488ad910f01bb4393" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38461 } }
I20260811 08:08:17.029071 7463 sys_catalog.cc:455] T 00000000000000000000000000000000 P 711a5485e0004e3488ad910f01bb4393 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 711a5485e0004e3488ad910f01bb4393. Latest consensus state: current_term: 1 leader_uuid: "711a5485e0004e3488ad910f01bb4393" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "711a5485e0004e3488ad910f01bb4393" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38461 } } }
I20260811 08:08:17.029165 7463 sys_catalog.cc:458] T 00000000000000000000000000000000 P 711a5485e0004e3488ad910f01bb4393 [sys.catalog]: This master's current role is: LEADER
I20260811 08:08:17.029372 7462 sys_catalog.cc:455] T 00000000000000000000000000000000 P 711a5485e0004e3488ad910f01bb4393 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "711a5485e0004e3488ad910f01bb4393" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "711a5485e0004e3488ad910f01bb4393" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 38461 } } }
I20260811 08:08:17.029491 7462 sys_catalog.cc:458] T 00000000000000000000000000000000 P 711a5485e0004e3488ad910f01bb4393 [sys.catalog]: This master's current role is: LEADER
I20260811 08:08:17.029691 7472 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:08:17.030438 7472 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:08:17.032155 7454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:17.028151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59579 (local address 127.15.36.254:38461)
0811 08:08:17.028220 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:17.028222 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:17.028348 (+ 126us) server_negotiation.cc:407] Connection header received
0811 08:08:17.028728 (+ 380us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:17.028729 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:17.028739 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:17.028772 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:17.028989 (+ 217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:17.029712 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:17.030535 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:17.030763 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:17.030842 (+ 79us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:17.031874 (+ 1032us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:17.031875 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:17.031876 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:08:17.031881 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:17.031896 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:08:17.031900 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:17.031981 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:17.032070 (+ 89us) server_negotiation.cc:299] Negotiation successful
0811 08:08:17.032082 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 08:08:17.032424 7472 catalog_manager.cc:1347] Generated new cluster ID: 736795e477bf4e308b3eee54e4ff1b59
I20260811 08:08:17.032508 7472 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:08:17.039175 7472 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:08:17.039806 7472 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:08:17.057296 7472 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 711a5485e0004e3488ad910f01bb4393: Generated new TSK 0
I20260811 08:08:17.057567 7472 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:08:17.064625 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 7375
W20260811 08:08:17.074689 7359 connection.cc:535] client connection to 127.15.36.254:38461 recv error: Network error: failed to read from TLS socket (remote: 127.15.36.254:38461): Connection reset by peer (error 104)
2026-08-11T08:08:17Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1432 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786435400844580-15507-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:08:17 dist-test-slave-2w3w krb5kdc[7484](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:08:17 dist-test-slave-2w3w krb5kdc[7484](info): set up 2 sockets
Aug 11 08:08:17 dist-test-slave-2w3w krb5kdc[7484](info): commencing operation
krb5kdc: starting...
W20260811 08:08:18.197355 15507 mini_kdc.cc:121] Time spent starting KDC: real 1.108s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Aug 11 08:08:18 dist-test-slave-2w3w krb5kdc[7484](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435698, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:08:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:08:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.36.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab.
Entry for principal kudu/127.15.36.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab.
I20260811 08:08:18.339030 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786435400844580-15507-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786435400844580-15507-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786435400844580-15507-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:40663
--webserver_interface=127.15.36.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=kudu/127.15.36.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:46449
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.36.254:40663
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:08:18.423480 7497 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:08:18.423764 7497 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:08:18.423808 7497 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:08:18.425004 7497 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:08:18.425086 7497 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:08:18.425112 7497 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:08:18.425134 7497 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:08:18.425164 7497 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:08:18.426730 7497 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:46449
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786435400844580-15507-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786435400844580-15507-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.36.254:40663
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=kudu/127.15.36.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:40663
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.36.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7497
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786435400844580-15507-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:08:18.427075 7497 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:08:18.427337 7497 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:08:18.432775 7503 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:18.432817 7505 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:18.432767 7502 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:18.432816 7497 server_base.cc:1034] running on GCE node
I20260811 08:08:18.433272 7497 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:08:18.433583 7497 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:08:18.434762 7497 hybrid_clock.cc:648] HybridClock initialized: now 1786435698434725 us; error 51 us; skew 500 ppm
Aug 11 08:08:18 dist-test-slave-2w3w krb5kdc[7484](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435698, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:08:18.437865 7497 init.cc:377] Logged in from keytab as kudu/127.15.36.254@KRBTEST.COM (short username kudu)
I20260811 08:08:18.438486 7497 webserver.cc:460] Webserver started at http://127.15.36.254:39321/ using document root <none> and password file <none>
I20260811 08:08:18.438818 7497 fs_manager.cc:359] Metadata directory not provided
I20260811 08:08:18.438889 7497 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:08:18.439083 7497 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:08:18.440316 7497 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786435400844580-15507-0/minicluster-data/master-0/data/instance:
uuid: "c341cf7bb916487b9b742ff72c99b16e"
format_stamp: "Formatted at 2026-08-11 08:08:18 on dist-test-slave-2w3w"
server_key: "229c49a0d4127891d5e8c7b1c9eb3e0e"
server_key_iv: "7303d8aae37334ab9d706a6f6f84f506"
server_key_version: "encryptionkey@0"
I20260811 08:08:18.440730 7497 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786435400844580-15507-0/minicluster-data/master-0/wal/instance:
uuid: "c341cf7bb916487b9b742ff72c99b16e"
format_stamp: "Formatted at 2026-08-11 08:08:18 on dist-test-slave-2w3w"
server_key: "229c49a0d4127891d5e8c7b1c9eb3e0e"
server_key_iv: "7303d8aae37334ab9d706a6f6f84f506"
server_key_version: "encryptionkey@0"
I20260811 08:08:18.442333 7497 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 08:08:18.443221 7513 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:18.443413 7497 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:08:18.443535 7497 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786435400844580-15507-0/minicluster-data/master-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786435400844580-15507-0/minicluster-data/master-0/wal
uuid: "c341cf7bb916487b9b742ff72c99b16e"
format_stamp: "Formatted at 2026-08-11 08:08:18 on dist-test-slave-2w3w"
server_key: "229c49a0d4127891d5e8c7b1c9eb3e0e"
server_key_iv: "7303d8aae37334ab9d706a6f6f84f506"
server_key_version: "encryptionkey@0"
I20260811 08:08:18.443619 7497 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786435400844580-15507-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786435400844580-15507-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786435400844580-15507-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:08:18.447167 7497 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:08:18.449550 7497 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:08:18.449750 7497 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:08:18.454468 7497 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.254:40663
I20260811 08:08:18.454543 7566 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.254:40663 every 8 connection(s)
I20260811 08:08:18.455188 7497 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
I20260811 08:08:18.456403 7567 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:08:18.458768 7567 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c341cf7bb916487b9b742ff72c99b16e: Bootstrap starting.
I20260811 08:08:18.459445 7567 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c341cf7bb916487b9b742ff72c99b16e: Neither blocks nor log segments found. Creating new log.
I20260811 08:08:18.459695 7567 log.cc:824] T 00000000000000000000000000000000 P c341cf7bb916487b9b742ff72c99b16e: Log is configured to *not* fsync() on all Append() calls
I20260811 08:08:18.460457 7567 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c341cf7bb916487b9b742ff72c99b16e: No bootstrap required, opened a new log
I20260811 08:08:18.462158 7567 raft_consensus.cc:348] T 00000000000000000000000000000000 P c341cf7bb916487b9b742ff72c99b16e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c341cf7bb916487b9b742ff72c99b16e" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 40663 } }
I20260811 08:08:18.462320 7567 raft_consensus.cc:374] T 00000000000000000000000000000000 P c341cf7bb916487b9b742ff72c99b16e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:08:18.462344 7567 raft_consensus.cc:729] T 00000000000000000000000000000000 P c341cf7bb916487b9b742ff72c99b16e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c341cf7bb916487b9b742ff72c99b16e, State: Initialized, Role: FOLLOWER
I20260811 08:08:18.462458 7567 consensus_queue.cc:260] T 00000000000000000000000000000000 P c341cf7bb916487b9b742ff72c99b16e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c341cf7bb916487b9b742ff72c99b16e" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 40663 } }
I20260811 08:08:18.462512 7567 raft_consensus.cc:388] T 00000000000000000000000000000000 P c341cf7bb916487b9b742ff72c99b16e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:08:18.462533 7567 raft_consensus.cc:482] T 00000000000000000000000000000000 P c341cf7bb916487b9b742ff72c99b16e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:08:18.462601 7567 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c341cf7bb916487b9b742ff72c99b16e [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:08:18.463641 7567 raft_consensus.cc:504] T 00000000000000000000000000000000 P c341cf7bb916487b9b742ff72c99b16e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c341cf7bb916487b9b742ff72c99b16e" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 40663 } }
I20260811 08:08:18.463743 7567 leader_election.cc:302] T 00000000000000000000000000000000 P c341cf7bb916487b9b742ff72c99b16e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c341cf7bb916487b9b742ff72c99b16e; no voters:
I20260811 08:08:18.463991 7567 leader_election.cc:288] T 00000000000000000000000000000000 P c341cf7bb916487b9b742ff72c99b16e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:08:18.464178 7570 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c341cf7bb916487b9b742ff72c99b16e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:08:18.464273 7567 sys_catalog.cc:564] T 00000000000000000000000000000000 P c341cf7bb916487b9b742ff72c99b16e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:08:18.464357 7570 raft_consensus.cc:686] T 00000000000000000000000000000000 P c341cf7bb916487b9b742ff72c99b16e [term 1 LEADER]: Becoming Leader. State: Replica: c341cf7bb916487b9b742ff72c99b16e, State: Running, Role: LEADER
I20260811 08:08:18.464460 7570 consensus_queue.cc:237] T 00000000000000000000000000000000 P c341cf7bb916487b9b742ff72c99b16e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c341cf7bb916487b9b742ff72c99b16e" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 40663 } }
I20260811 08:08:18.464896 7572 sys_catalog.cc:455] T 00000000000000000000000000000000 P c341cf7bb916487b9b742ff72c99b16e [sys.catalog]: SysCatalogTable state changed. Reason: New leader c341cf7bb916487b9b742ff72c99b16e. Latest consensus state: current_term: 1 leader_uuid: "c341cf7bb916487b9b742ff72c99b16e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c341cf7bb916487b9b742ff72c99b16e" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 40663 } } }
I20260811 08:08:18.465205 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 7497
I20260811 08:08:18.465344 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786435400844580-15507-0/minicluster-data/master-0/wal/instance
I20260811 08:08:18.465267 7571 sys_catalog.cc:455] T 00000000000000000000000000000000 P c341cf7bb916487b9b742ff72c99b16e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c341cf7bb916487b9b742ff72c99b16e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c341cf7bb916487b9b742ff72c99b16e" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 40663 } } }
I20260811 08:08:18.465371 7572 sys_catalog.cc:458] T 00000000000000000000000000000000 P c341cf7bb916487b9b742ff72c99b16e [sys.catalog]: This master's current role is: LEADER
I20260811 08:08:18.465386 7571 sys_catalog.cc:458] T 00000000000000000000000000000000 P c341cf7bb916487b9b742ff72c99b16e [sys.catalog]: This master's current role is: LEADER
I20260811 08:08:18.465583 15507 external_mini_cluster.cc:1428] Setting key 08b6638afe3852bbffc2ed9be3c11424
W20260811 08:08:18.466452 7589 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c341cf7bb916487b9b742ff72c99b16e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 08:08:18.466539 7589 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 08:08:18.466598 7583 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:08:18.466768 7583 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:08:18.468011 7592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:18.466170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58599 (local address 127.15.36.254:40663)
0811 08:08:18.466405 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:18.466415 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:18.466454 (+ 39us) server_negotiation.cc:407] Connection header received
0811 08:08:18.466587 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:18.466595 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:18.466628 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:18.466821 (+ 193us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:18.467536 (+ 715us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:18.467539 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:18.467540 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:08:18.467544 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:18.467586 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:08:18.467602 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:18.467664 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:18.467769 (+ 105us) server_negotiation.cc:299] Negotiation successful
0811 08:08:18.467812 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":181,"thread_start_us":81,"threads_started":1}
I20260811 08:08:18.468657 7583 catalog_manager.cc:1347] Generated new cluster ID: 78d354edff76409f89f9b9b8963b977f
I20260811 08:08:18.468720 7583 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:08:18.469102 15507 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:08:18.472246 7592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:18.470780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48837 (local address 127.15.36.254:40663)
0811 08:08:18.470817 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:18.470819 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:18.471192 (+ 373us) server_negotiation.cc:407] Connection header received
0811 08:08:18.471271 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:18.471272 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:18.471278 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:18.471333 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:18.472012 (+ 679us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:18.472013 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:18.472014 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:08:18.472018 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:18.472035 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:08:18.472039 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:18.472098 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:18.472161 (+ 63us) server_negotiation.cc:299] Negotiation successful
0811 08:08:18.472174 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 08:08:18.489601 7583 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:08:18.489815 7583 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:08:18.495160 7583 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c341cf7bb916487b9b742ff72c99b16e: Generated new TSK 0
I20260811 08:08:18.495398 7583 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:08:18.505892 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 7497
2026-08-11T08:08:18Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1437 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786435400844580-15507-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:08:18 dist-test-slave-2w3w krb5kdc[7601](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:08:18 dist-test-slave-2w3w krb5kdc[7601](info): set up 2 sockets
Aug 11 08:08:18 dist-test-slave-2w3w krb5kdc[7601](info): commencing operation
krb5kdc: starting...
W20260811 08:08:19.637923 15507 mini_kdc.cc:121] Time spent starting KDC: real 1.111s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Aug 11 08:08:19 dist-test-slave-2w3w krb5kdc[7601](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435699, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:08:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:08:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.36.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab.
Entry for principal kudu/127.15.36.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab.
I20260811 08:08:19.779270 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786435400844580-15507-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786435400844580-15507-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786435400844580-15507-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:40213
--webserver_interface=127.15.36.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=kudu/127.15.36.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:40639
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.36.254:40213
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:08:19.865902 7614 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:08:19.866168 7614 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:08:19.866207 7614 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:08:19.867520 7614 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:08:19.867602 7614 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:08:19.867627 7614 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:08:19.867650 7614 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:08:19.867679 7614 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:08:19.869390 7614 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:40639
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786435400844580-15507-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786435400844580-15507-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.36.254:40213
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=kudu/127.15.36.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:40213
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.36.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7614
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786435400844580-15507-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:08:19.869705 7614 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:08:19.869961 7614 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 08:08:19.875528 7614 server_base.cc:1034] running on GCE node
W20260811 08:08:19.875500 7619 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:19.875494 7620 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:19.875475 7622 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:19.875937 7614 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:08:19.876212 7614 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:08:19.877363 7614 hybrid_clock.cc:648] HybridClock initialized: now 1786435699877351 us; error 37 us; skew 500 ppm
Aug 11 08:08:19 dist-test-slave-2w3w krb5kdc[7601](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435699, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:08:19.880121 7614 init.cc:377] Logged in from keytab as kudu/127.15.36.254@KRBTEST.COM (short username kudu)
I20260811 08:08:19.880606 7614 webserver.cc:460] Webserver started at http://127.15.36.254:34387/ using document root <none> and password file <none>
I20260811 08:08:19.880820 7614 fs_manager.cc:359] Metadata directory not provided
I20260811 08:08:19.880864 7614 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:08:19.880999 7614 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:08:19.882086 7614 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786435400844580-15507-0/minicluster-data/master-0/data/instance:
uuid: "a2c9aa1d92e14125b6259337c039a618"
format_stamp: "Formatted at 2026-08-11 08:08:19 on dist-test-slave-2w3w"
server_key: "c2955e663749f19713e93b06602640ee"
server_key_iv: "3193f09d1e567b42f4f27c2e56d0c6d1"
server_key_version: "encryptionkey@0"
I20260811 08:08:19.882398 7614 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786435400844580-15507-0/minicluster-data/master-0/wal/instance:
uuid: "a2c9aa1d92e14125b6259337c039a618"
format_stamp: "Formatted at 2026-08-11 08:08:19 on dist-test-slave-2w3w"
server_key: "c2955e663749f19713e93b06602640ee"
server_key_iv: "3193f09d1e567b42f4f27c2e56d0c6d1"
server_key_version: "encryptionkey@0"
I20260811 08:08:19.883932 7614 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 08:08:19.884701 7631 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:19.884950 7614 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:08:19.885069 7614 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786435400844580-15507-0/minicluster-data/master-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786435400844580-15507-0/minicluster-data/master-0/wal
uuid: "a2c9aa1d92e14125b6259337c039a618"
format_stamp: "Formatted at 2026-08-11 08:08:19 on dist-test-slave-2w3w"
server_key: "c2955e663749f19713e93b06602640ee"
server_key_iv: "3193f09d1e567b42f4f27c2e56d0c6d1"
server_key_version: "encryptionkey@0"
I20260811 08:08:19.885139 7614 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786435400844580-15507-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786435400844580-15507-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786435400844580-15507-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:08:19.907598 7614 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:08:19.910137 7614 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:08:19.910259 7614 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:08:19.914578 7614 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.254:40213
I20260811 08:08:19.914669 7685 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.254:40213 every 8 connection(s)
I20260811 08:08:19.915081 7614 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
I20260811 08:08:19.915582 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 7614
I20260811 08:08:19.915671 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786435400844580-15507-0/minicluster-data/master-0/wal/instance
I20260811 08:08:19.915876 15507 external_mini_cluster.cc:1428] Setting key e8bf744c1d63dbbd39c3112c4a0c6ac4
I20260811 08:08:19.916193 7686 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:08:19.919294 7686 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a2c9aa1d92e14125b6259337c039a618: Bootstrap starting.
I20260811 08:08:19.919924 7686 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a2c9aa1d92e14125b6259337c039a618: Neither blocks nor log segments found. Creating new log.
I20260811 08:08:19.920226 7686 log.cc:824] T 00000000000000000000000000000000 P a2c9aa1d92e14125b6259337c039a618: Log is configured to *not* fsync() on all Append() calls
I20260811 08:08:19.921001 7686 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a2c9aa1d92e14125b6259337c039a618: No bootstrap required, opened a new log
Aug 11 08:08:19 dist-test-slave-2w3w krb5kdc[7601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435699, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:08:19.923039 7686 raft_consensus.cc:348] T 00000000000000000000000000000000 P a2c9aa1d92e14125b6259337c039a618 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2c9aa1d92e14125b6259337c039a618" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 40213 } }
I20260811 08:08:19.923202 7686 raft_consensus.cc:374] T 00000000000000000000000000000000 P a2c9aa1d92e14125b6259337c039a618 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:08:19.923254 7686 raft_consensus.cc:729] T 00000000000000000000000000000000 P a2c9aa1d92e14125b6259337c039a618 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2c9aa1d92e14125b6259337c039a618, State: Initialized, Role: FOLLOWER
I20260811 08:08:19.923408 7686 consensus_queue.cc:260] T 00000000000000000000000000000000 P a2c9aa1d92e14125b6259337c039a618 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2c9aa1d92e14125b6259337c039a618" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 40213 } }
I20260811 08:08:19.923485 7686 raft_consensus.cc:388] T 00000000000000000000000000000000 P a2c9aa1d92e14125b6259337c039a618 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:08:19.923509 7686 raft_consensus.cc:482] T 00000000000000000000000000000000 P a2c9aa1d92e14125b6259337c039a618 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:08:19.923560 7686 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a2c9aa1d92e14125b6259337c039a618 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:08:19.924170 7686 raft_consensus.cc:504] T 00000000000000000000000000000000 P a2c9aa1d92e14125b6259337c039a618 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2c9aa1d92e14125b6259337c039a618" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 40213 } }
I20260811 08:08:19.924289 7686 leader_election.cc:302] T 00000000000000000000000000000000 P a2c9aa1d92e14125b6259337c039a618 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a2c9aa1d92e14125b6259337c039a618; no voters:
I20260811 08:08:19.924491 7686 leader_election.cc:288] T 00000000000000000000000000000000 P a2c9aa1d92e14125b6259337c039a618 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:08:19.924563 7692 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a2c9aa1d92e14125b6259337c039a618 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:08:19.924769 7692 raft_consensus.cc:686] T 00000000000000000000000000000000 P a2c9aa1d92e14125b6259337c039a618 [term 1 LEADER]: Becoming Leader. State: Replica: a2c9aa1d92e14125b6259337c039a618, State: Running, Role: LEADER
I20260811 08:08:19.924782 7686 sys_catalog.cc:564] T 00000000000000000000000000000000 P a2c9aa1d92e14125b6259337c039a618 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:08:19.924973 7692 consensus_queue.cc:237] T 00000000000000000000000000000000 P a2c9aa1d92e14125b6259337c039a618 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2c9aa1d92e14125b6259337c039a618" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 40213 } }
I20260811 08:08:19.925779 7694 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2c9aa1d92e14125b6259337c039a618 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a2c9aa1d92e14125b6259337c039a618. Latest consensus state: current_term: 1 leader_uuid: "a2c9aa1d92e14125b6259337c039a618" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2c9aa1d92e14125b6259337c039a618" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 40213 } } }
I20260811 08:08:19.925887 7694 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2c9aa1d92e14125b6259337c039a618 [sys.catalog]: This master's current role is: LEADER
I20260811 08:08:19.926143 7701 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:08:19.926740 7693 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2c9aa1d92e14125b6259337c039a618 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a2c9aa1d92e14125b6259337c039a618" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2c9aa1d92e14125b6259337c039a618" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 40213 } } }
I20260811 08:08:19.926865 7701 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:08:19.927112 7693 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2c9aa1d92e14125b6259337c039a618 [sys.catalog]: This master's current role is: LEADER
I20260811 08:08:19.927709 7689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:19.916395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50371 (local address 127.15.36.254:40213)
0811 08:08:19.916598 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:19.916606 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:19.916632 (+ 26us) server_negotiation.cc:407] Connection header received
0811 08:08:19.917292 (+ 660us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:19.917300 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:19.917351 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:19.917564 (+ 213us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:19.918225 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:19.919208 (+ 983us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:19.920005 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:19.920494 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:19.920624 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:19.923289 (+ 2665us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:19.923293 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:19.923294 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:19.923308 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:19.925408 (+ 2100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:19.925969 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:19.925972 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:19.925972 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:19.926099 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:19.926348 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:19.926348 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:19.926349 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:19.926705 (+ 356us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:19.926864 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:19.927419 (+ 555us) server_negotiation.cc:299] Negotiation successful
0811 08:08:19.927553 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":90,"threads_started":1}
I20260811 08:08:19.928733 15507 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:08:19.928972 7701 catalog_manager.cc:1347] Generated new cluster ID: ae2ce0550bde47d0b57ed16d316cb5b2
I20260811 08:08:19.929026 7701 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:08:19.938266 7689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:19.930225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57229 (local address 127.15.36.254:40213)
0811 08:08:19.930275 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:19.930277 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:19.931232 (+ 955us) server_negotiation.cc:407] Connection header received
0811 08:08:19.931317 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:19.931318 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:19.931329 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:19.931402 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:19.932010 (+ 608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:19.932886 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:19.933717 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:19.933964 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:19.934046 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:19.935516 (+ 1470us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:19.935518 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:19.935518 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:19.935526 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:19.937019 (+ 1493us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:19.937422 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:19.937424 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:19.937425 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:19.937487 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:19.937695 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:19.937696 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:19.937696 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:19.937819 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:19.937941 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:19.938054 (+ 113us) server_negotiation.cc:299] Negotiation successful
0811 08:08:19.938149 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 08:08:19.946542 7701 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:08:19.947221 7701 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:08:19.958282 7701 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a2c9aa1d92e14125b6259337c039a618: Generated new TSK 0
I20260811 08:08:19.958588 7701 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:08:19.966387 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 7614
2026-08-11T08:08:19Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1461 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786435400844580-15507-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:08:20 dist-test-slave-2w3w krb5kdc[7719](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:08:20 dist-test-slave-2w3w krb5kdc[7719](info): set up 2 sockets
Aug 11 08:08:20 dist-test-slave-2w3w krb5kdc[7719](info): commencing operation
krb5kdc: starting...
W20260811 08:08:21.094915 15507 mini_kdc.cc:121] Time spent starting KDC: real 1.107s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Aug 11 08:08:21 dist-test-slave-2w3w krb5kdc[7719](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435701, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:08:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:08:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.36.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab.
Entry for principal kudu/127.15.36.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab.
I20260811 08:08:21.231716 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786435400844580-15507-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786435400844580-15507-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786435400844580-15507-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:39711
--webserver_interface=127.15.36.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=kudu/127.15.36.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:35575
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.36.254:39711
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:08:21.316603 7734 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:08:21.316838 7734 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:08:21.316864 7734 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:08:21.318037 7734 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:08:21.318106 7734 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:08:21.318122 7734 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:08:21.318135 7734 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:08:21.318148 7734 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:08:21.319926 7734 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:35575
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786435400844580-15507-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786435400844580-15507-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.36.254:39711
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=kudu/127.15.36.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:39711
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.36.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7734
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786435400844580-15507-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:08:21.320191 7734 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:08:21.320403 7734 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:08:21.325693 7739 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:21.325693 7742 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:21.325784 7740 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:21.326128 7734 server_base.cc:1034] running on GCE node
I20260811 08:08:21.326413 7734 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:08:21.326740 7734 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:08:21.327924 7734 hybrid_clock.cc:648] HybridClock initialized: now 1786435701327887 us; error 72 us; skew 500 ppm
Aug 11 08:08:21 dist-test-slave-2w3w krb5kdc[7719](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435701, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:08:21.336510 7734 init.cc:377] Logged in from keytab as kudu/127.15.36.254@KRBTEST.COM (short username kudu)
I20260811 08:08:21.337078 7734 webserver.cc:460] Webserver started at http://127.15.36.254:39263/ using document root <none> and password file <none>
I20260811 08:08:21.337358 7734 fs_manager.cc:359] Metadata directory not provided
I20260811 08:08:21.337432 7734 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:08:21.337592 7734 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:08:21.338766 7734 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786435400844580-15507-0/minicluster-data/master-0/data/instance:
uuid: "f9b1cee4aff44840af7949a3f2b25fd2"
format_stamp: "Formatted at 2026-08-11 08:08:21 on dist-test-slave-2w3w"
server_key: "e9a412ebde6e67d5506d1d7a23cc469f"
server_key_iv: "5651fd9e8a7fc486f30a8226640750df"
server_key_version: "encryptionkey@0"
I20260811 08:08:21.339203 7734 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786435400844580-15507-0/minicluster-data/master-0/wal/instance:
uuid: "f9b1cee4aff44840af7949a3f2b25fd2"
format_stamp: "Formatted at 2026-08-11 08:08:21 on dist-test-slave-2w3w"
server_key: "e9a412ebde6e67d5506d1d7a23cc469f"
server_key_iv: "5651fd9e8a7fc486f30a8226640750df"
server_key_version: "encryptionkey@0"
I20260811 08:08:21.341156 7734 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260811 08:08:21.342212 7749 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:21.342453 7734 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:08:21.342576 7734 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786435400844580-15507-0/minicluster-data/master-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786435400844580-15507-0/minicluster-data/master-0/wal
uuid: "f9b1cee4aff44840af7949a3f2b25fd2"
format_stamp: "Formatted at 2026-08-11 08:08:21 on dist-test-slave-2w3w"
server_key: "e9a412ebde6e67d5506d1d7a23cc469f"
server_key_iv: "5651fd9e8a7fc486f30a8226640750df"
server_key_version: "encryptionkey@0"
I20260811 08:08:21.342675 7734 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786435400844580-15507-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786435400844580-15507-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786435400844580-15507-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:08:21.355355 7734 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:08:21.357559 7734 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:08:21.357735 7734 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:08:21.362030 7734 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.254:39711
I20260811 08:08:21.362073 7806 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.254:39711 every 8 connection(s)
I20260811 08:08:21.362444 7734 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
I20260811 08:08:21.363399 7807 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:08:21.365650 7807 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f9b1cee4aff44840af7949a3f2b25fd2: Bootstrap starting.
I20260811 08:08:21.366194 7807 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f9b1cee4aff44840af7949a3f2b25fd2: Neither blocks nor log segments found. Creating new log.
I20260811 08:08:21.366437 7807 log.cc:824] T 00000000000000000000000000000000 P f9b1cee4aff44840af7949a3f2b25fd2: Log is configured to *not* fsync() on all Append() calls
I20260811 08:08:21.367247 7807 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f9b1cee4aff44840af7949a3f2b25fd2: No bootstrap required, opened a new log
I20260811 08:08:21.367653 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 7734
I20260811 08:08:21.367769 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786435400844580-15507-0/minicluster-data/master-0/wal/instance
I20260811 08:08:21.367972 15507 external_mini_cluster.cc:1428] Setting key c38e38c1f4444dff7a47375009e66cb5
I20260811 08:08:21.369525 7807 raft_consensus.cc:348] T 00000000000000000000000000000000 P f9b1cee4aff44840af7949a3f2b25fd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9b1cee4aff44840af7949a3f2b25fd2" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 39711 } }
I20260811 08:08:21.369704 7807 raft_consensus.cc:374] T 00000000000000000000000000000000 P f9b1cee4aff44840af7949a3f2b25fd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:08:21.369743 7807 raft_consensus.cc:729] T 00000000000000000000000000000000 P f9b1cee4aff44840af7949a3f2b25fd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9b1cee4aff44840af7949a3f2b25fd2, State: Initialized, Role: FOLLOWER
I20260811 08:08:21.369922 7807 consensus_queue.cc:260] T 00000000000000000000000000000000 P f9b1cee4aff44840af7949a3f2b25fd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9b1cee4aff44840af7949a3f2b25fd2" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 39711 } }
I20260811 08:08:21.370033 7807 raft_consensus.cc:388] T 00000000000000000000000000000000 P f9b1cee4aff44840af7949a3f2b25fd2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:08:21.370065 7807 raft_consensus.cc:482] T 00000000000000000000000000000000 P f9b1cee4aff44840af7949a3f2b25fd2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:08:21.370105 7807 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f9b1cee4aff44840af7949a3f2b25fd2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:08:21.370898 7807 raft_consensus.cc:504] T 00000000000000000000000000000000 P f9b1cee4aff44840af7949a3f2b25fd2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9b1cee4aff44840af7949a3f2b25fd2" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 39711 } }
I20260811 08:08:21.371027 7807 leader_election.cc:302] T 00000000000000000000000000000000 P f9b1cee4aff44840af7949a3f2b25fd2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f9b1cee4aff44840af7949a3f2b25fd2; no voters:
I20260811 08:08:21.371196 7807 leader_election.cc:288] T 00000000000000000000000000000000 P f9b1cee4aff44840af7949a3f2b25fd2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:08:21.371253 7812 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f9b1cee4aff44840af7949a3f2b25fd2 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:08:21.371445 7807 sys_catalog.cc:564] T 00000000000000000000000000000000 P f9b1cee4aff44840af7949a3f2b25fd2 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:08:21.371480 7812 raft_consensus.cc:686] T 00000000000000000000000000000000 P f9b1cee4aff44840af7949a3f2b25fd2 [term 1 LEADER]: Becoming Leader. State: Replica: f9b1cee4aff44840af7949a3f2b25fd2, State: Running, Role: LEADER
I20260811 08:08:21.371694 7812 consensus_queue.cc:237] T 00000000000000000000000000000000 P f9b1cee4aff44840af7949a3f2b25fd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9b1cee4aff44840af7949a3f2b25fd2" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 39711 } }
I20260811 08:08:21.372071 7813 sys_catalog.cc:455] T 00000000000000000000000000000000 P f9b1cee4aff44840af7949a3f2b25fd2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f9b1cee4aff44840af7949a3f2b25fd2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9b1cee4aff44840af7949a3f2b25fd2" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 39711 } } }
I20260811 08:08:21.372151 7813 sys_catalog.cc:458] T 00000000000000000000000000000000 P f9b1cee4aff44840af7949a3f2b25fd2 [sys.catalog]: This master's current role is: LEADER
I20260811 08:08:21.372399 7814 sys_catalog.cc:455] T 00000000000000000000000000000000 P f9b1cee4aff44840af7949a3f2b25fd2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f9b1cee4aff44840af7949a3f2b25fd2. Latest consensus state: current_term: 1 leader_uuid: "f9b1cee4aff44840af7949a3f2b25fd2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9b1cee4aff44840af7949a3f2b25fd2" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 39711 } } }
I20260811 08:08:21.372648 7814 sys_catalog.cc:458] T 00000000000000000000000000000000 P f9b1cee4aff44840af7949a3f2b25fd2 [sys.catalog]: This master's current role is: LEADER
I20260811 08:08:21.372901 7821 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:08:21.373512 7821 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:08:21.375264 7821 catalog_manager.cc:1347] Generated new cluster ID: 5b83c159c2d341d18e137ab64334f789
I20260811 08:08:21.375327 7821 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:08:21.375380 7811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:21.368575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60393 (local address 127.15.36.254:39711)
0811 08:08:21.368778 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:21.368788 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:21.368823 (+ 35us) server_negotiation.cc:407] Connection header received
0811 08:08:21.369488 (+ 665us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:21.369497 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:21.369563 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:21.369719 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:21.370024 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:21.371820 (+ 1796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:21.373015 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:21.373614 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:21.373722 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:21.374572 (+ 850us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:21.374576 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:21.374576 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:08:21.374824 (+ 248us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:21.374874 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:08:21.374887 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:21.374964 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:21.375067 (+ 103us) server_negotiation.cc:299] Negotiation successful
0811 08:08:21.375133 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":85,"threads_started":1}
I20260811 08:08:21.376125 15507 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:08:21.381018 7811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:21.377562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50069 (local address 127.15.36.254:39711)
0811 08:08:21.377595 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:21.377596 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:21.377697 (+ 101us) server_negotiation.cc:407] Connection header received
0811 08:08:21.377776 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:21.377777 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:21.377795 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:21.377823 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:21.377987 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:21.378671 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:21.379677 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:21.379975 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:21.380011 (+ 36us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:21.380760 (+ 749us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:21.380761 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:21.380762 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:08:21.380767 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:21.380780 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:08:21.380784 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:21.380817 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:21.380914 (+ 97us) server_negotiation.cc:299] Negotiation successful
0811 08:08:21.380936 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 08:08:21.383603 7821 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:08:21.384315 7821 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:08:21.388568 7821 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f9b1cee4aff44840af7949a3f2b25fd2: Generated new TSK 0
I20260811 08:08:21.388787 7821 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:08:21.392726 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 7734
2026-08-11T08:08:21Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1425 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786435400844580-15507-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:08:21 dist-test-slave-2w3w krb5kdc[7839](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:08:21 dist-test-slave-2w3w krb5kdc[7839](info): set up 2 sockets
Aug 11 08:08:21 dist-test-slave-2w3w krb5kdc[7839](info): commencing operation
krb5kdc: starting...
W20260811 08:08:22.528122 15507 mini_kdc.cc:121] Time spent starting KDC: real 1.114s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Aug 11 08:08:22 dist-test-slave-2w3w krb5kdc[7839](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435702, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:08:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:08:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.36.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab.
Entry for principal kudu/127.15.36.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab.
I20260811 08:08:22.681766 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786435400844580-15507-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786435400844580-15507-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786435400844580-15507-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:46337
--webserver_interface=127.15.36.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=kudu/127.15.36.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:43285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.36.254:46337
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:08:22.767259 7854 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:08:22.767524 7854 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:08:22.767565 7854 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:08:22.768756 7854 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:08:22.768849 7854 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:08:22.768875 7854 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:08:22.768906 7854 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:08:22.768936 7854 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:08:22.770496 7854 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:43285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786435400844580-15507-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786435400844580-15507-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.36.254:46337
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=kudu/127.15.36.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:46337
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.36.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7854
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786435400844580-15507-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:08:22.770809 7854 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:08:22.771088 7854 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:08:22.776104 7860 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:22.776165 7859 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:22.776104 7862 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:22.776528 7854 server_base.cc:1034] running on GCE node
I20260811 08:08:22.776743 7854 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:08:22.777015 7854 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:08:22.778215 7854 hybrid_clock.cc:648] HybridClock initialized: now 1786435702778196 us; error 33 us; skew 500 ppm
Aug 11 08:08:22 dist-test-slave-2w3w krb5kdc[7839](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435702, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:08:22.781093 7854 init.cc:377] Logged in from keytab as kudu/127.15.36.254@KRBTEST.COM (short username kudu)
I20260811 08:08:22.781647 7854 webserver.cc:460] Webserver started at http://127.15.36.254:33097/ using document root <none> and password file <none>
I20260811 08:08:22.781894 7854 fs_manager.cc:359] Metadata directory not provided
I20260811 08:08:22.781967 7854 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:08:22.782130 7854 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:08:22.783363 7854 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786435400844580-15507-0/minicluster-data/master-0/data/instance:
uuid: "7f887e379c6d46828815ca3607d42082"
format_stamp: "Formatted at 2026-08-11 08:08:22 on dist-test-slave-2w3w"
server_key: "acf1b80bbdbcf7ab522f47869ff64ae2"
server_key_iv: "ad9a36331a3880cb59058da6a4f22695"
server_key_version: "encryptionkey@0"
I20260811 08:08:22.783767 7854 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786435400844580-15507-0/minicluster-data/master-0/wal/instance:
uuid: "7f887e379c6d46828815ca3607d42082"
format_stamp: "Formatted at 2026-08-11 08:08:22 on dist-test-slave-2w3w"
server_key: "acf1b80bbdbcf7ab522f47869ff64ae2"
server_key_iv: "ad9a36331a3880cb59058da6a4f22695"
server_key_version: "encryptionkey@0"
I20260811 08:08:22.785207 7854 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:08:22.786077 7870 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:22.786332 7854 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:08:22.786455 7854 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786435400844580-15507-0/minicluster-data/master-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786435400844580-15507-0/minicluster-data/master-0/wal
uuid: "7f887e379c6d46828815ca3607d42082"
format_stamp: "Formatted at 2026-08-11 08:08:22 on dist-test-slave-2w3w"
server_key: "acf1b80bbdbcf7ab522f47869ff64ae2"
server_key_iv: "ad9a36331a3880cb59058da6a4f22695"
server_key_version: "encryptionkey@0"
I20260811 08:08:22.786540 7854 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786435400844580-15507-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786435400844580-15507-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786435400844580-15507-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:08:22.790212 7854 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:08:22.792714 7854 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:08:22.792897 7854 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:08:22.797524 7854 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.254:46337
I20260811 08:08:22.797571 7925 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.254:46337 every 8 connection(s)
I20260811 08:08:22.797924 7854 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
I20260811 08:08:22.799072 7926 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:08:22.801410 7926 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f887e379c6d46828815ca3607d42082: Bootstrap starting.
I20260811 08:08:22.802024 7926 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7f887e379c6d46828815ca3607d42082: Neither blocks nor log segments found. Creating new log.
I20260811 08:08:22.802338 7926 log.cc:824] T 00000000000000000000000000000000 P 7f887e379c6d46828815ca3607d42082: Log is configured to *not* fsync() on all Append() calls
I20260811 08:08:22.803102 7926 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f887e379c6d46828815ca3607d42082: No bootstrap required, opened a new log
I20260811 08:08:22.804826 7926 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7f887e379c6d46828815ca3607d42082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f887e379c6d46828815ca3607d42082" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 46337 } }
I20260811 08:08:22.804982 7926 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7f887e379c6d46828815ca3607d42082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:08:22.805006 7926 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7f887e379c6d46828815ca3607d42082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f887e379c6d46828815ca3607d42082, State: Initialized, Role: FOLLOWER
I20260811 08:08:22.805158 7926 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7f887e379c6d46828815ca3607d42082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f887e379c6d46828815ca3607d42082" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 46337 } }
I20260811 08:08:22.805233 7926 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7f887e379c6d46828815ca3607d42082 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:08:22.805279 7926 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7f887e379c6d46828815ca3607d42082 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:08:22.805334 7926 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7f887e379c6d46828815ca3607d42082 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:08:22.806221 7926 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7f887e379c6d46828815ca3607d42082 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f887e379c6d46828815ca3607d42082" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 46337 } }
I20260811 08:08:22.806318 7926 leader_election.cc:302] T 00000000000000000000000000000000 P 7f887e379c6d46828815ca3607d42082 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7f887e379c6d46828815ca3607d42082; no voters:
I20260811 08:08:22.806516 7926 leader_election.cc:288] T 00000000000000000000000000000000 P 7f887e379c6d46828815ca3607d42082 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:08:22.806660 7929 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7f887e379c6d46828815ca3607d42082 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:08:22.806846 7926 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7f887e379c6d46828815ca3607d42082 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:08:22.806883 7929 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7f887e379c6d46828815ca3607d42082 [term 1 LEADER]: Becoming Leader. State: Replica: 7f887e379c6d46828815ca3607d42082, State: Running, Role: LEADER
I20260811 08:08:22.807050 7929 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7f887e379c6d46828815ca3607d42082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f887e379c6d46828815ca3607d42082" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 46337 } }
I20260811 08:08:22.807503 7931 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f887e379c6d46828815ca3607d42082 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7f887e379c6d46828815ca3607d42082. Latest consensus state: current_term: 1 leader_uuid: "7f887e379c6d46828815ca3607d42082" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f887e379c6d46828815ca3607d42082" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 46337 } } }
I20260811 08:08:22.807605 7931 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f887e379c6d46828815ca3607d42082 [sys.catalog]: This master's current role is: LEADER
I20260811 08:08:22.807629 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 7854
I20260811 08:08:22.807770 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786435400844580-15507-0/minicluster-data/master-0/wal/instance
I20260811 08:08:22.807760 7930 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f887e379c6d46828815ca3607d42082 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7f887e379c6d46828815ca3607d42082" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f887e379c6d46828815ca3607d42082" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 46337 } } }
I20260811 08:08:22.807818 7930 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f887e379c6d46828815ca3607d42082 [sys.catalog]: This master's current role is: LEADER
I20260811 08:08:22.808012 15507 external_mini_cluster.cc:1428] Setting key 86db92219796dd8178056dacb5dc60c8
I20260811 08:08:22.808148 7935 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:08:22.808712 7935 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:08:22.810765 7935 catalog_manager.cc:1347] Generated new cluster ID: 6b4a5eaade574f499197784e73c6de16
I20260811 08:08:22.810849 7944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:22.808565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56139 (local address 127.15.36.254:46337)
0811 08:08:22.808750 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:22.808763 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:22.808958 (+ 195us) server_negotiation.cc:407] Connection header received
0811 08:08:22.809100 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:22.809107 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:22.809141 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:22.809301 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:22.810388 (+ 1087us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:22.810391 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:22.810391 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:08:22.810396 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:22.810435 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:08:22.810446 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:22.810524 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:22.810600 (+ 76us) server_negotiation.cc:299] Negotiation successful
0811 08:08:22.810646 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":90,"threads_started":1}
I20260811 08:08:22.811342 7935 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:08:22.812372 15507 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:08:22.818861 7935 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:08:22.819080 7935 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:08:22.820340 7944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:22.818817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34845 (local address 127.15.36.254:46337)
0811 08:08:22.818866 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:22.818869 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:22.819175 (+ 306us) server_negotiation.cc:407] Connection header received
0811 08:08:22.819289 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:22.819290 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:22.819310 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:22.819371 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:22.820095 (+ 724us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:22.820097 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:22.820097 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:08:22.820103 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:22.820117 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:08:22.820122 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:22.820175 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:22.820229 (+ 54us) server_negotiation.cc:299] Negotiation successful
0811 08:08:22.820246 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 08:08:22.828286 7935 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7f887e379c6d46828815ca3607d42082: Generated new TSK 0
I20260811 08:08:22.828540 7935 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:08:22.830899 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 7854
2026-08-11T08:08:22Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1438 ms)
[----------] 18 tests from AuthTokenIssuingTest (25731 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:08:22 dist-test-slave-2w3w krb5kdc[7962](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:08:22 dist-test-slave-2w3w krb5kdc[7962](info): set up 2 sockets
Aug 11 08:08:22 dist-test-slave-2w3w krb5kdc[7962](info): commencing operation
krb5kdc: starting...
W20260811 08:08:23.963255 15507 mini_kdc.cc:121] Time spent starting KDC: real 1.111s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Aug 11 08:08:24 dist-test-slave-2w3w krb5kdc[7962](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435704, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:08:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:08:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.36.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab.
Entry for principal kudu/127.15.36.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab.
I20260811 08:08:24.102618 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:34673
--webserver_interface=127.15.36.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=kudu/127.15.36.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:33427
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.36.254:34673,127.15.36.253:43393,127.15.36.252:42213
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:08:24.187376 7975 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 08:08:24.187656 7975 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:08:24.187688 7975 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:08:24.187741 7975 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:08:24.188898 7975 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:08:24.188975 7975 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:08:24.189002 7975 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:08:24.189029 7975 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:08:24.189061 7975 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:08:24.190625 7975 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:33427
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.36.254:34673,127.15.36.253:43393,127.15.36.252:42213
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=kudu/127.15.36.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:34673
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.36.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7975
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:08:24.190948 7975 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:08:24.191246 7975 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 08:08:24.196866 7975 server_base.cc:1034] running on GCE node
W20260811 08:08:24.196839 7980 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:24.196831 7981 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:24.196830 7983 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:24.197365 7975 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:08:24.197736 7975 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:08:24.199047 7975 hybrid_clock.cc:648] HybridClock initialized: now 1786435704199011 us; error 44 us; skew 500 ppm
Aug 11 08:08:24 dist-test-slave-2w3w krb5kdc[7962](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435704, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:08:24.201930 7975 init.cc:377] Logged in from keytab as kudu/127.15.36.254@KRBTEST.COM (short username kudu)
I20260811 08:08:24.202462 7975 webserver.cc:460] Webserver started at http://127.15.36.254:40843/ using document root <none> and password file <none>
I20260811 08:08:24.202713 7975 fs_manager.cc:359] Metadata directory not provided
I20260811 08:08:24.202785 7975 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:08:24.202950 7975 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:08:24.204074 7975 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/minicluster-data/master-0/data/instance:
uuid: "9c33f5cad58845eabe5811361dd9b3c6"
format_stamp: "Formatted at 2026-08-11 08:08:24 on dist-test-slave-2w3w"
server_key: "d289339344d11008fd76c5e5661dd5fe"
server_key_iv: "af48c38497496563c09abc95307e8fcd"
server_key_version: "encryptionkey@0"
I20260811 08:08:24.204440 7975 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/minicluster-data/master-0/wal/instance:
uuid: "9c33f5cad58845eabe5811361dd9b3c6"
format_stamp: "Formatted at 2026-08-11 08:08:24 on dist-test-slave-2w3w"
server_key: "d289339344d11008fd76c5e5661dd5fe"
server_key_iv: "af48c38497496563c09abc95307e8fcd"
server_key_version: "encryptionkey@0"
I20260811 08:08:24.205842 7975 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 08:08:24.206635 7991 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:24.206841 7975 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:08:24.207008 7975 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/minicluster-data/master-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/minicluster-data/master-0/wal
uuid: "9c33f5cad58845eabe5811361dd9b3c6"
format_stamp: "Formatted at 2026-08-11 08:08:24 on dist-test-slave-2w3w"
server_key: "d289339344d11008fd76c5e5661dd5fe"
server_key_iv: "af48c38497496563c09abc95307e8fcd"
server_key_version: "encryptionkey@0"
I20260811 08:08:24.207089 7975 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:08:24.216741 7975 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:08:24.218935 7975 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:08:24.219163 7975 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:08:24.223600 7975 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.254:34673
I20260811 08:08:24.223644 8047 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.254:34673 every 8 connection(s)
I20260811 08:08:24.224079 7975 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
I20260811 08:08:24.225143 8048 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:08:24.226791 8048 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.36.254" port: 34673 } has no permanent_uuid. Determining permanent_uuid...
I20260811 08:08:24.228657 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 7975
I20260811 08:08:24.228768 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/minicluster-data/master-0/wal/instance
I20260811 08:08:24.228978 15507 external_mini_cluster.cc:1428] Setting key f8a319b96efb3a22d75cefcf4c37ffd4
Aug 11 08:08:24 dist-test-slave-2w3w krb5kdc[7962](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435704, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.254@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.15.36.253@KRBTEST.COM; defaulting to no policy
I20260811 08:08:24.240051 8051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:24.227690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40022 (local address 127.15.36.254:34673)
0811 08:08:24.227892 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:24.227896 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:24.227982 (+ 86us) server_negotiation.cc:407] Connection header received
0811 08:08:24.228557 (+ 575us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:24.228560 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:24.228587 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:24.228698 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:24.229649 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:24.231275 (+ 1626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:24.232753 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:24.233135 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:24.233247 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:24.236366 (+ 3119us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:24.236377 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:24.236377 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:24.236386 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:24.238151 (+ 1765us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:24.238691 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:24.238694 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:24.238694 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:24.238800 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:24.239167 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:24.239168 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:24.239168 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:24.239431 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:24.239531 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:24.239734 (+ 203us) server_negotiation.cc:299] Negotiation successful
0811 08:08:24.239858 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":173,"thread_start_us":99,"threads_started":1}
I20260811 08:08:24.240067 8050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:24.227588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:34673 (local address 127.0.0.1:40022)
0811 08:08:24.227784 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:24.227880 (+ 96us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:24.228369 (+ 489us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:24.228755 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:24.228759 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:24.229281 (+ 522us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:08:24.229530 (+ 249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:24.229536 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:24.231408 (+ 1872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:24.231409 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:24.232619 (+ 1210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:24.232623 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:24.233277 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:24.233278 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:24.233373 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:24.234109 (+ 736us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:08:24.234125 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:08:24.236244 (+ 2119us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:08:24.238250 (+ 2006us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:24.238259 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:24.238261 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:24.238571 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:24.238925 (+ 354us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:24.238926 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:24.238926 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:24.239102 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:24.239510 (+ 408us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:08:24.239524 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:08:24.239590 (+ 66us) client_negotiation.cc:769] Sending connection context
0811 08:08:24.239677 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 08:08:24.239971 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"mutex_wait_us":137,"thread_start_us":90,"threads_started":1}
I20260811 08:08:24.240963 8048 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.36.253" port: 43393 } has no permanent_uuid. Determining permanent_uuid...
I20260811 08:08:24.241381 8050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:24.241234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.253:43393 (local address 127.0.0.1:41706)
0811 08:08:24.241307 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:24.241354 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.253:43393: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260811 08:08:24.241536 7992 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.36.253:43393: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.253@KRBTEST.COM" created.
I20260811 08:08:24.242027 8050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:24.241918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.253:43393 (local address 127.0.0.1:41712)
0811 08:08:24.241972 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:24.242004 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.253:43393: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260811 08:08:24.242178 8048 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.36.253:43393: Network error: Client connection negotiation failed: client connection to 127.15.36.253:43393: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.253.keytab.
Entry for principal kudu/127.15.36.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.253.keytab.
I20260811 08:08:24.258596 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.253:43393
--webserver_interface=127.15.36.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.253.keytab
--principal=kudu/127.15.36.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:33427
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.36.254:34673,127.15.36.253:43393,127.15.36.252:42213
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 08:08:24.291455 8048 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.36.253" port: 43393 } attempt: 1
I20260811 08:08:24.292102 8050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:24.291943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.253:43393 (local address 127.0.0.1:41726)
0811 08:08:24.292022 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:24.292068 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.253:43393: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260811 08:08:24.292514 8050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:24.292416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.253:43393 (local address 127.0.0.1:41728)
0811 08:08:24.292471 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:24.292497 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.253:43393: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260811 08:08:24.292639 8048 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.36.253:43393: Network error: Client connection negotiation failed: client connection to 127.15.36.253:43393: connect: Connection refused (error 111)
W20260811 08:08:24.346395 8056 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 08:08:24.346635 8056 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:08:24.346653 8056 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:08:24.346676 8056 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:08:24.347849 8056 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:08:24.347892 8056 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:08:24.347906 8056 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:08:24.347919 8056 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:08:24.347931 8056 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:08:24.349428 8056 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:33427
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.15.36.254:34673,127.15.36.253:43393,127.15.36.252:42213
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.253.keytab
--principal=kudu/127.15.36.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.253:43393
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.15.36.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8056
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:08:24.349656 8056 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:08:24.349860 8056 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:08:24.355379 8062 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:24.355379 8061 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:24.355461 8064 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:24.355854 8056 server_base.cc:1034] running on GCE node
I20260811 08:08:24.356098 8056 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:08:24.356390 8056 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:08:24.357566 8056 hybrid_clock.cc:648] HybridClock initialized: now 1786435704357549 us; error 41 us; skew 500 ppm
Aug 11 08:08:24 dist-test-slave-2w3w krb5kdc[7962](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435704, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:08:24.360422 8056 init.cc:377] Logged in from keytab as kudu/127.15.36.253@KRBTEST.COM (short username kudu)
I20260811 08:08:24.360821 8048 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.36.253" port: 43393 } attempt: 2
I20260811 08:08:24.360915 8056 webserver.cc:460] Webserver started at http://127.15.36.253:44915/ using document root <none> and password file <none>
I20260811 08:08:24.361181 8056 fs_manager.cc:359] Metadata directory not provided
I20260811 08:08:24.361234 8056 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:08:24.361263 8050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:24.361095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.253:43393 (local address 127.0.0.1:41736)
0811 08:08:24.361161 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:24.361199 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.253:43393: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260811 08:08:24.361378 8056 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:08:24.361630 8050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:24.361539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.253:43393 (local address 127.0.0.1:41746)
0811 08:08:24.361586 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:24.361612 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.253:43393: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260811 08:08:24.361833 8048 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.36.253:43393: Network error: Client connection negotiation failed: client connection to 127.15.36.253:43393: connect: Connection refused (error 111)
I20260811 08:08:24.362671 8056 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/minicluster-data/master-1/data/instance:
uuid: "d68d03f6ba3c447c85384edc3a616e96"
format_stamp: "Formatted at 2026-08-11 08:08:24 on dist-test-slave-2w3w"
server_key: "81e8df3e7ebb376f7f02b8cfb0d82ef3"
server_key_iv: "4b3c012f28ca32e659db64cee89eccc9"
server_key_version: "encryptionkey@0"
I20260811 08:08:24.363078 8056 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/minicluster-data/master-1/wal/instance:
uuid: "d68d03f6ba3c447c85384edc3a616e96"
format_stamp: "Formatted at 2026-08-11 08:08:24 on dist-test-slave-2w3w"
server_key: "81e8df3e7ebb376f7f02b8cfb0d82ef3"
server_key_iv: "4b3c012f28ca32e659db64cee89eccc9"
server_key_version: "encryptionkey@0"
I20260811 08:08:24.364557 8056 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:08:24.365550 8073 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:24.365780 8056 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:08:24.365933 8056 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/minicluster-data/master-1/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/minicluster-data/master-1/wal
uuid: "d68d03f6ba3c447c85384edc3a616e96"
format_stamp: "Formatted at 2026-08-11 08:08:24 on dist-test-slave-2w3w"
server_key: "81e8df3e7ebb376f7f02b8cfb0d82ef3"
server_key_iv: "4b3c012f28ca32e659db64cee89eccc9"
server_key_version: "encryptionkey@0"
I20260811 08:08:24.366019 8056 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:08:24.392768 8056 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:08:24.395215 8056 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:08:24.395532 8056 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:08:24.399920 8056 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.253:43393
I20260811 08:08:24.399958 8131 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.253:43393 every 8 connection(s)
I20260811 08:08:24.400347 8056 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/minicluster-data/master-1/data/info.pb
I20260811 08:08:24.401535 8132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:08:24.403277 8132 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.36.254" port: 34673 } has no permanent_uuid. Determining permanent_uuid...
I20260811 08:08:24.405802 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 8056
I20260811 08:08:24.405901 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/minicluster-data/master-1/wal/instance
I20260811 08:08:24.406112 15507 external_mini_cluster.cc:1428] Setting key abc2f51454911d45552892e59af204d9
Aug 11 08:08:24 dist-test-slave-2w3w krb5kdc[7962](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435704, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.253@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:08:24.414587 8051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:24.404081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40026 (local address 127.15.36.254:34673)
0811 08:08:24.404148 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:24.404150 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:24.404388 (+ 238us) server_negotiation.cc:407] Connection header received
0811 08:08:24.404973 (+ 585us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:24.404974 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:24.404990 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:24.405053 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:24.405771 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:24.406453 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:24.408073 (+ 1620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:24.408438 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:24.408523 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:24.411214 (+ 2691us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:24.411216 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:24.411216 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:24.411225 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:24.412981 (+ 1756us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:24.413465 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:24.413466 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:24.413467 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:24.413540 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:24.413808 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:24.413809 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:24.413810 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:24.413972 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:24.414050 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:24.414362 (+ 312us) server_negotiation.cc:299] Negotiation successful
0811 08:08:24.414465 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 08:08:24.414700 8134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:24.404037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:34673 (local address 127.0.0.1:40026)
0811 08:08:24.404256 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:24.404298 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:24.404853 (+ 555us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:24.405143 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:24.405146 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:24.405409 (+ 263us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:08:24.405648 (+ 239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:24.405654 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:24.406557 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:24.406558 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:24.407967 (+ 1409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:24.407971 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:24.408545 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:24.408546 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:24.408666 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:24.409296 (+ 630us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:08:24.409305 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:08:24.411113 (+ 1808us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:08:24.413093 (+ 1980us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:24.413101 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:24.413103 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:24.413373 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:24.413618 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:24.413619 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:24.413619 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:24.413732 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:24.414069 (+ 337us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:08:24.414077 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:08:24.414212 (+ 135us) client_negotiation.cc:769] Sending connection context
0811 08:08:24.414316 (+ 104us) client_negotiation.cc:240] Negotiation successful
0811 08:08:24.414469 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":107,"threads_started":1}
I20260811 08:08:24.415449 8132 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.36.253" port: 43393 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.15.36.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.252@KRBTEST.COM" created.
Aug 11 08:08:24 dist-test-slave-2w3w krb5kdc[7962](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435704, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.253@KRBTEST.COM for kudu/127.15.36.253@KRBTEST.COM
I20260811 08:08:24.423851 8134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:24.415738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.253:43393 (local address 127.0.0.1:41750)
0811 08:08:24.415982 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:24.415994 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:24.416049 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:24.416232 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:24.416234 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:24.416378 (+ 144us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:08:24.416428 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:24.416430 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:24.417475 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:24.417476 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:24.418030 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:24.418032 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:24.418641 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:24.418642 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:24.418727 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:24.419282 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:08:24.419287 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:08:24.420765 (+ 1478us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:08:24.422667 (+ 1902us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:24.422668 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:24.422668 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:24.422847 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:24.423112 (+ 265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:24.423113 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:24.423113 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:24.423170 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:24.423604 (+ 434us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:08:24.423604 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:08:24.423643 (+ 39us) client_negotiation.cc:769] Sending connection context
0811 08:08:24.423698 (+ 55us) client_negotiation.cc:240] Negotiation successful
0811 08:08:24.423778 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260811 08:08:24.424023 8136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:24.415822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41750 (local address 127.15.36.253:43393)
0811 08:08:24.415997 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:24.416002 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:24.416048 (+ 46us) server_negotiation.cc:407] Connection header received
0811 08:08:24.416106 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:24.416109 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:24.416123 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:24.416229 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:24.416509 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:24.417354 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:24.418181 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:24.418521 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:24.418617 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:24.420872 (+ 2255us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:24.420881 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:24.420882 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:24.420909 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:24.422559 (+ 1650us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:24.422949 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:24.422953 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:24.422953 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:24.423044 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:24.423259 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:24.423261 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:24.423262 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:24.423520 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:24.423628 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:24.423763 (+ 135us) server_negotiation.cc:299] Negotiation successful
0811 08:08:24.423861 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":114,"threads_started":1}
I20260811 08:08:24.424628 8132 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.36.252" port: 42213 } has no permanent_uuid. Determining permanent_uuid...
I20260811 08:08:24.425048 8134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:24.424921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.252:42213 (local address 127.0.0.1:42916)
0811 08:08:24.424974 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:24.425026 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.252:42213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260811 08:08:24.425182 8078 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.36.252:42213: connect: Connection refused (error 111)
I20260811 08:08:24.425624 8134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:24.425521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.252:42213 (local address 127.0.0.1:42918)
0811 08:08:24.425572 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:24.425597 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.252:42213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260811 08:08:24.425726 8132 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.36.252:42213: Network error: Client connection negotiation failed: client connection to 127.15.36.252:42213: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.252.keytab.
Entry for principal kudu/127.15.36.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.252.keytab.
I20260811 08:08:24.438726 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.252:42213
--webserver_interface=127.15.36.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.252.keytab
--principal=kudu/127.15.36.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:33427
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.36.254:34673,127.15.36.253:43393,127.15.36.252:42213
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 08:08:24.452992 8048 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.36.253" port: 43393 } attempt: 3
Aug 11 08:08:24 dist-test-slave-2w3w krb5kdc[7962](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435704, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.254@KRBTEST.COM for kudu/127.15.36.253@KRBTEST.COM
I20260811 08:08:24.460660 8050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:24.453381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.253:43393 (local address 127.0.0.1:41762)
0811 08:08:24.453450 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:24.453463 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:24.453542 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:24.453697 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:24.453698 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:24.453871 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:08:24.453969 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:24.453971 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:24.454678 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:24.454679 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:24.455410 (+ 731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:24.455414 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:24.455843 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:24.455844 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:24.455922 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:24.456425 (+ 503us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:08:24.456430 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:08:24.457869 (+ 1439us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:08:24.459544 (+ 1675us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:24.459545 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:24.459545 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:24.459719 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:24.459977 (+ 258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:24.459977 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:24.459978 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:24.460040 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:24.460300 (+ 260us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:08:24.460301 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:08:24.460350 (+ 49us) client_negotiation.cc:769] Sending connection context
0811 08:08:24.460445 (+ 95us) client_negotiation.cc:240] Negotiation successful
0811 08:08:24.460553 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260811 08:08:24.460660 8136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:24.453473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41762 (local address 127.15.36.253:43393)
0811 08:08:24.453561 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:24.453564 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:24.453581 (+ 17us) server_negotiation.cc:407] Connection header received
0811 08:08:24.453617 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:24.453618 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:24.453626 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:24.453691 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:24.454066 (+ 375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:24.454586 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:24.455513 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:24.455756 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:24.455838 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:24.457983 (+ 2145us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:24.457984 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:24.457984 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:24.457995 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:24.459442 (+ 1447us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:24.459806 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:24.459807 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:24.459808 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:24.459898 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:24.460114 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:24.460115 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:24.460115 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:24.460233 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:24.460309 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:24.460471 (+ 162us) server_negotiation.cc:299] Negotiation successful
0811 08:08:24.460553 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 08:08:24.461359 8048 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.36.252" port: 42213 } has no permanent_uuid. Determining permanent_uuid...
I20260811 08:08:24.461759 8050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:24.461640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.252:42213 (local address 127.0.0.1:42926)
0811 08:08:24.461698 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:24.461734 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.252:42213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260811 08:08:24.462157 8050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:24.462075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.252:42213 (local address 127.0.0.1:42930)
0811 08:08:24.462115 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:24.462139 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.252:42213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260811 08:08:24.462265 8048 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.36.252:42213: Network error: Client connection negotiation failed: client connection to 127.15.36.252:42213: connect: Connection refused (error 111)
I20260811 08:08:24.475003 8132 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.36.252" port: 42213 } attempt: 1
I20260811 08:08:24.475565 8134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:24.475396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.252:42213 (local address 127.0.0.1:42938)
0811 08:08:24.475469 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:24.475523 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.252:42213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260811 08:08:24.475976 8134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:24.475873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.252:42213 (local address 127.0.0.1:42948)
0811 08:08:24.475920 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:24.475956 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.252:42213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260811 08:08:24.476131 8132 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.36.252:42213: Network error: Client connection negotiation failed: client connection to 127.15.36.252:42213: connect: Connection refused (error 111)
I20260811 08:08:24.493456 8048 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.36.252" port: 42213 } attempt: 1
I20260811 08:08:24.494068 8050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:24.493898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.252:42213 (local address 127.0.0.1:42962)
0811 08:08:24.493976 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:24.494027 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.252:42213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260811 08:08:24.494576 8050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:24.494472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.252:42213 (local address 127.0.0.1:42974)
0811 08:08:24.494522 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:24.494552 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.252:42213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260811 08:08:24.494732 8048 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.36.252:42213: Network error: Client connection negotiation failed: client connection to 127.15.36.252:42213: connect: Connection refused (error 111)
W20260811 08:08:24.528364 8140 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 08:08:24.528633 8140 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:08:24.528652 8140 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:08:24.528676 8140 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:08:24.529937 8140 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:08:24.530027 8140 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:08:24.530054 8140 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:08:24.530077 8140 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:08:24.530097 8140 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:08:24.531917 8140 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:33427
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.15.36.254:34673,127.15.36.253:43393,127.15.36.252:42213
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.252.keytab
--principal=kudu/127.15.36.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.252:42213
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.15.36.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8140
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:08:24.532225 8140 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:08:24.532497 8140 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:08:24.537981 8149 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:24.537981 8146 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:24.538184 8140 server_base.cc:1034] running on GCE node
W20260811 08:08:24.538100 8147 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:24.538599 8140 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:08:24.538882 8140 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:08:24.540033 8140 hybrid_clock.cc:648] HybridClock initialized: now 1786435704540001 us; error 55 us; skew 500 ppm
Aug 11 08:08:24 dist-test-slave-2w3w krb5kdc[7962](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435704, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:08:24.542768 8140 init.cc:377] Logged in from keytab as kudu/127.15.36.252@KRBTEST.COM (short username kudu)
I20260811 08:08:24.543293 8140 webserver.cc:460] Webserver started at http://127.15.36.252:35087/ using document root <none> and password file <none>
I20260811 08:08:24.543543 8140 fs_manager.cc:359] Metadata directory not provided
I20260811 08:08:24.543617 8140 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:08:24.543779 8140 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:08:24.544327 8132 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.36.252" port: 42213 } attempt: 2
I20260811 08:08:24.544776 8134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:24.544601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.252:42213 (local address 127.0.0.1:42990)
0811 08:08:24.544671 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:24.544709 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.252:42213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260811 08:08:24.545231 8134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:24.545091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.252:42213 (local address 127.0.0.1:42992)
0811 08:08:24.545172 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:24.545205 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.252:42213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260811 08:08:24.545214 8140 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/minicluster-data/master-2/data/instance:
uuid: "bcaa7e30f6854d1892f05c1f34186e95"
format_stamp: "Formatted at 2026-08-11 08:08:24 on dist-test-slave-2w3w"
server_key: "50a01528962725a44fcc64de4b6fd252"
server_key_iv: "6afb6ac28ae76511af6dac3055023539"
server_key_version: "encryptionkey@0"
W20260811 08:08:24.545372 8132 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.36.252:42213: Network error: Client connection negotiation failed: client connection to 127.15.36.252:42213: connect: Connection refused (error 111)
I20260811 08:08:24.545627 8140 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/minicluster-data/master-2/wal/instance:
uuid: "bcaa7e30f6854d1892f05c1f34186e95"
format_stamp: "Formatted at 2026-08-11 08:08:24 on dist-test-slave-2w3w"
server_key: "50a01528962725a44fcc64de4b6fd252"
server_key_iv: "6afb6ac28ae76511af6dac3055023539"
server_key_version: "encryptionkey@0"
I20260811 08:08:24.547168 8140 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.004s
I20260811 08:08:24.548182 8156 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:24.548434 8140 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 08:08:24.548550 8140 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/minicluster-data/master-2/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/minicluster-data/master-2/wal
uuid: "bcaa7e30f6854d1892f05c1f34186e95"
format_stamp: "Formatted at 2026-08-11 08:08:24 on dist-test-slave-2w3w"
server_key: "50a01528962725a44fcc64de4b6fd252"
server_key_iv: "6afb6ac28ae76511af6dac3055023539"
server_key_version: "encryptionkey@0"
I20260811 08:08:24.548632 8140 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:08:24.559705 8140 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:08:24.561944 8140 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:08:24.562119 8140 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:08:24.566393 8140 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.252:42213
I20260811 08:08:24.566438 8214 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.252:42213 every 8 connection(s)
I20260811 08:08:24.566829 8140 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/minicluster-data/master-2/data/info.pb
I20260811 08:08:24.567898 8215 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:08:24.569571 8215 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.36.254" port: 34673 } has no permanent_uuid. Determining permanent_uuid...
I20260811 08:08:24.569933 8048 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.36.252" port: 42213 } attempt: 2
I20260811 08:08:24.574985 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 8140
I20260811 08:08:24.575124 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786435400844580-15507-0/minicluster-data/master-2/wal/instance
I20260811 08:08:24.575392 15507 external_mini_cluster.cc:1428] Setting key 7a8a3f02bc0d0f8e65e64ef46145f878
Aug 11 08:08:24 dist-test-slave-2w3w krb5kdc[7962](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435704, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.254@KRBTEST.COM for kudu/127.15.36.252@KRBTEST.COM
Aug 11 08:08:24 dist-test-slave-2w3w krb5kdc[7962](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435704, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.252@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:08:24.581856 8050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:24.570277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.252:42213 (local address 127.0.0.1:43000)
0811 08:08:24.570345 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:24.570358 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:24.570423 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:24.571473 (+ 1050us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:24.571474 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:24.571673 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:08:24.571728 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:24.571731 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:24.573164 (+ 1433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:24.573165 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:24.573977 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:24.573980 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:24.575073 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:24.575075 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:24.575137 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:24.575849 (+ 712us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:08:24.575854 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:08:24.577453 (+ 1599us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:08:24.580161 (+ 2708us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:24.580162 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:24.580163 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:24.580369 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:24.580711 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:24.580712 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:24.580712 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:24.580775 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:24.581528 (+ 753us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:08:24.581529 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:08:24.581580 (+ 51us) client_negotiation.cc:769] Sending connection context
0811 08:08:24.581652 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 08:08:24.581749 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260811 08:08:24.582099 8217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:24.570320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:34673 (local address 127.0.0.1:40040)
0811 08:08:24.570529 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:24.570580 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:24.571191 (+ 611us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:24.571496 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:24.571499 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:24.571837 (+ 338us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:08:24.572001 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:24.572006 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:24.572946 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:24.572947 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:24.573997 (+ 1050us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:24.574000 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:24.574634 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:24.574635 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:24.574939 (+ 304us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:24.575697 (+ 758us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:08:24.575713 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:08:24.578218 (+ 2505us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:08:24.580014 (+ 1796us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:24.580020 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:24.580023 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:24.580363 (+ 340us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:24.580629 (+ 266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:24.580630 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:24.580630 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:24.580765 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:24.581179 (+ 414us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:08:24.581186 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:08:24.581414 (+ 228us) client_negotiation.cc:769] Sending connection context
0811 08:08:24.581532 (+ 118us) client_negotiation.cc:240] Negotiation successful
0811 08:08:24.581729 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":106,"threads_started":1}
I20260811 08:08:24.582260 8218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:24.570526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43000 (local address 127.15.36.252:42213)
0811 08:08:24.570709 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:24.570714 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:24.570744 (+ 30us) server_negotiation.cc:407] Connection header received
0811 08:08:24.571284 (+ 540us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:24.571293 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:24.571328 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:24.571444 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:24.571871 (+ 427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:24.573087 (+ 1216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:24.574203 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:24.574893 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:24.575297 (+ 404us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:24.577554 (+ 2257us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:24.577562 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:24.577563 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:24.577570 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:24.580074 (+ 2504us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:24.580490 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:24.580494 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:24.580494 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:24.580606 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:24.581211 (+ 605us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:24.581212 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:24.581213 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:24.581418 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:24.581500 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:24.582020 (+ 520us) server_negotiation.cc:299] Negotiation successful
0811 08:08:24.582105 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":165,"server-negotiator.queue_time_us":151,"thread_start_us":84,"threads_started":1}
Aug 11 08:08:24 dist-test-slave-2w3w krb5kdc[7962](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435704, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.36.252@KRBTEST.COM
I20260811 08:08:24.582676 8051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:24.570317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40040 (local address 127.15.36.254:34673)
0811 08:08:24.570361 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:24.570363 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:24.570693 (+ 330us) server_negotiation.cc:407] Connection header received
0811 08:08:24.571310 (+ 617us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:24.571346 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:24.571358 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:24.571428 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:24.572088 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:24.572841 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:24.574203 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:24.574495 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:24.574571 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:24.578308 (+ 3737us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:24.578310 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:24.578310 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:24.578317 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:24.579940 (+ 1623us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:24.580461 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:24.580463 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:24.580463 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:24.580535 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:24.580845 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:24.580846 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:24.580847 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:24.581082 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:24.581174 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:24.582451 (+ 1277us) server_negotiation.cc:299] Negotiation successful
0811 08:08:24.582544 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 08:08:24.583461 8215 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.36.253" port: 43393 } has no permanent_uuid. Determining permanent_uuid...
I20260811 08:08:24.585099 8048 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c33f5cad58845eabe5811361dd9b3c6: Bootstrap starting.
I20260811 08:08:24.586010 8048 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9c33f5cad58845eabe5811361dd9b3c6: Neither blocks nor log segments found. Creating new log.
I20260811 08:08:24.586403 8048 log.cc:824] T 00000000000000000000000000000000 P 9c33f5cad58845eabe5811361dd9b3c6: Log is configured to *not* fsync() on all Append() calls
I20260811 08:08:24.587502 8048 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c33f5cad58845eabe5811361dd9b3c6: No bootstrap required, opened a new log
Aug 11 08:08:24 dist-test-slave-2w3w krb5kdc[7962](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435704, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.252@KRBTEST.COM for kudu/127.15.36.253@KRBTEST.COM
I20260811 08:08:24.588299 8219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:24.575841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43008 (local address 127.15.36.252:42213)
0811 08:08:24.576707 (+ 866us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:24.576709 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:24.576715 (+ 6us) server_negotiation.cc:407] Connection header received
0811 08:08:24.576732 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:24.576733 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:24.576751 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:24.576809 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:24.577622 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:24.578412 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:24.579496 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:24.579836 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:24.579921 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:24.583139 (+ 3218us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:24.583140 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:24.583140 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:24.583148 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:24.586003 (+ 2855us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:24.586813 (+ 810us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:24.586814 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:24.586814 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:24.586890 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:24.587159 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:24.587160 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:24.587160 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:24.587305 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:24.587458 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:24.587958 (+ 500us) server_negotiation.cc:299] Negotiation successful
0811 08:08:24.588154 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":848,"thread_start_us":106,"threads_started":1}
I20260811 08:08:24.590296 8048 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9c33f5cad58845eabe5811361dd9b3c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c33f5cad58845eabe5811361dd9b3c6" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 34673 } } peers { permanent_uuid: "d68d03f6ba3c447c85384edc3a616e96" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 43393 } } peers { permanent_uuid: "bcaa7e30f6854d1892f05c1f34186e95" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 42213 } }
I20260811 08:08:24.590510 8048 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9c33f5cad58845eabe5811361dd9b3c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c33f5cad58845eabe5811361dd9b3c6, State: Initialized, Role: FOLLOWER
I20260811 08:08:24.590626 8048 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9c33f5cad58845eabe5811361dd9b3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c33f5cad58845eabe5811361dd9b3c6" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 34673 } } peers { permanent_uuid: "d68d03f6ba3c447c85384edc3a616e96" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 43393 } } peers { permanent_uuid: "bcaa7e30f6854d1892f05c1f34186e95" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 42213 } }
I20260811 08:08:24.590996 8223 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c33f5cad58845eabe5811361dd9b3c6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c33f5cad58845eabe5811361dd9b3c6" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 34673 } } peers { permanent_uuid: "d68d03f6ba3c447c85384edc3a616e96" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 43393 } } peers { permanent_uuid: "bcaa7e30f6854d1892f05c1f34186e95" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 42213 } } }
I20260811 08:08:24.591091 8048 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9c33f5cad58845eabe5811361dd9b3c6 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:08:24.591210 8223 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c33f5cad58845eabe5811361dd9b3c6 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 08:08:24.591354 8217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:24.583794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.253:43393 (local address 127.0.0.1:41764)
0811 08:08:24.583842 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:24.583861 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:24.583912 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:24.584085 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:24.584086 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:24.584238 (+ 152us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:08:24.584296 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:24.584298 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:24.585096 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:24.585097 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:24.585710 (+ 613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:24.585712 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:24.586222 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:24.586223 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:24.586299 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:24.586739 (+ 440us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:08:24.586745 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:08:24.588214 (+ 1469us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:08:24.590069 (+ 1855us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:24.590070 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:24.590071 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:24.590280 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:24.590567 (+ 287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:24.590568 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:24.590568 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:24.590654 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:24.591034 (+ 380us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:08:24.591035 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:08:24.591087 (+ 52us) client_negotiation.cc:769] Sending connection context
0811 08:08:24.591145 (+ 58us) client_negotiation.cc:240] Negotiation successful
0811 08:08:24.591254 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260811 08:08:24.591892 8136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:24.583847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41764 (local address 127.15.36.253:43393)
0811 08:08:24.583898 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:24.583900 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:24.583909 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:08:24.583989 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:24.583990 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:24.584002 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:24.584059 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:24.584391 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:24.584950 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:24.585818 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:24.586063 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:24.586154 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:24.588303 (+ 2149us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:24.588304 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:24.588305 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:24.588314 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:24.589970 (+ 1656us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:24.590378 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:24.590379 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:24.590379 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:24.590447 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:24.590718 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:24.590719 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:24.590720 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:24.590900 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:24.591576 (+ 676us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:24.591626 (+ 50us) server_negotiation.cc:299] Negotiation successful
0811 08:08:24.591726 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 08:08:24.592281 8215 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.36.252" port: 42213 } has no permanent_uuid. Determining permanent_uuid...
W20260811 08:08:24.593597 8234 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9c33f5cad58845eabe5811361dd9b3c6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 08:08:24.593705 8234 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
Aug 11 08:08:24 dist-test-slave-2w3w krb5kdc[7962](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435704, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
Aug 11 08:08:24 dist-test-slave-2w3w krb5kdc[7962](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435704, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.252@KRBTEST.COM for kudu/127.15.36.252@KRBTEST.COM
I20260811 08:08:24.599577 8051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:24.588915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40048 (local address 127.15.36.254:34673)
0811 08:08:24.588957 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:24.588959 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:24.589000 (+ 41us) server_negotiation.cc:407] Connection header received
0811 08:08:24.589071 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:24.589072 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:24.589083 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:24.589141 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:24.590145 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:24.590893 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:24.591945 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:24.592225 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:24.592308 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:24.595608 (+ 3300us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:24.595610 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:24.595610 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:24.595617 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:24.597950 (+ 2333us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:24.598376 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:24.598377 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:24.598377 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:24.598436 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:24.598638 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:24.598639 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:24.598640 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:24.598775 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:24.598907 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:24.599395 (+ 488us) server_negotiation.cc:299] Negotiation successful
0811 08:08:24.599479 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 08:08:24.594575 7975 master_runner.cc:186] Error getting master registration for 127.15.36.253:43393: OK, instance_id { permanent_uuid: "d68d03f6ba3c447c85384edc3a616e96" instance_seqno: 1786435704398616 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 08:08:24.599874 7975 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 08:08:24.601287 8217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:24.592570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.252:42213 (local address 127.0.0.1:43024)
0811 08:08:24.592616 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:24.592627 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:24.592660 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:24.592860 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:24.592861 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:24.593040 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:08:24.593082 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:24.593084 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:24.594045 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:24.594046 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:24.594866 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:24.594869 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:24.595432 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:24.595432 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:24.595481 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:24.595974 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:08:24.595980 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:08:24.597588 (+ 1608us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:08:24.600055 (+ 2467us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:24.600056 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:24.600057 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:24.600309 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:24.600567 (+ 258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:24.600568 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:24.600568 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:24.600629 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:24.600953 (+ 324us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:08:24.600954 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:08:24.601008 (+ 54us) client_negotiation.cc:769] Sending connection context
0811 08:08:24.601098 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 08:08:24.601212 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260811 08:08:24.602200 8219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:24.592643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43024 (local address 127.15.36.252:42213)
0811 08:08:24.592688 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:24.592690 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:24.592699 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:08:24.592723 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:24.592724 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:24.592739 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:24.592818 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:24.593166 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:24.593959 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:24.594988 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:24.595315 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:24.595383 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:24.597687 (+ 2304us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:24.597688 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:24.597689 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:24.597695 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:24.599570 (+ 1875us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:24.600392 (+ 822us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:24.600393 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:24.600394 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:24.600452 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:24.600707 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:24.600708 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:24.600709 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:24.600864 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:24.600942 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:24.602008 (+ 1066us) server_negotiation.cc:299] Negotiation successful
0811 08:08:24.602109 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 08:08:24.603994 8215 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bcaa7e30f6854d1892f05c1f34186e95: Bootstrap starting.
I20260811 08:08:24.604828 8215 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bcaa7e30f6854d1892f05c1f34186e95: Neither blocks nor log segments found. Creating new log.
Aug 11 08:08:24 dist-test-slave-2w3w krb5kdc[7962](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435704, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.36.253@KRBTEST.COM
I20260811 08:08:24.605159 8215 log.cc:824] T 00000000000000000000000000000000 P bcaa7e30f6854d1892f05c1f34186e95: Log is configured to *not* fsync() on all Append() calls
I20260811 08:08:24.606066 8215 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bcaa7e30f6854d1892f05c1f34186e95: No bootstrap required, opened a new log
I20260811 08:08:24.608500 8215 raft_consensus.cc:348] T 00000000000000000000000000000000 P bcaa7e30f6854d1892f05c1f34186e95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c33f5cad58845eabe5811361dd9b3c6" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 34673 } } peers { permanent_uuid: "d68d03f6ba3c447c85384edc3a616e96" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 43393 } } peers { permanent_uuid: "bcaa7e30f6854d1892f05c1f34186e95" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 42213 } }
I20260811 08:08:24.608670 8215 raft_consensus.cc:729] T 00000000000000000000000000000000 P bcaa7e30f6854d1892f05c1f34186e95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bcaa7e30f6854d1892f05c1f34186e95, State: Initialized, Role: FOLLOWER
I20260811 08:08:24.608767 8215 consensus_queue.cc:260] T 00000000000000000000000000000000 P bcaa7e30f6854d1892f05c1f34186e95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c33f5cad58845eabe5811361dd9b3c6" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 34673 } } peers { permanent_uuid: "d68d03f6ba3c447c85384edc3a616e96" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 43393 } } peers { permanent_uuid: "bcaa7e30f6854d1892f05c1f34186e95" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 42213 } }
I20260811 08:08:24.609127 8215 sys_catalog.cc:564] T 00000000000000000000000000000000 P bcaa7e30f6854d1892f05c1f34186e95 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:08:24.609149 8136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:24.600280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41780 (local address 127.15.36.253:43393)
0811 08:08:24.600324 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:24.600326 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:24.600339 (+ 13us) server_negotiation.cc:407] Connection header received
0811 08:08:24.600387 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:24.600388 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:24.600399 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:24.600488 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:24.601125 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:24.601868 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:24.602746 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:24.603056 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:24.603150 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:24.605688 (+ 2538us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:24.605689 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:24.605689 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:24.605698 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:24.607637 (+ 1939us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:24.608071 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:24.608073 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:24.608073 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:24.608141 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:24.608380 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:24.608380 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:24.608381 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:24.608538 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:24.608707 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:24.608905 (+ 198us) server_negotiation.cc:299] Negotiation successful
0811 08:08:24.609049 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 08:08:24.609674 8238 sys_catalog.cc:455] T 00000000000000000000000000000000 P bcaa7e30f6854d1892f05c1f34186e95 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c33f5cad58845eabe5811361dd9b3c6" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 34673 } } peers { permanent_uuid: "d68d03f6ba3c447c85384edc3a616e96" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 43393 } } peers { permanent_uuid: "bcaa7e30f6854d1892f05c1f34186e95" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 42213 } } }
I20260811 08:08:24.609781 8238 sys_catalog.cc:458] T 00000000000000000000000000000000 P bcaa7e30f6854d1892f05c1f34186e95 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 08:08:24.610790 15507 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260811 08:08:24.611642 8251 catalog_manager.cc:1558] T 00000000000000000000000000000000 P bcaa7e30f6854d1892f05c1f34186e95: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 08:08:24.611752 8251 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 08:08:24.611913 8019 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "9c33f5cad58845eabe5811361dd9b3c6"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40048
I20260811 08:08:24.612058 8019 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9c33f5cad58845eabe5811361dd9b3c6 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 08:08:24.612106 8019 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9c33f5cad58845eabe5811361dd9b3c6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:08:24.613152 8019 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9c33f5cad58845eabe5811361dd9b3c6 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c33f5cad58845eabe5811361dd9b3c6" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 34673 } } peers { permanent_uuid: "d68d03f6ba3c447c85384edc3a616e96" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 43393 } } peers { permanent_uuid: "bcaa7e30f6854d1892f05c1f34186e95" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 42213 } }
I20260811 08:08:24.613394 8019 leader_election.cc:288] T 00000000000000000000000000000000 P 9c33f5cad58845eabe5811361dd9b3c6 [CANDIDATE]: Term 1 election: Requested vote from peers d68d03f6ba3c447c85384edc3a616e96 (127.15.36.253:43393), bcaa7e30f6854d1892f05c1f34186e95 (127.15.36.252:42213)
I20260811 08:08:24.613875 8186 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9c33f5cad58845eabe5811361dd9b3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "bcaa7e30f6854d1892f05c1f34186e95"
I20260811 08:08:24.613989 8186 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bcaa7e30f6854d1892f05c1f34186e95 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:08:24.612481 8140 master_runner.cc:186] Error getting master registration for 127.15.36.253:43393: OK, instance_id { permanent_uuid: "d68d03f6ba3c447c85384edc3a616e96" instance_seqno: 1786435704398616 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 08:08:24.614925 8140 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 08:08:24.614939 8186 raft_consensus.cc:2454] T 00000000000000000000000000000000 P bcaa7e30f6854d1892f05c1f34186e95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c33f5cad58845eabe5811361dd9b3c6 in term 1.
I20260811 08:08:24.615298 7995 leader_election.cc:302] T 00000000000000000000000000000000 P 9c33f5cad58845eabe5811361dd9b3c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9c33f5cad58845eabe5811361dd9b3c6, bcaa7e30f6854d1892f05c1f34186e95; no voters:
I20260811 08:08:24.615454 8223 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9c33f5cad58845eabe5811361dd9b3c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:08:24.615609 8223 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9c33f5cad58845eabe5811361dd9b3c6 [term 1 LEADER]: Becoming Leader. State: Replica: 9c33f5cad58845eabe5811361dd9b3c6, State: Running, Role: LEADER
I20260811 08:08:24.615703 8223 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9c33f5cad58845eabe5811361dd9b3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c33f5cad58845eabe5811361dd9b3c6" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 34673 } } peers { permanent_uuid: "d68d03f6ba3c447c85384edc3a616e96" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 43393 } } peers { permanent_uuid: "bcaa7e30f6854d1892f05c1f34186e95" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 42213 } }
I20260811 08:08:24.616173 8257 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c33f5cad58845eabe5811361dd9b3c6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9c33f5cad58845eabe5811361dd9b3c6. Latest consensus state: current_term: 1 leader_uuid: "9c33f5cad58845eabe5811361dd9b3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c33f5cad58845eabe5811361dd9b3c6" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 34673 } } peers { permanent_uuid: "d68d03f6ba3c447c85384edc3a616e96" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 43393 } } peers { permanent_uuid: "bcaa7e30f6854d1892f05c1f34186e95" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 42213 } } }
I20260811 08:08:24.616403 8257 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c33f5cad58845eabe5811361dd9b3c6 [sys.catalog]: This master's current role is: LEADER
I20260811 08:08:24.617726 8260 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:08:24.617923 8260 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:08:24.625978 8136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:24.616382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41782 (local address 127.15.36.253:43393)
0811 08:08:24.616436 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:24.616439 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:24.616689 (+ 250us) server_negotiation.cc:407] Connection header received
0811 08:08:24.616788 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:24.616789 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:24.616800 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:24.616831 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:24.617662 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:24.618419 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:24.619557 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:24.620368 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:24.620447 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:24.622719 (+ 2272us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:24.622720 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:24.622721 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:24.622729 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:24.624678 (+ 1949us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:24.625070 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:24.625071 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:24.625072 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:24.625159 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:24.625384 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:24.625385 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:24.625385 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:24.625533 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:24.625644 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:24.625769 (+ 125us) server_negotiation.cc:299] Negotiation successful
0811 08:08:24.625870 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 08:08:24.634766 8219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:24.622508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43040 (local address 127.15.36.252:42213)
0811 08:08:24.622553 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:24.622555 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:24.626042 (+ 3487us) server_negotiation.cc:407] Connection header received
0811 08:08:24.626071 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:24.626072 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:24.626083 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:24.626131 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:24.627025 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:24.627816 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:24.629305 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:24.629624 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:24.629696 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:24.631279 (+ 1583us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:24.631281 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:24.631281 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:24.631289 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:24.633090 (+ 1801us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:24.633576 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:24.633577 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:24.633577 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:24.633654 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:24.633900 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:24.633900 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:24.633901 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:24.634051 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:24.634156 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:24.634558 (+ 402us) server_negotiation.cc:299] Negotiation successful
0811 08:08:24.634642 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 08:08:24.636322 8186 raft_consensus.cc:1261] T 00000000000000000000000000000000 P bcaa7e30f6854d1892f05c1f34186e95 [term 1 FOLLOWER]: Refusing update from remote peer 9c33f5cad58845eabe5811361dd9b3c6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:08:24.636499 8132 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.36.252" port: 42213 } attempt: 3
I20260811 08:08:24.636816 8257 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 9c33f5cad58845eabe5811361dd9b3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcaa7e30f6854d1892f05c1f34186e95" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 42213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:08:24.638469 8238 sys_catalog.cc:455] T 00000000000000000000000000000000 P bcaa7e30f6854d1892f05c1f34186e95 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9c33f5cad58845eabe5811361dd9b3c6. Latest consensus state: current_term: 1 leader_uuid: "9c33f5cad58845eabe5811361dd9b3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c33f5cad58845eabe5811361dd9b3c6" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 34673 } } peers { permanent_uuid: "d68d03f6ba3c447c85384edc3a616e96" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 43393 } } peers { permanent_uuid: "bcaa7e30f6854d1892f05c1f34186e95" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 42213 } } }
I20260811 08:08:24.638589 8238 sys_catalog.cc:458] T 00000000000000000000000000000000 P bcaa7e30f6854d1892f05c1f34186e95 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 08:08:24.639161 8051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:24.622083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40052 (local address 127.15.36.254:34673)
0811 08:08:24.622159 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:24.622161 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:24.623309 (+ 1148us) server_negotiation.cc:407] Connection header received
0811 08:08:24.625166 (+ 1857us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:24.625167 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:24.625179 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:24.625210 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:24.628451 (+ 3241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:24.629222 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:24.632003 (+ 2781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:24.632314 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:24.632358 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:24.634013 (+ 1655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:24.634015 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:24.634015 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:24.634023 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:24.635811 (+ 1788us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:24.637410 (+ 1599us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:24.637411 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:24.637411 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:24.637491 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:24.638164 (+ 673us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:24.638165 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:24.638166 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:24.638314 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:24.638403 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:24.638927 (+ 524us) server_negotiation.cc:299] Negotiation successful
0811 08:08:24.639040 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 08:08:24.640650 8223 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c33f5cad58845eabe5811361dd9b3c6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9c33f5cad58845eabe5811361dd9b3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c33f5cad58845eabe5811361dd9b3c6" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 34673 } } peers { permanent_uuid: "d68d03f6ba3c447c85384edc3a616e96" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 43393 } } peers { permanent_uuid: "bcaa7e30f6854d1892f05c1f34186e95" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 42213 } } }
I20260811 08:08:24.640774 8223 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c33f5cad58845eabe5811361dd9b3c6 [sys.catalog]: This master's current role is: LEADER
I20260811 08:08:24.641045 8238 sys_catalog.cc:455] T 00000000000000000000000000000000 P bcaa7e30f6854d1892f05c1f34186e95 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9c33f5cad58845eabe5811361dd9b3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c33f5cad58845eabe5811361dd9b3c6" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 34673 } } peers { permanent_uuid: "d68d03f6ba3c447c85384edc3a616e96" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 43393 } } peers { permanent_uuid: "bcaa7e30f6854d1892f05c1f34186e95" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 42213 } } }
I20260811 08:08:24.641122 8238 sys_catalog.cc:458] T 00000000000000000000000000000000 P bcaa7e30f6854d1892f05c1f34186e95 [sys.catalog]: This master's current role is: FOLLOWER
Aug 11 08:08:24 dist-test-slave-2w3w krb5kdc[7962](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435704, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.253@KRBTEST.COM for kudu/127.15.36.252@KRBTEST.COM
I20260811 08:08:24.641312 8262 mvcc.cc:205] Tried to move back new op lower bound from 7317240646187302912 to 7317240646106558464. Current Snapshot: MvccSnapshot[applied={T|T < 7317240646187302912}]
I20260811 08:08:24.641577 8265 mvcc.cc:205] Tried to move back new op lower bound from 7317240646187302912 to 7317240646106558464. Current Snapshot: MvccSnapshot[applied={T|T < 7317240646187302912}]
I20260811 08:08:24.642203 8260 catalog_manager.cc:1347] Generated new cluster ID: 7c8929aff8f34a76b3fd25b3aa59bedf
I20260811 08:08:24.642257 8260 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:08:24.644970 8134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:24.636749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.252:42213 (local address 127.0.0.1:43042)
0811 08:08:24.636838 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:24.636850 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:24.636897 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:24.637140 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:24.637142 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:24.637328 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:08:24.637380 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:24.637382 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:24.638220 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:24.638222 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:24.639064 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:24.639067 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:24.639570 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:24.639572 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:24.639633 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:24.640074 (+ 441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:08:24.640079 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:08:24.641573 (+ 1494us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:08:24.643529 (+ 1956us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:24.643530 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:24.643531 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:24.643757 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:24.644055 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:24.644056 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:24.644056 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:24.644140 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:24.644615 (+ 475us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:08:24.644616 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:08:24.644688 (+ 72us) client_negotiation.cc:769] Sending connection context
0811 08:08:24.644748 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 08:08:24.644865 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":69}
I20260811 08:08:24.645838 8219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:24.636970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43042 (local address 127.15.36.252:42213)
0811 08:08:24.637009 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:24.637011 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:24.637018 (+ 7us) server_negotiation.cc:407] Connection header received
0811 08:08:24.637039 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:24.637040 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:24.637050 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:24.637095 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:24.637467 (+ 372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:24.638116 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:24.639157 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:24.639457 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:24.639518 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:24.641668 (+ 2150us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:24.641670 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:24.641670 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:24.641677 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:24.643428 (+ 1751us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:24.643849 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:24.643850 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:24.643850 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:24.643940 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:24.644225 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:24.644226 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:24.644226 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:24.644481 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:24.645379 (+ 898us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:24.645456 (+ 77us) server_negotiation.cc:299] Negotiation successful
0811 08:08:24.645637 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 08:08:24.647745 8132 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d68d03f6ba3c447c85384edc3a616e96: Bootstrap starting.
I20260811 08:08:24.648535 8132 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d68d03f6ba3c447c85384edc3a616e96: Neither blocks nor log segments found. Creating new log.
I20260811 08:08:24.648867 8132 log.cc:824] T 00000000000000000000000000000000 P d68d03f6ba3c447c85384edc3a616e96: Log is configured to *not* fsync() on all Append() calls
I20260811 08:08:24.657982 8132 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d68d03f6ba3c447c85384edc3a616e96: No bootstrap required, opened a new log
I20260811 08:08:24.659787 8260 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:08:24.660290 8132 raft_consensus.cc:348] T 00000000000000000000000000000000 P d68d03f6ba3c447c85384edc3a616e96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c33f5cad58845eabe5811361dd9b3c6" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 34673 } } peers { permanent_uuid: "d68d03f6ba3c447c85384edc3a616e96" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 43393 } } peers { permanent_uuid: "bcaa7e30f6854d1892f05c1f34186e95" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 42213 } }
I20260811 08:08:24.660456 8132 raft_consensus.cc:729] T 00000000000000000000000000000000 P d68d03f6ba3c447c85384edc3a616e96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d68d03f6ba3c447c85384edc3a616e96, State: Initialized, Role: FOLLOWER
I20260811 08:08:24.660544 8132 consensus_queue.cc:260] T 00000000000000000000000000000000 P d68d03f6ba3c447c85384edc3a616e96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c33f5cad58845eabe5811361dd9b3c6" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 34673 } } peers { permanent_uuid: "d68d03f6ba3c447c85384edc3a616e96" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 43393 } } peers { permanent_uuid: "bcaa7e30f6854d1892f05c1f34186e95" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 42213 } }
I20260811 08:08:24.660910 8132 sys_catalog.cc:564] T 00000000000000000000000000000000 P d68d03f6ba3c447c85384edc3a616e96 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:08:24.660946 8103 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9c33f5cad58845eabe5811361dd9b3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d68d03f6ba3c447c85384edc3a616e96"
I20260811 08:08:24.661067 8103 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d68d03f6ba3c447c85384edc3a616e96 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:08:24.662145 8103 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d68d03f6ba3c447c85384edc3a616e96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c33f5cad58845eabe5811361dd9b3c6 in term 1.
I20260811 08:08:24.662696 8102 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d68d03f6ba3c447c85384edc3a616e96 [term 1 FOLLOWER]: Refusing update from remote peer 9c33f5cad58845eabe5811361dd9b3c6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:08:24.663018 8223 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 9c33f5cad58845eabe5811361dd9b3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d68d03f6ba3c447c85384edc3a616e96" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 43393 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:08:24.663995 8260 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:08:24.666515 8282 sys_catalog.cc:455] T 00000000000000000000000000000000 P d68d03f6ba3c447c85384edc3a616e96 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9c33f5cad58845eabe5811361dd9b3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c33f5cad58845eabe5811361dd9b3c6" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 34673 } } peers { permanent_uuid: "d68d03f6ba3c447c85384edc3a616e96" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 43393 } } peers { permanent_uuid: "bcaa7e30f6854d1892f05c1f34186e95" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 42213 } } }
I20260811 08:08:24.666651 8282 sys_catalog.cc:458] T 00000000000000000000000000000000 P d68d03f6ba3c447c85384edc3a616e96 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 08:08:24.666725 8282 sys_catalog.cc:455] T 00000000000000000000000000000000 P d68d03f6ba3c447c85384edc3a616e96 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9c33f5cad58845eabe5811361dd9b3c6. Latest consensus state: current_term: 1 leader_uuid: "9c33f5cad58845eabe5811361dd9b3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c33f5cad58845eabe5811361dd9b3c6" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 34673 } } peers { permanent_uuid: "d68d03f6ba3c447c85384edc3a616e96" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 43393 } } peers { permanent_uuid: "bcaa7e30f6854d1892f05c1f34186e95" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 42213 } } }
I20260811 08:08:24.666807 8282 sys_catalog.cc:458] T 00000000000000000000000000000000 P d68d03f6ba3c447c85384edc3a616e96 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 08:08:24.666852 8282 sys_catalog.cc:455] T 00000000000000000000000000000000 P d68d03f6ba3c447c85384edc3a616e96 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9c33f5cad58845eabe5811361dd9b3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c33f5cad58845eabe5811361dd9b3c6" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 34673 } } peers { permanent_uuid: "d68d03f6ba3c447c85384edc3a616e96" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 43393 } } peers { permanent_uuid: "bcaa7e30f6854d1892f05c1f34186e95" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 42213 } } }
I20260811 08:08:24.666898 8282 sys_catalog.cc:458] T 00000000000000000000000000000000 P d68d03f6ba3c447c85384edc3a616e96 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 08:08:24.667702 8283 mvcc.cc:205] Tried to move back new op lower bound from 7317240646279757824 to 7317240646106558464. Current Snapshot: MvccSnapshot[applied={T|T < 7317240646187302912}]
W20260811 08:08:24.668368 8281 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d68d03f6ba3c447c85384edc3a616e96: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 08:08:24.668450 8281 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 08:08:24.670194 8223 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c33f5cad58845eabe5811361dd9b3c6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9c33f5cad58845eabe5811361dd9b3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c33f5cad58845eabe5811361dd9b3c6" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 34673 } } peers { permanent_uuid: "d68d03f6ba3c447c85384edc3a616e96" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 43393 } } peers { permanent_uuid: "bcaa7e30f6854d1892f05c1f34186e95" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 42213 } } }
I20260811 08:08:24.670308 8223 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c33f5cad58845eabe5811361dd9b3c6 [sys.catalog]: This master's current role is: LEADER
I20260811 08:08:24.681679 8260 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9c33f5cad58845eabe5811361dd9b3c6: Generated new TSK 0
I20260811 08:08:24.682106 8260 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 08:08:24.705826 8219 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:08:24.704334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43052 (local address 127.15.36.252:42213)
0811 08:08:24.704391 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:24.704394 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:24.705056 (+ 662us) server_negotiation.cc:407] Connection header received
0811 08:08:24.705169 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:24.705171 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:24.705184 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:24.705216 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:24.705755 (+ 539us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43052: BlockingRecv error: recv got EOF from 127.0.0.1:43052 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260811 08:08:24.706790 8051 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:08:24.704740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40066 (local address 127.15.36.254:34673)
0811 08:08:24.704782 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:24.704785 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:24.706227 (+ 1442us) server_negotiation.cc:407] Connection header received
0811 08:08:24.706330 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:24.706331 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:24.706344 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:24.706374 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:24.706725 (+ 351us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40066: BlockingRecv error: recv got EOF from 127.0.0.1:40066 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260811 08:08:24.708000 8136 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:08:24.707291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41796 (local address 127.15.36.253:43393)
0811 08:08:24.707335 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:24.707337 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:24.707480 (+ 143us) server_negotiation.cc:407] Connection header received
0811 08:08:24.707572 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:24.707573 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:24.707583 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:24.707610 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:24.707940 (+ 330us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41796: BlockingRecv error: recv got EOF from 127.0.0.1:41796 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260811 08:08:24.710803 8136 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:08:24.709843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41798 (local address 127.15.36.253:43393)
0811 08:08:24.709887 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:24.709889 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:24.710124 (+ 235us) server_negotiation.cc:407] Connection header received
0811 08:08:24.710324 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:24.710325 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:24.710348 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:24.710380 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:24.710752 (+ 372us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41798: BlockingRecv error: recv got EOF from 127.0.0.1:41798 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260811 08:08:24.714184 8136 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:08:24.713336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41814 (local address 127.15.36.253:43393)
0811 08:08:24.713376 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:24.713378 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:24.713623 (+ 245us) server_negotiation.cc:407] Connection header received
0811 08:08:24.713730 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:24.713731 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:24.713743 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:24.713773 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:24.714131 (+ 358us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41814: BlockingRecv error: recv got EOF from 127.0.0.1:41814 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260811 08:08:24.718564 8136 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:08:24.717581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41828 (local address 127.15.36.253:43393)
0811 08:08:24.717623 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:24.717625 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:24.717872 (+ 247us) server_negotiation.cc:407] Connection header received
0811 08:08:24.718003 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:24.718004 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:24.718016 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:24.718049 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:24.718505 (+ 456us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41828: BlockingRecv error: recv got EOF from 127.0.0.1:41828 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260811 08:08:24.725121 8136 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:08:24.724125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41842 (local address 127.15.36.253:43393)
0811 08:08:24.724172 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:24.724174 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:24.724488 (+ 314us) server_negotiation.cc:407] Connection header received
0811 08:08:24.724609 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:24.724610 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:24.724623 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:24.724654 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:24.725057 (+ 403us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41842: BlockingRecv error: recv got EOF from 127.0.0.1:41842 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260811 08:08:24.735826 8136 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:08:24.734713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41848 (local address 127.15.36.253:43393)
0811 08:08:24.734779 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:24.734781 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:24.735155 (+ 374us) server_negotiation.cc:407] Connection header received
0811 08:08:24.735283 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:24.735285 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:24.735300 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:24.735334 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:24.735761 (+ 427us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41848: BlockingRecv error: recv got EOF from 127.0.0.1:41848 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
W20260811 08:08:24.754478 8136 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:08:24.753456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41856 (local address 127.15.36.253:43393)
0811 08:08:24.753508 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:24.753510 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:24.753803 (+ 293us) server_negotiation.cc:407] Connection header received
0811 08:08:24.753914 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:24.753915 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:24.753928 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:24.753963 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:24.754398 (+ 435us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41856: BlockingRecv error: recv got EOF from 127.0.0.1:41856 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260811 08:08:24.788947 8136 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:08:24.788038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41868 (local address 127.15.36.253:43393)
0811 08:08:24.788084 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:24.788086 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:24.788322 (+ 236us) server_negotiation.cc:407] Connection header received
0811 08:08:24.788438 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:24.788439 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:24.788451 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:24.788480 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:24.788885 (+ 405us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41868: BlockingRecv error: recv got EOF from 127.0.0.1:41868 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260811 08:08:24.855613 8136 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:08:24.854617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41874 (local address 127.15.36.253:43393)
0811 08:08:24.854726 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:24.854728 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:24.854894 (+ 166us) server_negotiation.cc:407] Connection header received
0811 08:08:24.855036 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:24.855037 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:24.855050 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:24.855131 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:24.855527 (+ 396us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41874: BlockingRecv error: recv got EOF from 127.0.0.1:41874 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
W20260811 08:08:24.985930 8136 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:08:24.985027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41878 (local address 127.15.36.253:43393)
0811 08:08:24.985152 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:24.985155 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:24.985288 (+ 133us) server_negotiation.cc:407] Connection header received
0811 08:08:24.985375 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:24.985376 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:24.985389 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:24.985467 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:24.985861 (+ 394us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41878: BlockingRecv error: recv got EOF from 127.0.0.1:41878 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
W20260811 08:08:25.244220 8136 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:08:25.243443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41890 (local address 127.15.36.253:43393)
0811 08:08:25.243538 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:25.243540 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:25.243551 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:08:25.243606 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:25.243607 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:25.243626 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:25.243695 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:25.244147 (+ 452us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41890: BlockingRecv error: recv got EOF from 127.0.0.1:41890 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 08:08:25.612298 8251 catalog_manager.cc:1259] Loaded cluster ID: 7c8929aff8f34a76b3fd25b3aa59bedf
I20260811 08:08:25.612382 8251 catalog_manager.cc:1552] T 00000000000000000000000000000000 P bcaa7e30f6854d1892f05c1f34186e95: loading cluster ID for follower catalog manager: success
I20260811 08:08:25.613233 8251 catalog_manager.cc:1574] T 00000000000000000000000000000000 P bcaa7e30f6854d1892f05c1f34186e95: acquiring CA information for follower catalog manager: success
I20260811 08:08:25.613550 8251 catalog_manager.cc:1602] T 00000000000000000000000000000000 P bcaa7e30f6854d1892f05c1f34186e95: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 08:08:25.669034 8281 catalog_manager.cc:1259] Loaded cluster ID: 7c8929aff8f34a76b3fd25b3aa59bedf
I20260811 08:08:25.669119 8281 catalog_manager.cc:1552] T 00000000000000000000000000000000 P d68d03f6ba3c447c85384edc3a616e96: loading cluster ID for follower catalog manager: success
I20260811 08:08:25.670127 8281 catalog_manager.cc:1574] T 00000000000000000000000000000000 P d68d03f6ba3c447c85384edc3a616e96: acquiring CA information for follower catalog manager: success
I20260811 08:08:25.670408 8281 catalog_manager.cc:1602] T 00000000000000000000000000000000 P d68d03f6ba3c447c85384edc3a616e96: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 08:08:25.760766 8357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:25.757630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41900 (local address 127.15.36.253:43393)
0811 08:08:25.757744 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:25.757747 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:25.757925 (+ 178us) server_negotiation.cc:407] Connection header received
0811 08:08:25.757960 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:25.757961 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:25.758054 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:25.758164 (+ 110us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:08:25.758368 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:25.759044 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:25.759867 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:25.760092 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:25.760158 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:25.760359 (+ 201us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:08:25.760485 (+ 126us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:08:25.760552 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:25.760658 (+ 106us) server_negotiation.cc:299] Negotiation successful
0811 08:08:25.760684 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90,"thread_start_us":59,"threads_started":1}
I20260811 08:08:25.765564 8365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:25.762908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43058 (local address 127.15.36.252:42213)
0811 08:08:25.763083 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:25.763085 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:25.763094 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:08:25.763134 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:25.763135 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:25.763173 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:25.763248 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:08:25.763388 (+ 140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:25.763869 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:25.764617 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:25.764822 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:25.764901 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:25.765107 (+ 206us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:08:25.765225 (+ 118us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:08:25.765312 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:25.765393 (+ 81us) server_negotiation.cc:299] Negotiation successful
0811 08:08:25.765415 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":81,"threads_started":1}
I20260811 08:08:25.771158 8365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:25.767793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43070 (local address 127.15.36.252:42213)
0811 08:08:25.768006 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:25.768008 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:25.768047 (+ 39us) server_negotiation.cc:407] Connection header received
0811 08:08:25.768118 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:25.768119 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:25.768129 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:25.768209 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:08:25.768381 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:25.769258 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:25.770399 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:25.770609 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:25.770698 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:25.770853 (+ 155us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:08:25.770890 (+ 37us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:08:25.770938 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:25.771035 (+ 97us) server_negotiation.cc:299] Negotiation successful
0811 08:08:25.771060 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":189}
I20260811 08:08:25.771370 8357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:25.767726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41906 (local address 127.15.36.253:43393)
0811 08:08:25.767791 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:25.767794 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:25.768199 (+ 405us) server_negotiation.cc:407] Connection header received
0811 08:08:25.768298 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:25.768300 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:25.768311 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:25.768367 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:08:25.768536 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:25.769140 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:25.770416 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:25.770733 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:25.770826 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:25.770937 (+ 111us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:08:25.770996 (+ 59us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:08:25.771046 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:25.771231 (+ 185us) server_negotiation.cc:299] Negotiation successful
0811 08:08:25.771265 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 08:08:25.771589 8371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:25.767682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40074 (local address 127.15.36.254:34673)
0811 08:08:25.767859 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:25.767861 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:25.767925 (+ 64us) server_negotiation.cc:407] Connection header received
0811 08:08:25.768072 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:25.768073 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:25.768131 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:25.768287 (+ 156us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:08:25.768465 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:25.769361 (+ 896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:25.770328 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:25.770653 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:25.770718 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:25.771064 (+ 346us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:08:25.771201 (+ 137us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:08:25.771258 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:25.771465 (+ 207us) server_negotiation.cc:299] Negotiation successful
0811 08:08:25.771502 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":67,"threads_started":1}
I20260811 08:08:25.773393 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 7975
I20260811 08:08:25.785382 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 8056
I20260811 08:08:25.792418 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 8140
2026-08-11T08:08:25Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (2962 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:08:25 dist-test-slave-2w3w krb5kdc[8376](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:08:25 dist-test-slave-2w3w krb5kdc[8376](info): set up 2 sockets
Aug 11 08:08:25 dist-test-slave-2w3w krb5kdc[8376](info): commencing operation
krb5kdc: starting...
W20260811 08:08:26.918188 15507 mini_kdc.cc:121] Time spent starting KDC: real 1.102s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/krb5kdc/test-user.keytab.
Aug 11 08:08:27 dist-test-slave-2w3w krb5kdc[8376](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435707, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:08:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:08:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.36.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab.
Entry for principal kudu/127.15.36.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab.
I20260811 08:08:27.054631 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:37283
--webserver_interface=127.15.36.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=kudu/127.15.36.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:44957
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.36.254:37283,127.15.36.253:36671,127.15.36.252:36743
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:08:27.138388 8389 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 08:08:27.138625 8389 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:08:27.138643 8389 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:08:27.138664 8389 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:08:27.139994 8389 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:08:27.140049 8389 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:08:27.140064 8389 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:08:27.140076 8389 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:08:27.140089 8389 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:08:27.141551 8389 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:44957
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.36.254:37283,127.15.36.253:36671,127.15.36.252:36743
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.254.keytab
--principal=kudu/127.15.36.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.254:37283
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.36.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8389
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:08:27.141747 8389 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:08:27.141925 8389 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:08:27.146669 8397 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:27.146696 8399 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:27.146669 8396 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:27.147171 8389 server_base.cc:1034] running on GCE node
I20260811 08:08:27.147454 8389 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:08:27.147754 8389 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:08:27.148998 8389 hybrid_clock.cc:648] HybridClock initialized: now 1786435707148952 us; error 55 us; skew 500 ppm
Aug 11 08:08:27 dist-test-slave-2w3w krb5kdc[8376](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435707, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:08:27.155727 8389 init.cc:377] Logged in from keytab as kudu/127.15.36.254@KRBTEST.COM (short username kudu)
I20260811 08:08:27.156258 8389 webserver.cc:460] Webserver started at http://127.15.36.254:39341/ using document root <none> and password file <none>
I20260811 08:08:27.156514 8389 fs_manager.cc:359] Metadata directory not provided
I20260811 08:08:27.156590 8389 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:08:27.156759 8389 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:08:27.157955 8389 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/minicluster-data/master-0/data/instance:
uuid: "3b392945996f44179d86e890198ff0d8"
format_stamp: "Formatted at 2026-08-11 08:08:27 on dist-test-slave-2w3w"
server_key: "b47a8f780faed2cdb201b76082d9ce0d"
server_key_iv: "cf9f11794510876b4ba8283649cb2931"
server_key_version: "encryptionkey@0"
I20260811 08:08:27.158352 8389 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/minicluster-data/master-0/wal/instance:
uuid: "3b392945996f44179d86e890198ff0d8"
format_stamp: "Formatted at 2026-08-11 08:08:27 on dist-test-slave-2w3w"
server_key: "b47a8f780faed2cdb201b76082d9ce0d"
server_key_iv: "cf9f11794510876b4ba8283649cb2931"
server_key_version: "encryptionkey@0"
I20260811 08:08:27.160058 8389 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 08:08:27.160930 8406 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:27.161113 8389 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:08:27.161234 8389 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/minicluster-data/master-0/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/minicluster-data/master-0/wal
uuid: "3b392945996f44179d86e890198ff0d8"
format_stamp: "Formatted at 2026-08-11 08:08:27 on dist-test-slave-2w3w"
server_key: "b47a8f780faed2cdb201b76082d9ce0d"
server_key_iv: "cf9f11794510876b4ba8283649cb2931"
server_key_version: "encryptionkey@0"
I20260811 08:08:27.161319 8389 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:08:27.173192 8389 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:08:27.175608 8389 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:08:27.175796 8389 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:08:27.180477 8389 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.254:37283
I20260811 08:08:27.180505 8462 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.254:37283 every 8 connection(s)
I20260811 08:08:27.180938 8389 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/minicluster-data/master-0/data/info.pb
I20260811 08:08:27.182026 8463 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:08:27.183729 8463 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.36.254" port: 37283 } has no permanent_uuid. Determining permanent_uuid...
I20260811 08:08:27.190671 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 8389
I20260811 08:08:27.190776 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/minicluster-data/master-0/wal/instance
I20260811 08:08:27.191042 15507 external_mini_cluster.cc:1428] Setting key 9e50a5522584f8e7982b9d4aa8f3e427
Aug 11 08:08:27 dist-test-slave-2w3w krb5kdc[8376](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435707, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.254@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:08:27.195525 8467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:27.184561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50178 (local address 127.15.36.254:37283)
0811 08:08:27.184858 (+ 297us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:27.184869 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:27.185049 (+ 180us) server_negotiation.cc:407] Connection header received
0811 08:08:27.185665 (+ 616us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:27.185668 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:27.185689 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:27.185806 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:27.186409 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:27.187408 (+ 999us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:27.188440 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:27.188900 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:27.189029 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:27.191806 (+ 2777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:27.191815 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:27.191815 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:27.191824 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:27.193735 (+ 1911us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:27.194264 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:27.194267 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:27.194267 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:27.194351 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:27.194634 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:27.194634 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:27.194635 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:27.194911 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:27.195035 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:27.195245 (+ 210us) server_negotiation.cc:299] Negotiation successful
0811 08:08:27.195352 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":246,"thread_start_us":86,"threads_started":1}
I20260811 08:08:27.195967 8466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:27.184477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:37283 (local address 127.0.0.1:50178)
0811 08:08:27.184847 (+ 370us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:27.184902 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:27.185490 (+ 588us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:27.185813 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:27.185816 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:27.186132 (+ 316us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:08:27.186295 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:27.186300 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:27.187542 (+ 1242us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:27.187543 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:27.188310 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:27.188313 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:27.189061 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:27.189063 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:27.189172 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:27.189891 (+ 719us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:08:27.189903 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:08:27.191709 (+ 1806us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:08:27.193836 (+ 2127us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:27.193846 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:27.193849 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:27.194173 (+ 324us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:27.194425 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:27.194426 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:27.194427 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:27.194545 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:27.195013 (+ 468us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:08:27.195021 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:08:27.195103 (+ 82us) client_negotiation.cc:769] Sending connection context
0811 08:08:27.195208 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 08:08:27.195459 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":331,"mutex_wait_us":45,"thread_start_us":143,"threads_started":1}
I20260811 08:08:27.196813 8463 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.36.253" port: 36671 } has no permanent_uuid. Determining permanent_uuid...
I20260811 08:08:27.197193 8466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:27.197076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.253:36671 (local address 127.0.0.1:55390)
0811 08:08:27.197124 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:27.197174 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.253:36671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260811 08:08:27.197367 8407 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.36.253:36671: connect: Connection refused (error 111)
I20260811 08:08:27.197834 8466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:27.197743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.253:36671 (local address 127.0.0.1:55400)
0811 08:08:27.197792 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:27.197817 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.253:36671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260811 08:08:27.197989 8463 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.36.253:36671: Network error: Client connection negotiation failed: client connection to 127.15.36.253:36671: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.15.36.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.253.keytab.
Entry for principal kudu/127.15.36.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.253.keytab.
I20260811 08:08:27.218237 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.253:36671
--webserver_interface=127.15.36.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.253.keytab
--principal=kudu/127.15.36.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:44957
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.36.254:37283,127.15.36.253:36671,127.15.36.252:36743
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 08:08:27.247277 8463 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.36.253" port: 36671 } attempt: 1
I20260811 08:08:27.247870 8466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:27.247705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.253:36671 (local address 127.0.0.1:55406)
0811 08:08:27.247774 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:27.247821 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.253:36671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260811 08:08:27.248287 8466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:27.248146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.253:36671 (local address 127.0.0.1:55412)
0811 08:08:27.248210 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:27.248256 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.253:36671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260811 08:08:27.248420 8463 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.36.253:36671: Network error: Client connection negotiation failed: client connection to 127.15.36.253:36671: connect: Connection refused (error 111)
W20260811 08:08:27.306247 8471 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 08:08:27.306493 8471 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:08:27.306512 8471 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:08:27.306535 8471 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:08:27.307870 8471 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:08:27.307930 8471 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:08:27.307945 8471 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:08:27.307960 8471 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:08:27.307972 8471 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:08:27.309623 8471 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:44957
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.15.36.254:37283,127.15.36.253:36671,127.15.36.252:36743
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.253.keytab
--principal=kudu/127.15.36.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.253:36671
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.15.36.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8471
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:08:27.309942 8471 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:08:27.310214 8471 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:08:27.315433 8476 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:27.315513 8481 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:27.315615 8471 server_base.cc:1034] running on GCE node
W20260811 08:08:27.315508 8477 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:27.315956 8471 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:08:27.316421 8471 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:08:27.316551 8463 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.36.253" port: 36671 } attempt: 2
I20260811 08:08:27.316943 8466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:27.316808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.253:36671 (local address 127.0.0.1:55416)
0811 08:08:27.316870 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:27.316911 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.253:36671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260811 08:08:27.317286 8466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:27.317208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.253:36671 (local address 127.0.0.1:55432)
0811 08:08:27.317248 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:27.317271 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.253:36671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260811 08:08:27.317392 8463 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.36.253:36671: Network error: Client connection negotiation failed: client connection to 127.15.36.253:36671: connect: Connection refused (error 111)
I20260811 08:08:27.317636 8471 hybrid_clock.cc:648] HybridClock initialized: now 1786435707317610 us; error 37 us; skew 500 ppm
Aug 11 08:08:27 dist-test-slave-2w3w krb5kdc[8376](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435707, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:08:27.320397 8471 init.cc:377] Logged in from keytab as kudu/127.15.36.253@KRBTEST.COM (short username kudu)
I20260811 08:08:27.320896 8471 webserver.cc:460] Webserver started at http://127.15.36.253:44135/ using document root <none> and password file <none>
I20260811 08:08:27.321163 8471 fs_manager.cc:359] Metadata directory not provided
I20260811 08:08:27.321233 8471 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:08:27.321388 8471 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:08:27.322496 8471 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/minicluster-data/master-1/data/instance:
uuid: "e76feeeb79f34746aacfc8ff98c9fb76"
format_stamp: "Formatted at 2026-08-11 08:08:27 on dist-test-slave-2w3w"
server_key: "8020d99fd1be0d312d2b31f85a765840"
server_key_iv: "a39de60625b46cf247783346d1270b44"
server_key_version: "encryptionkey@0"
I20260811 08:08:27.322885 8471 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/minicluster-data/master-1/wal/instance:
uuid: "e76feeeb79f34746aacfc8ff98c9fb76"
format_stamp: "Formatted at 2026-08-11 08:08:27 on dist-test-slave-2w3w"
server_key: "8020d99fd1be0d312d2b31f85a765840"
server_key_iv: "a39de60625b46cf247783346d1270b44"
server_key_version: "encryptionkey@0"
I20260811 08:08:27.324337 8471 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:08:27.325150 8488 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:27.325387 8471 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:08:27.325495 8471 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/minicluster-data/master-1/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/minicluster-data/master-1/wal
uuid: "e76feeeb79f34746aacfc8ff98c9fb76"
format_stamp: "Formatted at 2026-08-11 08:08:27 on dist-test-slave-2w3w"
server_key: "8020d99fd1be0d312d2b31f85a765840"
server_key_iv: "a39de60625b46cf247783346d1270b44"
server_key_version: "encryptionkey@0"
I20260811 08:08:27.325574 8471 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:08:27.337782 8471 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:08:27.340375 8471 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:08:27.340546 8471 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:08:27.344702 8471 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.253:36671
I20260811 08:08:27.344754 8544 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.253:36671 every 8 connection(s)
I20260811 08:08:27.345147 8471 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/minicluster-data/master-1/data/info.pb
I20260811 08:08:27.346196 8545 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:08:27.347784 8545 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.36.254" port: 37283 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 08:08:27 dist-test-slave-2w3w krb5kdc[8376](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435707, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.253@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:08:27.354621 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 8471
I20260811 08:08:27.354729 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/minicluster-data/master-1/wal/instance
I20260811 08:08:27.355028 15507 external_mini_cluster.cc:1428] Setting key aa0af3b5fb94271b07011bd2705c726a
I20260811 08:08:27.357856 8467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:27.348490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50180 (local address 127.15.36.254:37283)
0811 08:08:27.348552 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:27.348554 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:27.348780 (+ 226us) server_negotiation.cc:407] Connection header received
0811 08:08:27.349316 (+ 536us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:27.349318 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:27.349335 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:27.349409 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:27.350092 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:27.350598 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:27.351756 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:27.351971 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:27.352053 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:27.354519 (+ 2466us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:27.354521 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:27.354521 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:27.354531 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:27.356161 (+ 1630us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:27.356715 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:27.356716 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:27.356717 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:27.356789 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:27.357075 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:27.357076 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:27.357077 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:27.357242 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:27.357317 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:27.357638 (+ 321us) server_negotiation.cc:299] Negotiation successful
0811 08:08:27.357737 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 08:08:27.358058 8547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:27.348461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:37283 (local address 127.0.0.1:50180)
0811 08:08:27.348653 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:27.348689 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:27.349195 (+ 506us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:27.349508 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:27.349511 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:27.349773 (+ 262us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:08:27.349988 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:27.349992 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:27.350711 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:27.350712 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:27.351618 (+ 906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:27.351621 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:27.352075 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:27.352076 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:27.352210 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:27.352740 (+ 530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:08:27.352758 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:08:27.354374 (+ 1616us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:08:27.356260 (+ 1886us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:27.356269 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:27.356272 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:27.356623 (+ 351us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:27.356877 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:27.356877 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:27.356878 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:27.357006 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:27.357338 (+ 332us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:08:27.357345 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:08:27.357495 (+ 150us) client_negotiation.cc:769] Sending connection context
0811 08:08:27.357599 (+ 104us) client_negotiation.cc:240] Negotiation successful
0811 08:08:27.357792 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":96,"threads_started":1}
I20260811 08:08:27.358657 8545 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.36.253" port: 36671 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 08:08:27 dist-test-slave-2w3w krb5kdc[8376](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435707, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.253@KRBTEST.COM for kudu/127.15.36.253@KRBTEST.COM
WARNING: no policy specified for kudu/127.15.36.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.36.252@KRBTEST.COM" created.
I20260811 08:08:27.366653 8547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:27.358941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.253:36671 (local address 127.0.0.1:55446)
0811 08:08:27.359012 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:27.359023 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:27.359066 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:27.359401 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:27.359402 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:27.359554 (+ 152us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:08:27.359603 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:27.359605 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:27.360472 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:27.360474 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:27.360981 (+ 507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:27.360982 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:27.361491 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:27.361492 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:27.361556 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:27.362104 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:08:27.362109 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:08:27.363437 (+ 1328us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:08:27.365305 (+ 1868us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:27.365306 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:27.365306 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:27.365522 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:27.365861 (+ 339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:27.365862 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:27.365862 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:27.365927 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:27.366344 (+ 417us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:08:27.366345 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:08:27.366388 (+ 43us) client_negotiation.cc:769] Sending connection context
0811 08:08:27.366462 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 08:08:27.366578 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20260811 08:08:27.366824 8549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:27.359063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55446 (local address 127.15.36.253:36671)
0811 08:08:27.359246 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:27.359251 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:27.359274 (+ 23us) server_negotiation.cc:407] Connection header received
0811 08:08:27.359293 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:27.359295 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:27.359306 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:27.359387 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:27.359683 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:27.360376 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:27.361064 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:27.361398 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:27.361492 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:27.363524 (+ 2032us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:27.363534 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:27.363534 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:27.363541 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:27.365176 (+ 1635us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:27.365612 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:27.365616 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:27.365616 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:27.365709 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:27.366032 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:27.366033 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:27.366033 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:27.366258 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:27.366369 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:27.366527 (+ 158us) server_negotiation.cc:299] Negotiation successful
0811 08:08:27.366681 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":26,"server-negotiator.queue_time_us":126,"thread_start_us":96,"threads_started":1}
I20260811 08:08:27.367565 8545 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.36.252" port: 36743 } has no permanent_uuid. Determining permanent_uuid...
I20260811 08:08:27.367978 8547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:27.367834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.252:36743 (local address 127.0.0.1:60872)
0811 08:08:27.367887 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:27.367946 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.252:36743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260811 08:08:27.368120 8492 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.36.252:36743: connect: Connection refused (error 111)
I20260811 08:08:27.368618 8547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:27.368529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.252:36743 (local address 127.0.0.1:60874)
0811 08:08:27.368568 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:27.368592 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.252:36743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260811 08:08:27.368767 8545 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.36.252:36743: Network error: Client connection negotiation failed: client connection to 127.15.36.252:36743: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.36.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.252.keytab.
Entry for principal kudu/127.15.36.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.252.keytab.
I20260811 08:08:27.386241 15507 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP5pk_f/build/release/bin/kudu
/tmp/dist-test-taskP5pk_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.252:36743
--webserver_interface=127.15.36.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.252.keytab
--principal=kudu/127.15.36.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.36.212:44957
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.36.254:37283,127.15.36.253:36671,127.15.36.252:36743
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 08:08:27.408586 8463 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.36.253" port: 36671 } attempt: 3
Aug 11 08:08:27 dist-test-slave-2w3w krb5kdc[8376](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435707, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.254@KRBTEST.COM for kudu/127.15.36.253@KRBTEST.COM
I20260811 08:08:27.418035 8545 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.36.252" port: 36743 } attempt: 1
I20260811 08:08:27.418514 8547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:27.418352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.252:36743 (local address 127.0.0.1:60884)
0811 08:08:27.418445 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:27.418475 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.252:36743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260811 08:08:27.418526 8466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:27.409331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.253:36671 (local address 127.0.0.1:55456)
0811 08:08:27.409393 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:27.409406 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:27.409504 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:27.409730 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:27.409731 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:27.410012 (+ 281us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:08:27.410100 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:27.410102 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:27.411137 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:27.411138 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:27.412074 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:27.412077 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:27.412688 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:27.412689 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:27.412796 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:27.413355 (+ 559us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:08:27.413361 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:08:27.415097 (+ 1736us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:08:27.417217 (+ 2120us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:27.417218 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:27.417219 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:27.417469 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:27.417706 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:27.417707 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:27.417707 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:27.417785 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:27.418135 (+ 350us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:08:27.418137 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:08:27.418190 (+ 53us) client_negotiation.cc:769] Sending connection context
0811 08:08:27.418270 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 08:08:27.418396 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260811 08:08:27.418861 8549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:27.409136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55456 (local address 127.15.36.253:36671)
0811 08:08:27.409213 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:27.409216 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:27.409570 (+ 354us) server_negotiation.cc:407] Connection header received
0811 08:08:27.409606 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:27.409607 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:27.409622 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:27.409681 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:27.410212 (+ 531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:27.411028 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:27.412197 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:27.412583 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:27.412673 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:27.415199 (+ 2526us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:27.415200 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:27.415201 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:27.415209 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:27.416996 (+ 1787us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:27.417557 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:27.417558 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:27.417558 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:27.417625 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:27.417884 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:27.417885 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:27.417885 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:27.418038 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:27.418104 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:27.418656 (+ 552us) server_negotiation.cc:299] Negotiation successful
0811 08:08:27.418763 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 08:08:27.419401 8553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:27.419124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.252:36743 (local address 127.0.0.1:60894)
0811 08:08:27.419324 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:27.419365 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.252:36743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":92,"threads_started":1}
I20260811 08:08:27.419485 8463 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.36.252" port: 36743 } has no permanent_uuid. Determining permanent_uuid...
W20260811 08:08:27.419543 8545 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.36.252:36743: Network error: Client connection negotiation failed: client connection to 127.15.36.252:36743: connect: Connection refused (error 111)
I20260811 08:08:27.419814 8466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:27.419727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.252:36743 (local address 127.0.0.1:60900)
0811 08:08:27.419769 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:27.419790 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.252:36743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260811 08:08:27.420185 8466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:27.420075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.252:36743 (local address 127.0.0.1:60904)
0811 08:08:27.420126 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:27.420159 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.252:36743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260811 08:08:27.420300 8463 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.36.252:36743: Network error: Client connection negotiation failed: client connection to 127.15.36.252:36743: connect: Connection refused (error 111)
I20260811 08:08:27.451449 8463 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.36.252" port: 36743 } attempt: 1
I20260811 08:08:27.451961 8466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:27.451787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.252:36743 (local address 127.0.0.1:60910)
0811 08:08:27.451864 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:27.451918 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.252:36743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260811 08:08:27.452348 8466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:27.452244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.252:36743 (local address 127.0.0.1:60916)
0811 08:08:27.452298 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:27.452328 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.252:36743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260811 08:08:27.452458 8463 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.36.252:36743: Network error: Client connection negotiation failed: client connection to 127.15.36.252:36743: connect: Connection refused (error 111)
W20260811 08:08:27.475106 8552 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 08:08:27.475328 8552 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:08:27.475345 8552 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:08:27.475394 8552 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:08:27.476547 8552 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:08:27.476596 8552 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:08:27.476610 8552 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:08:27.476624 8552 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:08:27.476660 8552 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:08:27.478206 8552 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.36.212:44957
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.15.36.254:37283,127.15.36.253:36671,127.15.36.252:36743
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/krb5kdc/kudu_127.15.36.252.keytab
--principal=kudu/127.15.36.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.36.252:36743
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.15.36.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8552
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:08:27.478483 8552 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:08:27.478729 8552 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:08:27.483777 8558 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:08:27.483861 8559 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:27.483985 8552 server_base.cc:1034] running on GCE node
W20260811 08:08:27.483817 8561 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:08:27.484300 8552 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:08:27.484601 8552 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:08:27.485735 8552 hybrid_clock.cc:648] HybridClock initialized: now 1786435707485713 us; error 42 us; skew 500 ppm
I20260811 08:08:27.487702 8545 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.36.252" port: 36743 } attempt: 2
I20260811 08:08:27.488160 8547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:27.488014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.252:36743 (local address 127.0.0.1:60928)
0811 08:08:27.488090 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:27.488127 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.252:36743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
Aug 11 08:08:27 dist-test-slave-2w3w krb5kdc[8376](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435707, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:08:27.488549 8547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:27.488446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.252:36743 (local address 127.0.0.1:60938)
0811 08:08:27.488494 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:27.488528 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.36.252:36743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260811 08:08:27.488574 8552 init.cc:377] Logged in from keytab as kudu/127.15.36.252@KRBTEST.COM (short username kudu)
W20260811 08:08:27.488670 8545 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.36.252:36743: Network error: Client connection negotiation failed: client connection to 127.15.36.252:36743: connect: Connection refused (error 111)
I20260811 08:08:27.489111 8552 webserver.cc:460] Webserver started at http://127.15.36.252:34961/ using document root <none> and password file <none>
I20260811 08:08:27.489408 8552 fs_manager.cc:359] Metadata directory not provided
I20260811 08:08:27.489485 8552 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:08:27.489632 8552 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:08:27.490763 8552 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/minicluster-data/master-2/data/instance:
uuid: "ba5a8ca48d4c4a73a8aeddb25ed6c3ce"
format_stamp: "Formatted at 2026-08-11 08:08:27 on dist-test-slave-2w3w"
server_key: "d8dc01323d75990975b4dde5f37d4892"
server_key_iv: "71bc391bf088211d1377b8fde1ee84c5"
server_key_version: "encryptionkey@0"
I20260811 08:08:27.491184 8552 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/minicluster-data/master-2/wal/instance:
uuid: "ba5a8ca48d4c4a73a8aeddb25ed6c3ce"
format_stamp: "Formatted at 2026-08-11 08:08:27 on dist-test-slave-2w3w"
server_key: "d8dc01323d75990975b4dde5f37d4892"
server_key_iv: "71bc391bf088211d1377b8fde1ee84c5"
server_key_version: "encryptionkey@0"
I20260811 08:08:27.492697 8552 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:08:27.493697 8568 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:08:27.493934 8552 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:08:27.494040 8552 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/minicluster-data/master-2/data,/tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/minicluster-data/master-2/wal
uuid: "ba5a8ca48d4c4a73a8aeddb25ed6c3ce"
format_stamp: "Formatted at 2026-08-11 08:08:27 on dist-test-slave-2w3w"
server_key: "d8dc01323d75990975b4dde5f37d4892"
server_key_iv: "71bc391bf088211d1377b8fde1ee84c5"
server_key_version: "encryptionkey@0"
I20260811 08:08:27.494128 8552 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:08:27.504830 8552 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:08:27.507079 8552 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:08:27.507257 8552 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:08:27.511322 8552 rpc_server.cc:307] RPC server started. Bound to: 127.15.36.252:36743
I20260811 08:08:27.511420 8625 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.36.252:36743 every 8 connection(s)
I20260811 08:08:27.511933 8552 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/minicluster-data/master-2/data/info.pb
I20260811 08:08:27.512123 15507 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP5pk_f/build/release/bin/kudu as pid 8552
I20260811 08:08:27.512261 15507 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP5pk_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786435400844580-15507-0/minicluster-data/master-2/wal/instance
I20260811 08:08:27.512504 15507 external_mini_cluster.cc:1428] Setting key f2f62b18175fb3235f9ef7cfd95762b8
I20260811 08:08:27.513202 8626 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:08:27.515025 8626 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.36.254" port: 37283 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 08:08:27 dist-test-slave-2w3w krb5kdc[8376](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435707, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.36.252@KRBTEST.COM
Aug 11 08:08:27 dist-test-slave-2w3w krb5kdc[8376](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435707, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.252@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:08:27.523725 8467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:27.515751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50196 (local address 127.15.36.254:37283)
0811 08:08:27.515822 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:27.515824 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:27.515986 (+ 162us) server_negotiation.cc:407] Connection header received
0811 08:08:27.516038 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:27.516039 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:27.516053 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:27.516124 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:27.516640 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:27.517155 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:27.518158 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:27.518497 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:27.518589 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:27.520888 (+ 2299us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:27.520889 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:27.520890 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:27.520899 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:27.522374 (+ 1475us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:27.522787 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:27.522789 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:27.522789 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:27.522895 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:27.523141 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:27.523142 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:27.523142 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:27.523266 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:27.523344 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:27.523534 (+ 190us) server_negotiation.cc:299] Negotiation successful
0811 08:08:27.523616 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 08:08:27.523837 8630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:27.515685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.254:37283 (local address 127.0.0.1:50196)
0811 08:08:27.515872 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:27.515914 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:27.515983 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:27.516138 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:27.516139 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:27.516475 (+ 336us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:08:27.516547 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:27.516549 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:27.517246 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:27.517247 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:27.518061 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:27.518064 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:27.518614 (+ 550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:27.518615 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:27.518668 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:27.519160 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:08:27.519168 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:08:27.520788 (+ 1620us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:08:27.522484 (+ 1696us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:27.522492 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:27.522494 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:27.522704 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:27.523003 (+ 299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:27.523004 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:27.523004 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:27.523069 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:27.523339 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:08:27.523346 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:08:27.523397 (+ 51us) client_negotiation.cc:769] Sending connection context
0811 08:08:27.523493 (+ 96us) client_negotiation.cc:240] Negotiation successful
0811 08:08:27.523615 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":111,"threads_started":1}
I20260811 08:08:27.523837 8629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:27.513047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60944 (local address 127.15.36.252:36743)
0811 08:08:27.513245 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:27.513255 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:27.513289 (+ 34us) server_negotiation.cc:407] Connection header received
0811 08:08:27.513770 (+ 481us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:27.513776 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:27.513820 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:27.513982 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:27.514647 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:27.515884 (+ 1237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:27.516776 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:27.517182 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:27.517320 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:27.520089 (+ 2769us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:27.520097 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:27.520098 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:27.520105 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:27.522068 (+ 1963us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:27.522457 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:27.522460 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:27.522461 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:27.522556 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:27.522780 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:27.522781 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:27.522781 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:27.523105 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:27.523254 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:27.523382 (+ 128us) server_negotiation.cc:299] Negotiation successful
0811 08:08:27.523526 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":93,"threads_started":1}
I20260811 08:08:27.524364 8626 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.36.253" port: 36671 } has no permanent_uuid. Determining permanent_uuid...
I20260811 08:08:27.528033 8463 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.36.252" port: 36743 } attempt: 2
Aug 11 08:08:27 dist-test-slave-2w3w krb5kdc[8376](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435707, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.252@KRBTEST.COM for kudu/127.15.36.253@KRBTEST.COM
Aug 11 08:08:27 dist-test-slave-2w3w krb5kdc[8376](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435707, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.36.254@KRBTEST.COM
I20260811 08:08:27.533103 8467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:27.524804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50206 (local address 127.15.36.254:37283)
0811 08:08:27.524849 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:27.524850 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:27.524857 (+ 7us) server_negotiation.cc:407] Connection header received
0811 08:08:27.524876 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:27.524877 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:27.524886 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:27.524944 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:27.525495 (+ 551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:27.526189 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:27.527214 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:27.527488 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:27.527546 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:27.530312 (+ 2766us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:27.530313 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:27.530313 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:27.530320 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:27.531794 (+ 1474us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:27.532198 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:27.532199 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:27.532199 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:27.532261 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:27.532467 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:27.532468 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:27.532468 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:27.532603 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:27.532791 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:27.532829 (+ 38us) server_negotiation.cc:299] Negotiation successful
0811 08:08:27.532919 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
Aug 11 08:08:27 dist-test-slave-2w3w krb5kdc[8376](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435707, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.254@KRBTEST.COM for kudu/127.15.36.252@KRBTEST.COM
I20260811 08:08:27.533134 8549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:27.524716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55458 (local address 127.15.36.253:36671)
0811 08:08:27.524764 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:27.524766 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:27.524776 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:08:27.524804 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:27.524805 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:27.524816 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:27.524887 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:27.525242 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:27.525962 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:27.527032 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:27.527309 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:27.527391 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:27.530019 (+ 2628us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:27.530021 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:27.530021 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:27.530029 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:27.531814 (+ 1785us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:27.532265 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:27.532267 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:27.532267 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:27.532328 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:27.532519 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:27.532521 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:27.532521 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:27.532675 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:27.532740 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:27.532959 (+ 219us) server_negotiation.cc:299] Negotiation successful
0811 08:08:27.533038 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 08:08:27.533483 8630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:27.524639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.253:36671 (local address 127.0.0.1:55458)
0811 08:08:27.524691 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:27.524702 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:27.524741 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:27.524891 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:27.524892 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:27.525084 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:08:27.525135 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:27.525137 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:27.526077 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:27.526078 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:27.526897 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:27.526900 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:27.527389 (+ 489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:27.527390 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:27.527437 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:27.527948 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:08:27.527954 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:08:27.529925 (+ 1971us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:08:27.531923 (+ 1998us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:27.531924 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:27.531925 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:27.532159 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:27.532393 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:27.532393 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:27.532394 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:27.532458 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:27.532770 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:08:27.532771 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:08:27.532819 (+ 48us) client_negotiation.cc:769] Sending connection context
0811 08:08:27.533254 (+ 435us) client_negotiation.cc:240] Negotiation successful
0811 08:08:27.533370 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260811 08:08:27.534139 8626 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.36.252" port: 36743 } has no permanent_uuid. Determining permanent_uuid...
I20260811 08:08:27.536442 8466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:27.528312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.252:36743 (local address 127.0.0.1:60952)
0811 08:08:27.528360 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:27.528370 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:27.528428 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:27.528744 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:27.528745 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:27.528914 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:08:27.528961 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:27.528963 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:27.529691 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:27.529692 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:27.530493 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:27.530495 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:27.531056 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:27.531057 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:27.531131 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:27.531971 (+ 840us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:08:27.531976 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:08:27.533463 (+ 1487us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:08:27.535377 (+ 1914us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:27.535378 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:27.535378 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:27.535560 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:27.535778 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:27.535779 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:27.535779 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:27.535846 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:27.536120 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:08:27.536121 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:08:27.536167 (+ 46us) client_negotiation.cc:769] Sending connection context
0811 08:08:27.536233 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 08:08:27.536339 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260811 08:08:27.536837 8629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:27.528368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60952 (local address 127.15.36.252:36743)
0811 08:08:27.528611 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:27.528613 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:27.528622 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:08:27.528645 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:27.528646 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:27.528657 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:27.528724 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:27.529036 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:27.529611 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:27.530567 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:27.530933 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:27.531028 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:27.533578 (+ 2550us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:27.533580 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:27.533580 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:27.533590 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:27.535283 (+ 1693us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:27.535638 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:27.535639 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:27.535639 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:27.535695 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:27.535921 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:27.535922 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:27.535922 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:27.536041 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:27.536115 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:27.536651 (+ 536us) server_negotiation.cc:299] Negotiation successful
0811 08:08:27.536735 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":219}
Aug 11 08:08:27 dist-test-slave-2w3w krb5kdc[8376](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435707, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.36.253@KRBTEST.COM
I20260811 08:08:27.538825 8463 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b392945996f44179d86e890198ff0d8: Bootstrap starting.
I20260811 08:08:27.539600 8463 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3b392945996f44179d86e890198ff0d8: Neither blocks nor log segments found. Creating new log.
I20260811 08:08:27.539930 8463 log.cc:824] T 00000000000000000000000000000000 P 3b392945996f44179d86e890198ff0d8: Log is configured to *not* fsync() on all Append() calls
I20260811 08:08:27.540927 8463 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b392945996f44179d86e890198ff0d8: No bootstrap required, opened a new log
I20260811 08:08:27.542140 8549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:27.533927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55462 (local address 127.15.36.253:36671)
0811 08:08:27.533966 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:27.533968 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:27.533976 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:08:27.534046 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:27.534047 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:27.534057 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:27.534113 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:27.534643 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:27.535259 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:27.536233 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:27.536553 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:27.536619 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:27.539170 (+ 2551us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:27.539171 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:27.539172 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:27.539180 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:27.540854 (+ 1674us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:27.541281 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:27.541282 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:27.541282 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:27.541342 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:27.541562 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:27.541563 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:27.541564 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:27.541696 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:27.541827 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:27.541961 (+ 134us) server_negotiation.cc:299] Negotiation successful
0811 08:08:27.542050 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
Aug 11 08:08:27 dist-test-slave-2w3w krb5kdc[8376](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435707, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.252@KRBTEST.COM for kudu/127.15.36.252@KRBTEST.COM
I20260811 08:08:27.543058 8463 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3b392945996f44179d86e890198ff0d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b392945996f44179d86e890198ff0d8" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 37283 } } peers { permanent_uuid: "e76feeeb79f34746aacfc8ff98c9fb76" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 36671 } } peers { permanent_uuid: "ba5a8ca48d4c4a73a8aeddb25ed6c3ce" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 36743 } }
I20260811 08:08:27.543228 8463 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3b392945996f44179d86e890198ff0d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b392945996f44179d86e890198ff0d8, State: Initialized, Role: FOLLOWER
I20260811 08:08:27.543339 8463 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3b392945996f44179d86e890198ff0d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b392945996f44179d86e890198ff0d8" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 37283 } } peers { permanent_uuid: "e76feeeb79f34746aacfc8ff98c9fb76" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 36671 } } peers { permanent_uuid: "ba5a8ca48d4c4a73a8aeddb25ed6c3ce" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 36743 } }
I20260811 08:08:27.543756 8463 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3b392945996f44179d86e890198ff0d8 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:08:27.544550 8636 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b392945996f44179d86e890198ff0d8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b392945996f44179d86e890198ff0d8" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 37283 } } peers { permanent_uuid: "e76feeeb79f34746aacfc8ff98c9fb76" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 36671 } } peers { permanent_uuid: "ba5a8ca48d4c4a73a8aeddb25ed6c3ce" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 36743 } } }
I20260811 08:08:27.544646 8636 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b392945996f44179d86e890198ff0d8 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 08:08:27.545567 15507 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260811 08:08:27.545795 8648 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3b392945996f44179d86e890198ff0d8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 08:08:27.545835 8648 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 08:08:27.546840 8632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:27.534655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.252:36743 (local address 127.0.0.1:60964)
0811 08:08:27.534857 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:27.534868 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:27.534927 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:27.535555 (+ 628us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:27.535556 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:27.535739 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:08:27.535803 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:27.535804 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:27.536958 (+ 1154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:27.536959 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:27.540683 (+ 3724us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:27.540687 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:27.541158 (+ 471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:27.541158 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:27.541200 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:27.541887 (+ 687us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:08:27.541891 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:08:27.543318 (+ 1427us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:08:27.545551 (+ 2233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:27.545552 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:27.545553 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:27.545797 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:27.546007 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:27.546007 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:27.546007 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:27.546057 (+ 50us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:27.546409 (+ 352us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:08:27.546410 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:08:27.546461 (+ 51us) client_negotiation.cc:769] Sending connection context
0811 08:08:27.546543 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 08:08:27.546672 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":125,"threads_started":1}
I20260811 08:08:27.546916 8633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:27.534828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60964 (local address 127.15.36.252:36743)
0811 08:08:27.535416 (+ 588us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:27.535418 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:27.535425 (+ 7us) server_negotiation.cc:407] Connection header received
0811 08:08:27.535443 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:27.535444 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:27.535453 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:27.535513 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:27.535873 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:27.536847 (+ 974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:27.540777 (+ 3930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:27.541041 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:27.541103 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:27.543416 (+ 2313us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:27.543418 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:27.543418 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:27.543425 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:27.545464 (+ 2039us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:27.545883 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:27.545884 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:27.545884 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:27.545942 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:27.546114 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:27.546115 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:27.546115 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:27.546323 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:27.546413 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:27.546584 (+ 171us) server_negotiation.cc:299] Negotiation successful
0811 08:08:27.546762 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":83,"server-negotiator.queue_time_us":562,"thread_start_us":72,"threads_started":1}
I20260811 08:08:27.546469 8434 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "3b392945996f44179d86e890198ff0d8"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50206
I20260811 08:08:27.547255 8434 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3b392945996f44179d86e890198ff0d8 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 08:08:27.547318 8434 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3b392945996f44179d86e890198ff0d8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:08:27.548408 8434 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3b392945996f44179d86e890198ff0d8 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b392945996f44179d86e890198ff0d8" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 37283 } } peers { permanent_uuid: "e76feeeb79f34746aacfc8ff98c9fb76" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 36671 } } peers { permanent_uuid: "ba5a8ca48d4c4a73a8aeddb25ed6c3ce" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 36743 } }
I20260811 08:08:27.548707 8434 leader_election.cc:288] T 00000000000000000000000000000000 P 3b392945996f44179d86e890198ff0d8 [CANDIDATE]: Term 1 election: Requested vote from peers e76feeeb79f34746aacfc8ff98c9fb76 (127.15.36.253:36671), ba5a8ca48d4c4a73a8aeddb25ed6c3ce (127.15.36.252:36743)
I20260811 08:08:27.548877 8626 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba5a8ca48d4c4a73a8aeddb25ed6c3ce: Bootstrap starting.
I20260811 08:08:27.549639 8626 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ba5a8ca48d4c4a73a8aeddb25ed6c3ce: Neither blocks nor log segments found. Creating new log.
I20260811 08:08:27.549969 8626 log.cc:824] T 00000000000000000000000000000000 P ba5a8ca48d4c4a73a8aeddb25ed6c3ce: Log is configured to *not* fsync() on all Append() calls
I20260811 08:08:27.549723 8389 master_runner.cc:186] Error getting master registration for 127.15.36.253:36671: OK, instance_id { permanent_uuid: "e76feeeb79f34746aacfc8ff98c9fb76" instance_seqno: 1786435707343578 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 08:08:27.552709 8389 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 08:08:27.554901 8626 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba5a8ca48d4c4a73a8aeddb25ed6c3ce: No bootstrap required, opened a new log
I20260811 08:08:27.557878 8626 raft_consensus.cc:348] T 00000000000000000000000000000000 P ba5a8ca48d4c4a73a8aeddb25ed6c3ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b392945996f44179d86e890198ff0d8" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 37283 } } peers { permanent_uuid: "e76feeeb79f34746aacfc8ff98c9fb76" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 36671 } } peers { permanent_uuid: "ba5a8ca48d4c4a73a8aeddb25ed6c3ce" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 36743 } }
I20260811 08:08:27.558080 8626 raft_consensus.cc:729] T 00000000000000000000000000000000 P ba5a8ca48d4c4a73a8aeddb25ed6c3ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba5a8ca48d4c4a73a8aeddb25ed6c3ce, State: Initialized, Role: FOLLOWER
I20260811 08:08:27.558183 8626 consensus_queue.cc:260] T 00000000000000000000000000000000 P ba5a8ca48d4c4a73a8aeddb25ed6c3ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b392945996f44179d86e890198ff0d8" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 37283 } } peers { permanent_uuid: "e76feeeb79f34746aacfc8ff98c9fb76" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 36671 } } peers { permanent_uuid: "ba5a8ca48d4c4a73a8aeddb25ed6c3ce" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 36743 } }
I20260811 08:08:27.558620 8626 sys_catalog.cc:564] T 00000000000000000000000000000000 P ba5a8ca48d4c4a73a8aeddb25ed6c3ce [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:08:27.558643 8596 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3b392945996f44179d86e890198ff0d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "ba5a8ca48d4c4a73a8aeddb25ed6c3ce"
I20260811 08:08:27.558730 8596 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ba5a8ca48d4c4a73a8aeddb25ed6c3ce [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:08:27.558881 8633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:27.550188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60980 (local address 127.15.36.252:36743)
0811 08:08:27.550232 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:27.550235 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:27.550354 (+ 119us) server_negotiation.cc:407] Connection header received
0811 08:08:27.550472 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:27.550473 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:27.550484 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:27.550520 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:27.551406 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:27.552158 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:27.553242 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:27.553570 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:27.553615 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:27.555377 (+ 1762us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:27.555379 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:27.555379 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:27.555388 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:27.557473 (+ 2085us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:27.557933 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:27.557935 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:27.557935 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:27.557995 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:27.558213 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:27.558214 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:27.558214 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:27.558378 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:27.558466 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:27.558693 (+ 227us) server_negotiation.cc:299] Negotiation successful
0811 08:08:27.558786 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 08:08:27.559839 8596 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ba5a8ca48d4c4a73a8aeddb25ed6c3ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b392945996f44179d86e890198ff0d8 in term 1.
I20260811 08:08:27.560401 8409 leader_election.cc:302] T 00000000000000000000000000000000 P 3b392945996f44179d86e890198ff0d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b392945996f44179d86e890198ff0d8, ba5a8ca48d4c4a73a8aeddb25ed6c3ce; no voters:
I20260811 08:08:27.560585 8636 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3b392945996f44179d86e890198ff0d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:08:27.560745 8636 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3b392945996f44179d86e890198ff0d8 [term 1 LEADER]: Becoming Leader. State: Replica: 3b392945996f44179d86e890198ff0d8, State: Running, Role: LEADER
W20260811 08:08:27.560799 8671 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ba5a8ca48d4c4a73a8aeddb25ed6c3ce: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 08:08:27.560853 8671 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 08:08:27.560827 8636 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3b392945996f44179d86e890198ff0d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b392945996f44179d86e890198ff0d8" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 37283 } } peers { permanent_uuid: "e76feeeb79f34746aacfc8ff98c9fb76" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 36671 } } peers { permanent_uuid: "ba5a8ca48d4c4a73a8aeddb25ed6c3ce" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 36743 } }
I20260811 08:08:27.561335 8636 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b392945996f44179d86e890198ff0d8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3b392945996f44179d86e890198ff0d8. Latest consensus state: current_term: 1 leader_uuid: "3b392945996f44179d86e890198ff0d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b392945996f44179d86e890198ff0d8" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 37283 } } peers { permanent_uuid: "e76feeeb79f34746aacfc8ff98c9fb76" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 36671 } } peers { permanent_uuid: "ba5a8ca48d4c4a73a8aeddb25ed6c3ce" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 36743 } } }
I20260811 08:08:27.561421 8636 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b392945996f44179d86e890198ff0d8 [sys.catalog]: This master's current role is: LEADER
I20260811 08:08:27.562001 8675 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:08:27.562198 8675 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:08:27.563367 8658 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba5a8ca48d4c4a73a8aeddb25ed6c3ce [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b392945996f44179d86e890198ff0d8" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 37283 } } peers { permanent_uuid: "e76feeeb79f34746aacfc8ff98c9fb76" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 36671 } } peers { permanent_uuid: "ba5a8ca48d4c4a73a8aeddb25ed6c3ce" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 36743 } } }
I20260811 08:08:27.565318 8658 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba5a8ca48d4c4a73a8aeddb25ed6c3ce [sys.catalog]: This master's current role is: FOLLOWER
I20260811 08:08:27.563433 8552 master_runner.cc:186] Error getting master registration for 127.15.36.253:36671: OK, instance_id { permanent_uuid: "e76feeeb79f34746aacfc8ff98c9fb76" instance_seqno: 1786435707343578 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 08:08:27.566499 8552 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 08:08:27.567698 8467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:27.550401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50218 (local address 127.15.36.254:37283)
0811 08:08:27.550440 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:27.550442 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:27.551301 (+ 859us) server_negotiation.cc:407] Connection header received
0811 08:08:27.551512 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:27.551513 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:27.551526 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:27.551555 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:27.553131 (+ 1576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:27.553812 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:27.555929 (+ 2117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:27.556212 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:27.556257 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:27.562813 (+ 6556us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:27.562814 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:27.562815 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:27.562823 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:27.564700 (+ 1877us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:27.565326 (+ 626us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:27.565327 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:27.565328 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:27.565399 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:27.567003 (+ 1604us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:27.567004 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:27.567005 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:27.567150 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:27.567276 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:27.567515 (+ 239us) server_negotiation.cc:299] Negotiation successful
0811 08:08:27.567606 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 08:08:27.567766 8596 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ba5a8ca48d4c4a73a8aeddb25ed6c3ce [term 1 FOLLOWER]: Refusing update from remote peer 3b392945996f44179d86e890198ff0d8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:08:27.568404 8673 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3b392945996f44179d86e890198ff0d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba5a8ca48d4c4a73a8aeddb25ed6c3ce" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 36743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:08:27.568522 8549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:27.550747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55468 (local address 127.15.36.253:36671)
0811 08:08:27.550793 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:27.550794 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:27.553221 (+ 2427us) server_negotiation.cc:407] Connection header received
0811 08:08:27.553648 (+ 427us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:27.553649 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:27.553660 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:27.553688 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:27.560321 (+ 6633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:27.561028 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:27.562902 (+ 1874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:27.563245 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:27.563292 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:27.564950 (+ 1658us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:27.564951 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:27.564952 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:27.564960 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:27.566840 (+ 1880us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:27.567440 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:27.567441 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:27.567441 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:27.567515 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:27.567801 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:27.567802 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:27.567802 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:27.567944 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:27.568025 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:27.568311 (+ 286us) server_negotiation.cc:299] Negotiation successful
0811 08:08:27.568427 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 08:08:27.569996 8658 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba5a8ca48d4c4a73a8aeddb25ed6c3ce [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3b392945996f44179d86e890198ff0d8. Latest consensus state: current_term: 1 leader_uuid: "3b392945996f44179d86e890198ff0d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b392945996f44179d86e890198ff0d8" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 37283 } } peers { permanent_uuid: "e76feeeb79f34746aacfc8ff98c9fb76" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 36671 } } peers { permanent_uuid: "ba5a8ca48d4c4a73a8aeddb25ed6c3ce" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 36743 } } }
I20260811 08:08:27.570117 8658 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba5a8ca48d4c4a73a8aeddb25ed6c3ce [sys.catalog]: This master's current role is: FOLLOWER
I20260811 08:08:27.571055 8636 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b392945996f44179d86e890198ff0d8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3b392945996f44179d86e890198ff0d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b392945996f44179d86e890198ff0d8" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 37283 } } peers { permanent_uuid: "e76feeeb79f34746aacfc8ff98c9fb76" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 36671 } } peers { permanent_uuid: "ba5a8ca48d4c4a73a8aeddb25ed6c3ce" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 36743 } } }
I20260811 08:08:27.571142 8636 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b392945996f44179d86e890198ff0d8 [sys.catalog]: This master's current role is: LEADER
I20260811 08:08:27.571273 8676 mvcc.cc:205] Tried to move back new op lower bound from 7317240658194665472 to 7317240658169896960. Current Snapshot: MvccSnapshot[applied={T|T < 7317240658194665472}]
I20260811 08:08:27.571868 8658 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba5a8ca48d4c4a73a8aeddb25ed6c3ce [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3b392945996f44179d86e890198ff0d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b392945996f44179d86e890198ff0d8" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 37283 } } peers { permanent_uuid: "e76feeeb79f34746aacfc8ff98c9fb76" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 36671 } } peers { permanent_uuid: "ba5a8ca48d4c4a73a8aeddb25ed6c3ce" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 36743 } } }
I20260811 08:08:27.571947 8658 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba5a8ca48d4c4a73a8aeddb25ed6c3ce [sys.catalog]: This master's current role is: FOLLOWER
I20260811 08:08:27.572746 8675 catalog_manager.cc:1347] Generated new cluster ID: f760e5b1982b439fb830056f7485cc6d
I20260811 08:08:27.572795 8675 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:08:27.579871 8545 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.36.252" port: 36743 } attempt: 3
I20260811 08:08:27.583223 8675 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:08:27.584239 8675 catalog_manager.cc:1504] Loading token signing keys...
Aug 11 08:08:27 dist-test-slave-2w3w krb5kdc[8376](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786435707, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.36.253@KRBTEST.COM for kudu/127.15.36.252@KRBTEST.COM
I20260811 08:08:27.588153 8547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:27.580189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.36.252:36743 (local address 127.0.0.1:60992)
0811 08:08:27.580243 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0811 08:08:27.580257 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 08:08:27.580304 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:08:27.580441 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:08:27.580442 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:08:27.580638 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:08:27.580679 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:27.580682 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:27.581596 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:27.581597 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:27.582422 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:08:27.582426 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:08:27.583005 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:08:27.583006 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:08:27.583065 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:27.583564 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:08:27.583570 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:08:27.585122 (+ 1552us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:08:27.586992 (+ 1870us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:27.586993 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:27.586994 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:27.587246 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:27.587459 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:08:27.587459 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:08:27.587460 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:08:27.587516 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:08:27.587827 (+ 311us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:08:27.587827 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:08:27.587872 (+ 45us) client_negotiation.cc:769] Sending connection context
0811 08:08:27.587950 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 08:08:27.588049 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260811 08:08:27.588503 8633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:27.580294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60992 (local address 127.15.36.252:36743)
0811 08:08:27.580334 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:27.580336 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:27.580344 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:08:27.580370 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:27.580371 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:27.580381 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:27.580433 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:27.580773 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:27.581508 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:27.582546 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:27.582848 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:27.582912 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:27.585223 (+ 2311us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:08:27.585225 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:08:27.585225 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:08:27.585233 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:08:27.586875 (+ 1642us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:27.587305 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:27.587325 (+ 20us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:27.587325 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:27.587398 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:08:27.587596 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:08:27.587598 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:08:27.587598 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:08:27.587745 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:08:27.587801 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:27.588331 (+ 530us) server_negotiation.cc:299] Negotiation successful
0811 08:08:27.588410 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 08:08:27.589999 8545 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e76feeeb79f34746aacfc8ff98c9fb76: Bootstrap starting.
I20260811 08:08:27.590422 8675 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3b392945996f44179d86e890198ff0d8: Generated new TSK 0
I20260811 08:08:27.590605 8675 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:08:27.590751 8545 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e76feeeb79f34746aacfc8ff98c9fb76: Neither blocks nor log segments found. Creating new log.
I20260811 08:08:27.591194 8545 log.cc:824] T 00000000000000000000000000000000 P e76feeeb79f34746aacfc8ff98c9fb76: Log is configured to *not* fsync() on all Append() calls
I20260811 08:08:27.592473 8545 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e76feeeb79f34746aacfc8ff98c9fb76: No bootstrap required, opened a new log
I20260811 08:08:27.597453 8545 raft_consensus.cc:348] T 00000000000000000000000000000000 P e76feeeb79f34746aacfc8ff98c9fb76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b392945996f44179d86e890198ff0d8" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 37283 } } peers { permanent_uuid: "e76feeeb79f34746aacfc8ff98c9fb76" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 36671 } } peers { permanent_uuid: "ba5a8ca48d4c4a73a8aeddb25ed6c3ce" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 36743 } }
I20260811 08:08:27.597577 8545 raft_consensus.cc:729] T 00000000000000000000000000000000 P e76feeeb79f34746aacfc8ff98c9fb76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e76feeeb79f34746aacfc8ff98c9fb76, State: Initialized, Role: FOLLOWER
I20260811 08:08:27.597633 8545 consensus_queue.cc:260] T 00000000000000000000000000000000 P e76feeeb79f34746aacfc8ff98c9fb76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b392945996f44179d86e890198ff0d8" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 37283 } } peers { permanent_uuid: "e76feeeb79f34746aacfc8ff98c9fb76" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 36671 } } peers { permanent_uuid: "ba5a8ca48d4c4a73a8aeddb25ed6c3ce" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 36743 } }
I20260811 08:08:27.597908 8684 sys_catalog.cc:455] T 00000000000000000000000000000000 P e76feeeb79f34746aacfc8ff98c9fb76 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b392945996f44179d86e890198ff0d8" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 37283 } } peers { permanent_uuid: "e76feeeb79f34746aacfc8ff98c9fb76" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 36671 } } peers { permanent_uuid: "ba5a8ca48d4c4a73a8aeddb25ed6c3ce" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 36743 } } }
I20260811 08:08:27.598004 8545 sys_catalog.cc:564] T 00000000000000000000000000000000 P e76feeeb79f34746aacfc8ff98c9fb76 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:08:27.598076 8518 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3b392945996f44179d86e890198ff0d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "e76feeeb79f34746aacfc8ff98c9fb76"
I20260811 08:08:27.598217 8518 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e76feeeb79f34746aacfc8ff98c9fb76 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:08:27.599156 8518 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e76feeeb79f34746aacfc8ff98c9fb76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b392945996f44179d86e890198ff0d8 in term 1.
I20260811 08:08:27.598001 8684 sys_catalog.cc:458] T 00000000000000000000000000000000 P e76feeeb79f34746aacfc8ff98c9fb76 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 08:08:27.599594 8517 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e76feeeb79f34746aacfc8ff98c9fb76 [term 1 FOLLOWER]: Refusing update from remote peer 3b392945996f44179d86e890198ff0d8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:08:27.600327 8636 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3b392945996f44179d86e890198ff0d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e76feeeb79f34746aacfc8ff98c9fb76" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 36671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 08:08:27.603240 8695 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e76feeeb79f34746aacfc8ff98c9fb76: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 08:08:27.603292 8695 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 08:08:27.602973 8684 sys_catalog.cc:455] T 00000000000000000000000000000000 P e76feeeb79f34746aacfc8ff98c9fb76 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3b392945996f44179d86e890198ff0d8. Latest consensus state: current_term: 1 leader_uuid: "3b392945996f44179d86e890198ff0d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b392945996f44179d86e890198ff0d8" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 37283 } } peers { permanent_uuid: "e76feeeb79f34746aacfc8ff98c9fb76" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 36671 } } peers { permanent_uuid: "ba5a8ca48d4c4a73a8aeddb25ed6c3ce" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 36743 } } }
I20260811 08:08:27.603487 8684 sys_catalog.cc:458] T 00000000000000000000000000000000 P e76feeeb79f34746aacfc8ff98c9fb76 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 08:08:27.603534 8684 sys_catalog.cc:455] T 00000000000000000000000000000000 P e76feeeb79f34746aacfc8ff98c9fb76 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3b392945996f44179d86e890198ff0d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b392945996f44179d86e890198ff0d8" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 37283 } } peers { permanent_uuid: "e76feeeb79f34746aacfc8ff98c9fb76" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 36671 } } peers { permanent_uuid: "ba5a8ca48d4c4a73a8aeddb25ed6c3ce" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 36743 } } }
I20260811 08:08:27.603572 8684 sys_catalog.cc:458] T 00000000000000000000000000000000 P e76feeeb79f34746aacfc8ff98c9fb76 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 08:08:27.604182 8696 mvcc.cc:205] Tried to move back new op lower bound from 7317240658285424640 to 7317240658169896960. Current Snapshot: MvccSnapshot[applied={T|T < 7317240658194665472}]
W20260811 08:08:27.620317 8633 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:08:27.618504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32772 (local address 127.15.36.252:36743)
0811 08:08:27.618556 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:27.618558 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:27.619583 (+ 1025us) server_negotiation.cc:407] Connection header received
0811 08:08:27.619692 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:27.619693 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:27.619704 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:27.619735 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:27.620235 (+ 500us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:32772: BlockingRecv error: recv got EOF from 127.0.0.1:32772 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260811 08:08:27.621152 8467 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:08:27.618922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50220 (local address 127.15.36.254:37283)
0811 08:08:27.618981 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:27.618983 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:27.620584 (+ 1601us) server_negotiation.cc:407] Connection header received
0811 08:08:27.620700 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:27.620702 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:27.620714 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:27.620744 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:27.621076 (+ 332us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50220: BlockingRecv error: recv got EOF from 127.0.0.1:50220 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260811 08:08:27.621922 8549 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:08:27.619300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55474 (local address 127.15.36.253:36671)
0811 08:08:27.619342 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:27.619343 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:27.621392 (+ 2049us) server_negotiation.cc:407] Connection header received
0811 08:08:27.621491 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:27.621492 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:27.621503 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:27.621533 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:27.621829 (+ 296us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55474: BlockingRecv error: recv got EOF from 127.0.0.1:55474 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260811 08:08:27.624413 8549 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:08:27.623640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55490 (local address 127.15.36.253:36671)
0811 08:08:27.623676 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:27.623678 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:27.623887 (+ 209us) server_negotiation.cc:407] Connection header received
0811 08:08:27.624002 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:27.624003 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:27.624023 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:27.624052 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:27.624362 (+ 310us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55490: BlockingRecv error: recv got EOF from 127.0.0.1:55490 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260811 08:08:27.627537 8549 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:08:27.626732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55498 (local address 127.15.36.253:36671)
0811 08:08:27.626767 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:27.626769 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:27.627023 (+ 254us) server_negotiation.cc:407] Connection header received
0811 08:08:27.627122 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:27.627123 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:27.627134 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:27.627163 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:27.627486 (+ 323us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55498: BlockingRecv error: recv got EOF from 127.0.0.1:55498 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260811 08:08:27.631652 8549 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:08:27.630759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55514 (local address 127.15.36.253:36671)
0811 08:08:27.630796 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:27.630798 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:27.631097 (+ 299us) server_negotiation.cc:407] Connection header received
0811 08:08:27.631199 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:27.631199 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:27.631211 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:27.631242 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:27.631596 (+ 354us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55514: BlockingRecv error: recv got EOF from 127.0.0.1:55514 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260811 08:08:27.637785 8549 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:08:27.636952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55520 (local address 127.15.36.253:36671)
0811 08:08:27.636996 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:27.636998 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:27.637223 (+ 225us) server_negotiation.cc:407] Connection header received
0811 08:08:27.637325 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:27.637326 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:27.637337 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:27.637370 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:27.637728 (+ 358us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55520: BlockingRecv error: recv got EOF from 127.0.0.1:55520 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260811 08:08:27.648245 8549 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:08:27.647302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55522 (local address 127.15.36.253:36671)
0811 08:08:27.647347 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:27.647350 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:27.647601 (+ 251us) server_negotiation.cc:407] Connection header received
0811 08:08:27.647710 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:27.647711 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:27.647725 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:27.647756 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:27.648169 (+ 413us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55522: BlockingRecv error: recv got EOF from 127.0.0.1:55522 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260811 08:08:27.666723 8549 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:08:27.665761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55526 (local address 127.15.36.253:36671)
0811 08:08:27.665807 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:27.665809 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:27.666082 (+ 273us) server_negotiation.cc:407] Connection header received
0811 08:08:27.666194 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:27.666195 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:27.666209 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:27.666240 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:27.666657 (+ 417us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55526: BlockingRecv error: recv got EOF from 127.0.0.1:55526 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260811 08:08:27.701349 8549 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:08:27.700339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55536 (local address 127.15.36.253:36671)
0811 08:08:27.700389 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:27.700391 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:27.700670 (+ 279us) server_negotiation.cc:407] Connection header received
0811 08:08:27.700785 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:27.700786 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:27.700799 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:27.700831 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:27.701272 (+ 441us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55536: BlockingRecv error: recv got EOF from 127.0.0.1:55536 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260811 08:08:27.767765 8549 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:08:27.766775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55550 (local address 127.15.36.253:36671)
0811 08:08:27.766850 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:27.766852 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:27.767119 (+ 267us) server_negotiation.cc:407] Connection header received
0811 08:08:27.767208 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:27.767209 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:27.767222 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:27.767299 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:27.767682 (+ 383us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55550: BlockingRecv error: recv got EOF from 127.0.0.1:55550 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
W20260811 08:08:27.898000 8549 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:08:27.897023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55566 (local address 127.15.36.253:36671)
0811 08:08:27.897131 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:27.897134 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:27.897296 (+ 162us) server_negotiation.cc:407] Connection header received
0811 08:08:27.897379 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:27.897380 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:27.897394 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:27.897482 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:27.897922 (+ 440us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55566: BlockingRecv error: recv got EOF from 127.0.0.1:55566 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 08:08:28.038089 8636 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b392945996f44179d86e890198ff0d8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3b392945996f44179d86e890198ff0d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b392945996f44179d86e890198ff0d8" member_type: VOTER last_known_addr { host: "127.15.36.254" port: 37283 } } peers { permanent_uuid: "e76feeeb79f34746aacfc8ff98c9fb76" member_type: VOTER last_known_addr { host: "127.15.36.253" port: 36671 } } peers { permanent_uuid: "ba5a8ca48d4c4a73a8aeddb25ed6c3ce" member_type: VOTER last_known_addr { host: "127.15.36.252" port: 36743 } } }
I20260811 08:08:28.038261 8636 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b392945996f44179d86e890198ff0d8 [sys.catalog]: This master's current role is: LEADER
W20260811 08:08:28.156461 8549 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:08:28.155684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55576 (local address 127.15.36.253:36671)
0811 08:08:28.155776 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:28.155779 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:28.155812 (+ 33us) server_negotiation.cc:407] Connection header received
0811 08:08:28.155851 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:28.155852 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:28.155861 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:28.155927 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:08:28.156388 (+ 461us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55576: BlockingRecv error: recv got EOF from 127.0.0.1:55576 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 08:08:28.561334 8671 catalog_manager.cc:1259] Loaded cluster ID: f760e5b1982b439fb830056f7485cc6d
I20260811 08:08:28.561427 8671 catalog_manager.cc:1552] T 00000000000000000000000000000000 P ba5a8ca48d4c4a73a8aeddb25ed6c3ce: loading cluster ID for follower catalog manager: success
I20260811 08:08:28.562299 8671 catalog_manager.cc:1574] T 00000000000000000000000000000000 P ba5a8ca48d4c4a73a8aeddb25ed6c3ce: acquiring CA information for follower catalog manager: success
I20260811 08:08:28.562628 8671 catalog_manager.cc:1602] T 00000000000000000000000000000000 P ba5a8ca48d4c4a73a8aeddb25ed6c3ce: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 08:08:28.603735 8695 catalog_manager.cc:1259] Loaded cluster ID: f760e5b1982b439fb830056f7485cc6d
I20260811 08:08:28.603850 8695 catalog_manager.cc:1552] T 00000000000000000000000000000000 P e76feeeb79f34746aacfc8ff98c9fb76: loading cluster ID for follower catalog manager: success
I20260811 08:08:28.604810 8695 catalog_manager.cc:1574] T 00000000000000000000000000000000 P e76feeeb79f34746aacfc8ff98c9fb76: acquiring CA information for follower catalog manager: success
I20260811 08:08:28.605170 8695 catalog_manager.cc:1602] T 00000000000000000000000000000000 P e76feeeb79f34746aacfc8ff98c9fb76: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 08:08:28.672384 8777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:28.669690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60076 (local address 127.15.36.253:36671)
0811 08:08:28.669826 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:28.669828 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:28.669841 (+ 13us) server_negotiation.cc:407] Connection header received
0811 08:08:28.669898 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:28.669899 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:28.669955 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:28.670037 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:08:28.670222 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:28.670774 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:28.671623 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:28.671837 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:28.671907 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:28.672053 (+ 146us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:08:28.672172 (+ 119us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:08:28.672235 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:28.672288 (+ 53us) server_negotiation.cc:299] Negotiation successful
0811 08:08:28.672307 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":64,"threads_started":1}
I20260811 08:08:28.677210 8783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:28.674412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44834 (local address 127.15.36.252:36743)
0811 08:08:28.674598 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:28.674600 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:28.674609 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:08:28.674680 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:28.674681 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:28.674743 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:28.674858 (+ 115us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:08:28.675089 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:28.675627 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:28.676368 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:28.676589 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:28.676665 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:28.676834 (+ 169us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:08:28.676949 (+ 115us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:08:28.677031 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:28.677084 (+ 53us) server_negotiation.cc:299] Negotiation successful
0811 08:08:28.677107 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":71,"threads_started":1}
I20260811 08:08:28.682175 8783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:28.679001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44836 (local address 127.15.36.252:36743)
0811 08:08:28.679147 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:28.679149 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:28.679352 (+ 203us) server_negotiation.cc:407] Connection header received
0811 08:08:28.679427 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:28.679428 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:28.679438 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:28.679491 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:08:28.679637 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:28.680126 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:28.681140 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:28.681480 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:28.681547 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:28.681734 (+ 187us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:08:28.681771 (+ 37us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:08:28.681828 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:28.682063 (+ 235us) server_negotiation.cc:299] Negotiation successful
0811 08:08:28.682091 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124}
I20260811 08:08:28.682250 8777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:28.679074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60092 (local address 127.15.36.253:36671)
0811 08:08:28.679127 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:28.679130 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:28.679244 (+ 114us) server_negotiation.cc:407] Connection header received
0811 08:08:28.679313 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:28.679314 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:28.679328 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:28.679382 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:08:28.679574 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:28.680423 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:28.681385 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:28.681674 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:28.681755 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:28.681939 (+ 184us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:08:28.681975 (+ 36us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:08:28.682030 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:28.682137 (+ 107us) server_negotiation.cc:299] Negotiation successful
0811 08:08:28.682170 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 08:08:28.683008 8789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:08:28.678925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58012 (local address 127.15.36.254:37283)
0811 08:08:28.679234 (+ 309us) server_negotiation.cc:206] Beginning negotiation
0811 08:08:28.679236 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:08:28.679247 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:08:28.679361 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:08:28.679363 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:08:28.679430 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:08:28.679508 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:08:28.679679 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:28.680524 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:28.681528 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:08:28.681903 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:08:28.681968 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:08:28.682240 (+ 272us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:08:28.682723 (+ 483us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:08:28.682781 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 08:08:28.682837 (+ 56us) server_negotiation.cc:299] Negotiation successful
0811 08:08:28.682858 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":273,"thread_start_us":75,"threads_started":1}
I20260811 08:08:28.685017 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 8389
I20260811 08:08:28.693634 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 8471
I20260811 08:08:28.701429 15507 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP5pk_f/build/release/bin/kudu with pid 8552
2026-08-11T08:08:28Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (2908 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (5871 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (307864 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST